PySpark Big Data Developer

Excited to grow your career? We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position you see is right for you, we encourage you to apply! Our people make all the difference in our success. \-------------------------------------------------------------- Market sales Technology is going through several transformational technology initiatives and is looking for Automation Tester to join the global Testing Center of Excellence. This role is based in Pune but it is part of a virtual team with other team members based in the US and India. Description * Work with a cross-functional and geographically dispersed team for quality assurance * Perform end to end features development of application including requirements understanding, impact analysis, development and execution, production deployment and maintenance. * Work with multiple teams to develop, and execute features * Work with teams in a collaborative style to engage partners and proactively manage activities. Skills * At least 4+ years’ experience in Python, SQL and PySpark. * Proficiency in distributed data processing and big data tools and technologies: Hadoop, HDFS, YARN, Spark, Hive * API's and backend development (FASTAPI / FLASK) * Devops: GIT, CI/CD basics, Linux/Unix commands * Design, develop, and maintain big data pipelines using PySpark * Experience with integration of data from multiple data sources * Experience in DevTools like openshift, teamcity, uDeploy, BitBucket, GitHub * Proactively contribute to stability of overall production systems and troubleshoot key components and processes * Keep track of latest technology trends and proactively learn new technologies driving practical and reference implementations Nice to have: * Experience with NoSQL databases, such as ElasticSearch * understand of LLMs, prompt engineering, Data qyery systems (NL to SQL), basic knowledge of vector databases (FAISS, pinecone etc) Qualifications: * Bachelor’s degree (preferably in technology /engineering or related field). What we offer: * Opportunity for professional development in the international and multicultural organization * Unique opportunity to participate in global investment banking projects * Internal and external trainings * Developing opportunities and challenging assignments * Attractive and stable employment conditions * Social benefits (medical care, Benefit System, life insurance, pension scheme) * Flexible working hours \------------------------------------------------------ ## Job Family Group: Technology \------------------------------------------------------ ## Job Family: Applications Development \------------------------------------------------------ ## Time Type: Full time \------------------------------------------------------ ## Most Relevant Skills Please see the requirements listed above. \------------------------------------------------------ ## Other Relevant Skills For complementary skills, please see above and/or contact the recruiter. \------------------------------------------------------ Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.