Bigdata Developer with spark

Job Description : Citi are recruiting a Full Stack Data Engineer, reporting to the Engineering Lead, to join the Engineering team for an internal compliance and surveillance line of business. You will be responsible for implementing Data Engineering solutions for Independent Compliance Risk Managers using Big Data Tools. The role requires deep technical knowledge and expertise in software development, including programming languages, frameworks, and best practices. Actively contributes to the implementation of critical features and complex technical solutions. Write clean, efficient, and maintainable code that meets the highest standards of quality. Stay up-to-date with emerging technologies, tools, and industry trends. Evaluate their potential impact on the organization and provide recommendations for technology adoption and innovation. Job Background/context * Candidate should have around 5+ years development and system design experience. * More than 2 years of experience in BigData technologies like spark, hive, python * Candidate should have strong Python programming skill. * Strong experience in building ETL/data engineering solutions. * Demonstrated experience with LLM Model, prompt engineering & AI workflow * Proven proactive problem solving & trouble shooting skills Responsibilities: * Design & develop Data engineering solutions using Big Data Technologies. * Design & Develop and test software applications that leverages LLM Models & AI Capabilities. * Provide technical walk-throughs to various stakeholders * Be able to work independently as well as within a team * Works directly with end-users or a projects team to translate business requirements into technical specifications to drive Semantic layer and report * Prioritize technical issue resolution. * Works closely with management to prioritize business needs and stay up to date with the goals of the organization as they evolve. Also work with other departments to find new ways to improve opportunities * Requirement gathering & understanding, effort estimation, technical design, project planning and monitoring * Understand and analyze the data to find patterns and valuable business insights * Required to review the day to day delivery work with the team, ensuring a robust process implementation, identifying project/program delivery risks and work on risk mitigation. Mandatory Skills: * Strong Knowledge in Spark, Python * Strong experience in Hive/SQL, PL/SQL * Good Understanding of Big data Ecosystem * Good Understanding of ETL & DW Concepts, Unix Scripting * Good understanding of SDLC Desirable Skills: * Previous Experience working with OpenAI, Google AI or similar LLM Providers * Experience integrating AI/ML Models or APIs into Production Applications. * Familiarity with Large language Models, APIs, Prompt Engineering & AI workflow Design * Background in NLP and ML * Cloud Computing AWS/Azure \------------------------------------------------------ ## Job Family Group: Technology \------------------------------------------------------ ## Job Family: Digital Software Engineering \------------------------------------------------------ ## Time Type: Full time \------------------------------------------------------ ## Most Relevant Skills Please see the requirements listed above. \------------------------------------------------------ ## Other Relevant Skills For complementary skills, please see above and/or contact the recruiter. \------------------------------------------------------ Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.