Principal Data Scientist

We are seeking a highly skilled Principal Data Scientist to focus on the cutting-edge field of agent orchestration. This role is responsible for designing, implementing, and deploying sophisticated systems that enable AI agents to execute complex, multi-step tasks autonomously. A deep, practical understanding of Large Language Models (LLMs) and the ability to rigorously evaluate agent system performance are non-negotiable.

●     Agent Orchestration Development: Design and build advanced orchestration layers, including planning, memory management, tool-use logic, and iterative reasoning loops for autonomous agents.

●     Production Deployment: Lead the deployment of LLM-powered features and agent systems into production environments, ensuring scalability, latency targets, and reliability.

●     Mandatory Evaluation Mastery: Own the definition, implementation, and analysis of agent and LLM evaluation benchmarks (reference tests, heuristics, model-graded evaluation). This includes metrics for helpfulness, accuracy, hallucination, and safety.

●     Framework Implementation: Leverage and contribute to modern agentic frameworks (e.g., LangChain, AutoGen, CrewAI, custom internal frameworks) to build out capabilities.

●     Research to Production: Translate the latest advancements in LLM and agent research into robust, production-ready features, collaborating closely with research scientists.

A/B Testing: Design and execute rigorous A/B tests on prompts, system settings, and model versions, making data-driven recommendations for rollouts or rollbacks.

●     10+ years of professional experience in machine learning engineering, NLP, or AI R&D.

●     Mastery of LLM/Agent Evaluation: Demonstrated expertise in setting up, running, and analyzing evaluation systems for LLMs and agentic workflows.

●     Production Experience (Mandatory): Extensive, hands-on experience putting LLMs and at least one major agentic framework (or equivalent custom architecture) into high-volume production.

●     Strong software engineering foundation, primarily in Python, with experience writing clean, maintainable, and efficient code.

●     Experience in the advanced mechanisms and libraries around python, pytorch, langchain, llama index, deepeval, scikit learn.

●     Deep understanding of LLM mechanisms (prompt engineering, fine-tuning, RAG, function/tool calling).

●     Experience with observability tools (logging, tracing, monitoring) for real-time model performance diagnostics.

●     Background in academic research (publications) related to AI, NLP, or reinforcement learning.

●     Experience optimizing inference pipelines for performance and cost.

Familiarity with safety and guardrail systems for generative AI.

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.