Senior AI Research Scientist (Model-based RL)

Phaidra is building the future of industrial automation.

The world today is filled with static, monolithic infrastructure. Factories, power plants, buildings, etc. operate the same they've operated for decades — because the controls programming is hard-coded. Thousands of lines of rules and heuristics that define how the machines interact with each other. The result of all this hard-coding is that facilities are frozen in time, unable to adapt to their environment while their performance slowly degrades.

Phaidra creates AI-powered control systems for the industrial sector, enabling industrial facilities to automatically learn and improve over time. Specifically:

• We use reinforcement learning algorithms to provide this intelligence, converting raw sensor data into high-value actions and decisions.
• We focus on industrial applications, which tend to be well-sensorized with measurable KPIs — perfect for reinforcement learning.
• We enable domain experts (our users) to configure the AI control systems (i.e. agents) without writing code. They define what they want their AI agents to do, and we do it for them.

Our team has a track record of applying AI to some of the toughest problems. From achieving superhuman performance with DeepMind's AlphaGo, to reducing the energy required to cool Google's Data Centers by 40%, we deeply understand AI and how to apply it in production for massive impact.

Phaidra’s ability to achieve its mission is determined by our ability to work together — as defined by our core values: Transparency, Collaboration, Operational Excellence, Ownership, and Empathy. We seek individuals who embody these values, as they are instrumental in ensuring our team consistently delivers excellence and fosters an engaging and supportive culture

Phaidra is based in the USA, but we are 100% remote with no physical office. We hire employees internationally with the help of our partner, OysterHR. Our team is currently located throughout the USA, Canada, UK, Sweden, Spain, Portugal, the Netherlands, Singapore, Australia, and India.

Research Scientists at Phaidra lead our efforts in developing novel algorithmic architecture towards the end goal of bringing intelligent control systems to industrial sector.

Having pioneered research in the world's leading academic and industrial labs as PhDs, post-docs or professors, Research Scientists join Phaidra to work collaboratively within and across research fields.

Drawing on expertise from a variety of disciplines including model-based reinforcement learning, planning and optimal control, deep learning, world models, and safe reinforcement learning, our Research Scientists are at the forefront of groundbreaking research and applying it to real-world industrial control systems.

• →Design, implement, and evaluate model-based reinforcement learning agents — including planning-based controllers (MPC, MPPI) — and the software prototypes needed to deploy them on real industrial control systems.
• →Develop learned dynamics and world models (learned surrogates) that generalize across systems, including the training pipelines — pretraining, curriculum learning, active/adversarial learning, and fine-tuning — needed to make them reliable for planning and control.
• →Research and implement methods for e.g. safe RL, constrained control, scenario planning and Bayesian RL, to develop agents that satisfy safety constraints during deployment.
• →Report and present research findings and developments including status and results clearly and efficiently both internally and externally, verbally and in writing.
• →Participate in and organize ambitious collaborative research projects, and work with external collaborators and partners to translate research into production outcomes.
• →Mentor and guide Research Engineers to apply research findings and developments to industrial domains.
• →Independently defines new research directions
• →Translates research into practical outcomes
• →Owns the development and rollout for an entire research area or large project

• PhD in a technical field or equivalent practical experience, with a strong background in model-based reinforcement learning and demonstrated knowledge in one or more of the following:
  • Planning algorithms
  • World models / learned dynamics surrogates
  • Reinforcement Learning and Deep Learning
  • Control Theory
  • Safe / constrained RL
• Either:
  • 2+ years of research experience in academia or industry after PhD graduation.
  • 5+ years of research experience in academia or industry after Master’s graduation.
• Extensive research in the fields of {ModelBased, ModelFree, Safe}RL and Control Theory, with particular depth in model-based methods.
• Hands-on experience building and evaluating agents against simulators (e.g. differentiable simulators or world models) and closing the sim-to-real gap.
• Share our company values: Collaboration, Transparency, Operational Excellence, Ownership, and Empathy

• PhD in machine learning, control, or a closely related field.
• Deep, hands-on experience with model-based RL and planning agents applied to real-world dynamical or industrial systems.
• Strong Python and PyTorch skills, including vectorized/differentiable simulators and scaling experiments on distributed compute (e.g. Ray, Kubernetes, GCP).
• A proven track record of publications in RL, control, or a related area.
• A real passion for AI and applying it to industrial systems to improve resource efficiency.

• Python
• PyTorch, scipy
• Kubernetes, Docker, Ray
• GCP

• You will be immersed in an onboarding program that introduces you to Phaidra and our product.
• You will spend time in the research team and get introduced to the different tracks of research that we perform.
• You will learn how other teams operate, interact, and approach problems.
• You will read various parts of our handbook and familiarize yourself with the documentation culture at Phaidra.
• You will set up your development environment and get introduced to various parts of our code base.

• You will have a solid understanding of what Phaidra does and how we do it.
• You will have met with team members across Phaidra and started building relationships that will help you be successful at your job.
• You will have a good understanding of our research tracks, which allowed you to form a plan for your first project, or maybe, you have already started one.

• You will have been fully integrated in the team and with team members across the company.
• You will have started to contribute to knowledge sharing throughout Phaidra.
• Your project is in full swing and you might have some early results already.

All of our interviews are held via Google Meet, and an active camera connection is required.

1. Meeting with People Operations team member (30 minutes) 
2. Meeting with Hiring Manager (30 minutes)
3. Meeting with Research team member (60 minutes)
4. Meeting with Hiring Manager (60 minutes)
5. Culture fit interview with Phaidra’s co-founders (30 minutes)

• Tier 1 (Largest highest-cost metros): £120,276 - £165,379
• Tier 2 (Other major metros): £108,248 - £148,841
• Tier 3 (Mid-sized metro areas): £97,423 - £133,957
• Tier 4 (All other locations): £87,681 - £120,561

In addition to base salary, this position is eligible for equity. Final salary will be determined based on several factors, including a candidate’s qualifications, skills, competencies, experience, expertise, education and location. In some cases, final compensation may fall outside the posted range. Salary ranges are regularly reviewed and may be adjusted in response to market trends.