Software Engineer - AI Tooling
Quick Summary
At least 5 years of professional software engineering experience. Strong proficiency in TypeScript and extensive knowledge of the JavaScript ecosystem, including npm, ES modules, bundlers,
As a Software Engineer on the AI Tooling team, you will help shape the next generation of AI-powered developer experiences and tools.
You will design, build, and maintain intelligent agents, Model Context Protocol (MCP) servers, agent skills, and AI-powered assistants.
Your work will make development platforms and products more accessible to AI agents, enabling developers to build smarter applications and workflows.
You will champion an evaluation-first engineering approach, ensuring that every tool is measured against clear quality, reliability, and performance benchmarks.
Working closely with Documentation, CLI, Frontend, SDK, and Infrastructure teams, you will contribute to a consistent and scalable developer experience.
You will also explore emerging AI technologies, experiment with new approaches, and turn promising innovations into production-ready solutions.
This is an opportunity to make a significant impact in a fast-moving, open-source-oriented environment alongside a globally distributed engineering team.
-
Design, develop, and continuously improve AI-powered developer tools, including MCP servers, intelligent agents, agent skills, and dashboard assistants.
-
Ensure new products and features are accessible to AI agents from launch by developing the necessary tools, skills, integrations, and evaluation frameworks.
-
Explore emerging AI technologies and agent architectures, rapidly prototype new solutions, assess their effectiveness, and collaborate with the team to determine which innovations are suitable for production.
-
Establish and promote an evaluation-first engineering culture by developing evaluation frameworks, instrumentation, and feedback loops to measure AI tool quality and effectiveness.
-
Benchmark AI-powered tools against no-tool baselines, monitor performance, and define quality indicators and release criteria to prevent regressions.
-
Analyse how developers and AI agents interact with existing tools and translate usage insights into improvements to interfaces, documentation, and overall functionality.
-
Design and optimise how technical documentation and product knowledge are structured and exposed to AI agents, measuring their effectiveness and accessibility.
-
Develop reusable patterns and tools that enable customers to integrate AI capabilities into their own applications, including MCP integrations with Edge Functions, vector embeddings, and AI agents running on Edge Functions.
-
Enable cross-functional engineering teams to contribute to AI capabilities by providing clear contribution guidelines, templates, documentation, and review processes.
-
Centralise shared AI logic and reusable components to encourage consistency and reduce duplicated development efforts across teams.
-
Ensure production readiness through comprehensive testing, benchmarking, stress testing, and continuous reliability improvements.
-
Collaborate with AI Tooling Infrastructure engineers on service hosting, authentication, scalability, and operational reliability.
-
Work closely with Documentation, CLI, Frontend, SDK, and other engineering teams to deliver a seamless and consistent developer experience.
-
Stay informed about developments in the AI ecosystem and identify opportunities to incorporate relevant technologies and practices into the platform.
Requirements
~2 min read-
At least 5 years of professional software engineering experience.
-
Strong proficiency in TypeScript and extensive knowledge of the JavaScript ecosystem, including npm, ES modules, bundlers, and compatibility considerations.
-
Deep familiarity with the AI ecosystem, including current tools, agent architectures, development patterns, and their practical trade-offs.
-
Ability to distinguish sustainable and effective AI engineering approaches from short-lived trends or unnecessary complexity.
-
Previous experience building developer tools, product interfaces, or platform components used by other engineers.
-
Experience designing, implementing, or working with evaluation frameworks to measure AI quality, reliability, and task success.
-
Understanding of evaluation fundamentals, including baselines, performance variance, cost considerations, and measurable quality improvements.
-
Strong technical judgment when identifying opportunities to use AI effectively while avoiding fragile, unnecessary, or overly complex solutions.
-
Solid testing practices and experience validating software reliability under real-world conditions.
-
Good knowledge of PostgreSQL and relational database principles.
-
Excellent written communication skills and the ability to collaborate effectively across engineering, product, and documentation teams.
-
Comfortable working in asynchronous, globally distributed teams and managing priorities independently.
-
Ability to navigate ambiguity, adapt to rapidly evolving technologies, and deliver high-quality solutions in a fast-paced environment.
-
Experience working with vector databases, embeddings, and semantic search technologies, particularly pgvector.
-
Previous experience shipping customer-facing AI features, intelligent assistants, or autonomous agents.
-
Experience designing technical documentation, structured knowledge bases, or information systems optimised for developers and AI agents.
-
Familiarity with Braintrust or similar AI evaluation and tracing platforms, or experience implementing automated quality gates within CI/CD pipelines.
-
Contributions to open-source projects or experience maintaining developer-focused tools and libraries.
-
Experience collaborating across multiple product areas, engineering teams, or technical platforms.
Additional experience that would be an advantage:
What We Offer
~2 min readLocation & Eligibility
About this job
- Who can apply
- United States
- Posted
- Today
Listing Details
- Posted
- November 12, 2026
- First seen
- November 12, 2026
- Last seen
- November 12, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 68%
- Scored at
- November 12, 2026
Signal breakdown
4 other jobs at
View all →Similar Software Engineer jobs
View all →Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.