Senior AI Engineer (Internal Tools & Agents)
Quick Summary
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior AI Engineer (Internal Tools & Agents) based in Australia.
We are looking for a hands-on Senior AI Engineer to build and scale AI-powered internal tools and intelligent Agent workflows that improve business operations and decision-making. You will take ownership of the full development lifecycle, from understanding operational challenges and designing solutions to backend implementation, system integrations, evaluation, and ongoing optimization. Working with large language models and production-grade AI systems, you will create reliable, secure, and observable applications that deliver measurable value to internal users. You will collaborate with teams across Product, Engineering, and Operations to turn complex needs into practical technical solutions. This role combines strong backend engineering with applied AI expertise, emphasizing quality, adoption, and continuous improvement. Join a global, fully remote environment where you can contribute to challenging projects and help shape the future of AI-enabled workflows.
Design, develop, maintain, and improve AI-powered internal tools that streamline workflows and support better business decisions.
Build sophisticated Agent workflows incorporating context management, tool calling, knowledge retrieval, structured outputs, state management, and human approval or escalation processes.
Integrate AI applications with internal data sources, APIs, business systems, and third-party services.
Develop reliable and scalable backend services and APIs that support production AI applications.
Work directly with internal stakeholders to understand operational processes, identify pain points, and define measurable success criteria.
Translate ambiguous business requirements into clear, testable, and deliverable technical solutions.
Measure the impact of deployed tools through adoption, task-completion quality, time savings, error reduction, and other relevant performance indicators.
Use production data, user feedback, and observed failures to prioritize improvements and continuously enhance solutions.
Create evaluation datasets and regression tests for prompts, models, retrieval pipelines, tools, and end-to-end workflows.
Establish release validation processes to detect quality regressions and unintended effects before deployment.
Compare models and technical approaches based on output quality, latency, reliability, security, and cost.
Implement robust handling of timeouts, retries, rate limits, asynchronous jobs, partial failures, and third-party dependency issues.
Build and maintain logging, tracing, monitoring, versioning, and recovery mechanisms for AI workflows.
Apply appropriate access controls, data-handling policies, human approval steps, and audit trails for sensitive internal processes.
Troubleshoot issues across model behavior, prompts, knowledge sources, retrieval quality, tool responses, business rules, and backend infrastructure.
Collaborate with AI engineers and stakeholders across Product, Engineering, Operations, and other functions to deliver effective solutions.
Communicate technical feasibility, risks, costs, trade-offs, and alternative approaches clearly, while breaking larger initiatives into manageable delivery stages.
Proactively communicate progress, blockers, timelines, and next steps, and document systems and technical decisions to support long-term maintainability.
Requirements
~2 min readAt least 4 years of professional software engineering experience, with strong backend development fundamentals.
At least 1–2 years of hands-on experience building LLM-powered applications, Agent workflows, or AI automation systems.
Demonstrated experience launching AI applications for real users and improving them using production data and user feedback.
Practical experience with tool calling, retrieval-augmented generation (RAG), knowledge retrieval, workflow orchestration, structured outputs, and stateful Agent systems.
Experience developing production services, APIs, data pipelines, and integrations with internal or third-party systems.
Strong hands-on proficiency in Golang. Golang is used for production development, and candidates must be able to complete the technical coding assessment in this language.
Practical Python experience for LLM and AI application development.
Experience creating evaluation datasets, regression tests, monitoring systems, and release validation processes for LLM applications.
Strong debugging and problem-solving skills across models, prompts, retrieval systems, tools, application logic, and backend infrastructure.
Strong ownership and accountability, including the ability to identify risks early, follow through after launch, and verify that delivered solutions achieve their intended outcomes.
Fluent spoken and written English, as it is the working language for daily communication and collaboration.
Clear communication and collaboration skills, particularly in distributed and cross-functional teams.
Nice to have:
Experience developing internal productivity tools, enterprise AI applications, or workflow automation platforms.
Familiarity with MCP, Agent frameworks, LLM gateways, tracing platforms, or model evaluation tools.
Experience with permission systems, audit logs, sensitive-data management, and human-in-the-loop workflows.
Background in crypto, Web3, financial services, or other security-sensitive industries.
Familiarity with self-custody wallets, blockchain data, on-chain transactions, or cryptocurrency operations.
Experience deploying and operating services using cloud infrastructure, containers, and Kubernetes.
What We Offer
~2 min readCompetitive salary and benefits package.
Fully remote working arrangement within a global organization.
Flexible working hours.
Opportunity to work on challenging, innovative AI projects with real operational impact.
Collaboration with diverse, highly skilled international teams.
Flat organizational structure that encourages ownership and cross-functional collaboration.
Learning and professional development opportunities.
Career growth within a fast-moving technology and blockchain ecosystem.
Opportunity to contribute to security-focused AI tools and workflows in the Web3 environment.
Applicants must have the legal right to work in the country where they are based.
Location & Eligibility
About this job
- Who can apply
- Australia
- Posted
- Today
Listing Details
- Posted
- November 20, 2026
- First seen
- November 20, 2026
- Last seen
- November 20, 2026
Posting Health
- Days active
- 0
- Repost count
- 1
- Trust Level
- 62%
- Scored at
- November 20, 2026
Signal breakdown
4 other jobs at
View all →Similar Machine Learning Engineer jobs
View all →Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.