Quick Summary
Lead complex, end-to-end delivery of agentic AI solutions, turning ambiguous
What's the role?
As a Senior AI Scientist, you will lead complex agentic AI initiatives from early problem definition through to production and ongoing monitoring. You’ll remain hands-on, designing and adapting approaches across models, retrieval, context, tools, safeguards and evaluation, while solving challenging technical problems and improving existing AI methods.
You’ll bring deep expertise in areas such as model evaluation, AI safeguards, monitoring or agent development, while providing technical leadership across delivery teams. You’ll mentor other AI Scientists, coordinate closely with engineering partners and help strengthen shared scientific standards and approaches.
Key Responsibilities:
- Lead complex, end-to-end delivery of agentic AI solutions, turning ambiguous requirements into clear, testable outcomes.
- Design and compare AI models using real-world measures such as quality, reliability, latency, performance and cost.
- Build hands-on agentic AI workflows across prompts, RAG/retrieval, context, memory, tool use and human hand-offs.
- Design robust AI evaluation frameworks covering datasets, regression testing, bias, data leakage, scoring and model performance.
- Lead Responsible AI and safeguard testing across prompt injection, sensitive data, unsafe outputs, permissions and human oversight.
- Monitor AI solutions in production, using traces, drift, feedback and cost analysis to diagnose issues and improve performance.
- Provide technical leadership and mentoring to AI Scientists, while developing reusable AI patterns, standards and guidance for wider teams.
What do I need?
- Proven experience leading complex, production-ready AI solutions and personally resolving difficult technical or methodological problems.
- Strong hands-on coding and engineering capability across agentic AI, including LLMs, RAG/retrieval, context, memory, routing, tool use and human hand-offs.
- Experience using coding agents for complex delivery, including task planning, appropriate autonomy, automated verification and human oversight.
- Strong model evaluation experience across LLM quality, accuracy, latency, token usage, cost, routing and fallback strategies.
- Ability to design robust AI evaluation methods, including representative datasets, benchmarking, regression testing, uncertainty, bias and data leakage.
- Strong Responsible AI and AI safety expertise, including adversarial testing, prompt injection, sensitive data, permissions, privacy, safeguards and human approval.
- Technical leadership experience, including mentoring AI Scientists, conducting design/code reviews and influencing stakeholders. Experience within banking or another regulated environment is highly desirable.
Why join us?
We’re obsessed with becoming our customers' #1 banking partner for life and we’re looking for people who are passionate about helping us achieve that goal. In return, we’re committed to making Westpac the best place to work in the country. Here are just a few of the ways we’re already doing that:
- Special offers on banking products and discounts from top brands, including generous employee only mortgage rates!
- Flexible work arrangements to help you achieve a greater work/life balance, and a variety of leave options including Culture, Lifestyle and Wellbeing leave.
- Tailored learning and development opportunities to help your grow your career within the bank.
- Lots of opportunities to ‘give back’ to the Community by getting involved in our many volunteering initiatives.
Create your future today
To get started, simply click on the APPLY or APPLY NOW button
We’re all about creating a supportive and inclusive community. We welcome everyone no matter your age, gender, background, or abilities. We also provide additional support to welcome our veterans, Indigenous Australians and neurodiverse community.
If you need any adjustments during the recruitment process, you can find out more information and additional contact details by visiting the "People with Disability and/or needing Accessibility Requirements" page on our website.
Location & Eligibility
About this job
- Who can apply
- Australia
- Posted
- Today
Listing Details
- Posted
- November 20, 2026
- First seen
- November 20, 2026
- Last seen
- November 20, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 56%
- Scored at
- November 20, 2026
Signal breakdown
4 other jobs at
View all →Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.