Software Engineer, AI Platform
Quick Summary
Illustrative, not exhaustive. You will help define this roadmap: Internal AI chat and agent platform: deploy and extend an open-source frontend (e.g., LibreChat,
stay current on the ecosystem, evaluate ne
Aalyria is a leading technology company that supplies laser communications technology and temporospatial software-defined networking platforms to the aerospace industry. With technology acquired from Google, Aalyria is at the forefront of innovation in satellite and airborne mesh networks, as well as cislunar and deep-space communications. We are revolutionizing the orchestration and management of planetary mesh networks using any radio or optical spectrum, any orbit, and any hardware across land, sea, air, and space.
Aalyria is hiring a software engineer to build the AI layer of our engineering organization. This is fundamentally a building role where you will design, ship, and operate internal AI products and platform services, such as chat and agent interfaces, retrieval over our code and docs, AI-integrated developer workflows, sandboxed execution environments, on top of our existing cloud infrastructure (GCP, GKE, Vertex AI, GitLab).
Responsibilities
~1 min read- →Internal AI chat and agent platform: deploy and extend an open-source frontend (e.g., LibreChat, Open WebUI) backed by our existing Vertex AI models and any future inference infrastructure, with SSO, access policy, and the integrations that make it actually useful, RAG and MCP servers tied to our GitLab repos and internal docs, code execution (Code Interpreter-style), and internal tool access.
- →AI-native SWE workflows in GitLab: agents that generate merge requests, respond to review comments, and iterate, so engineers can drive AI work entirely through the review interface they already use.
- →Sandboxes for AI development, with humans and hardware in the loop: isolated, policy-enforced environments where agents (and the engineers supervising them) can safely run code, access repos, and use tools — extending to infrastructure that lets AI safely interact with real hardware in our lab environments.
- →AI observability and cost tracking: request-level telemetry, usage analytics, and cost attribution across all model usage, so we know how AI is being used internally and what it's worth.
- Identifying, building, and maintaining LLM-powered systems across engineering and operations workflows, prioritizing leverage over coverage.
- The design and build of agentic systems and internal AI applications: multi-step pipelines, tool-using agents, retrieval-augmented systems, and internal-facing apps that put model capabilities in front of the right people.
- Owning the AI gateway layer: model routing, credential management, access policy, and request-level telemetry across all model usage.
- Operating what you ship: monitoring, upgrades, incident response, and continuous improvement of the AI stack.
- Partnering with the security/compliance director to understand boundary requirements (CUI handling, data residency, provider selection, audit logging) and translate them into system design, building guardrails in at design time, not as afterthoughts. You bring the engineering; they bring the framework.
- Contributing the technical substance (architecture, data-flow diagrams, logging evidence) that supports compliance documentation owned by the security team.
- Serving as the organization's internal expert on applied AI tooling: stay current on the ecosystem, evaluate new capabilities, and translate them into concrete proposals.
- Reporting periodically to leadership on friction points and opportunities — informing decisions rather than driving adoption targets.
Requirements
~3 min read- Strong software engineering fundamentals: Several years building, shipping, and operating production software. Fluency in at least one of Python, Go, or TypeScript, plus Terraform. We are an infrastructure-as-code company, and infrastructure here is written, reviewed, and shipped like software. Comfort with API design, testing, code review, and owning services in production.
- Hands-on experience building LLM-powered systems: retrieval pipelines, tool use / MCP, agent orchestration, prompt and context management, and evaluating whether any of it actually works.
- Product sense for internal tooling: experience deploying, extending, and integrating open-source applications (chat frontends, gateways, dev tools) rather than building everything from scratch, with a strong instinct for build vs. configure vs. wait.
- Developer-platform integration experience: working with Git-hosting APIs, webhooks, and CI/CD to embed AI into the workflows engineers already live in.
- Cloud and Kubernetes engineering: you build and operate the infrastructure your systems run on yourself, such as containers, Helm, Terraform, GKE, and/or IAM. The platform team reviews your changes the way any senior engineer reviews a colleague's work; they don't implement your designs for you.
- Sandboxing and isolation literacy: understanding of how to safely run model-generated code and constrain agent access (containers, network policy, least-privilege credentials).
- Effective in a regulated environment: not compliance expertise, but the ability to elicit constraints from security stakeholders, ask the right questions, design within hard boundaries, and build systems whose behavior is observable and auditable by construction.
- Clear written communication: Specifically for technical and executive audiences, including candid assessments of what is not working.
- High autonomy: you will define your own roadmap from a clear mandate and validate it directly with the teams you serve.
- Prior work in CMMC, DoD IL, FedRAMP, or NIST 800-171 environments — especially running AI/LLM workloads inside such a boundary.
- Self-hosted inference experience: vLLM/TGI/similar, GPU provisioning and utilization, open-weight model deployment.
- Experience with LLM gateway/proxy layers (e.g., LiteLLM or equivalent) and per-team cost attribution.
- Hardware-in-the-loop or lab-automation experience: test benches, device access control, or safely bridging software systems to physical equipment.
- Familiarity with DLP concepts as they apply at the model/API layer.
- GCP specifically (Vertex AI, GKE, IAP, Artifact Registry); Bazel or other hermetic build systems.
- Observability stack experience (OpenTelemetry, Grafana/Loki/Mimir/Tempo or similar).
This position involves access to export-controlled information. To comply with U.S. government export regulations, applicants must meet one of the following criteria:
(A) Qualify as a U.S. person, which includes:
- U.S. citizen or national
- U.S. lawful permanent resident (green card holder)
- Refugee under 8 U.S.C. 1157
- Asylee under 8 U.S.C. 1158
(B) Be eligible to access export-controlled information without requiring an export authorization.
(C) Be eligible and reasonably likely to obtain the necessary export authorization from the appropriate U.S. government agency.
The company reserves the right to decline pursuing an export licensing process for legitimate business-related reasons.
What We Offer
~1 min readAalyria is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex (including pregnancy, gender identity, and sexual orientation), national origin, age, disability status, genetic information, protected veteran status, or any other characteristic protected by law. Qualified applicants from all backgrounds are encouraged to apply.
Location & Eligibility
Listing Details
- First seen
- July 28, 2026
- Last seen
- July 29, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 61%
- Scored at
- July 28, 2026
Signal breakdown
Please let aalyria-careers know you found this job on Jobera.
3 other jobs at aalyria-careers
View all →Explore open roles at aalyria-careers.
Similar Software Engineer Ai jobs
View all →Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.