2h ago
↻ Repost
$152,000/year

Staff Software Engineer

United StatesUnited States·Seattlelead
Software EngineerSoftware Engineering
3 views0 saves0 applied

Quick Summary

Key Responsibilities

Architect and build Coupang's next-generation AI Inference Gateway platform that serves mission-critical machine learning and generative AI workloads at scale.

Requirements Summary

6+ years of professional software development experience. 4+ years of experience designing and operating large-scale distributed systems in production.

Technical Tools
Software EngineerSoftware Engineering

As a Staff Backend Engineer, you will work closely with platform and product leaders to design and deliver solutions for complex infrastructure problems. You will drive the development of highly scalable, reliable, and efficient platform services while providing technical direction across teams working with Java, AWS, Kafka, Kubernetes, Kubeflow, Argo CD, and gRPC.

Responsibilities

~1 min read
  • →Architect and build Coupang's next-generation AI Inference Gateway platform that serves mission-critical machine learning and generative AI workloads at scale.
  • →Design and develop high-performance request routing, model endpoint abstraction, traffic shaping, load balancing, failover, caching, and policy enforcement mechanisms for inference services.
  • →Drive the technical vision and roadmap for scalable, secure, and reliable AI inference infrastructure across cloud and on-prem environments.
  • →Develop critical infrastructure components in Go, Java, or Python with a strong focus on performance, resiliency, and operational excellence.
  • →Design multi-tenant platform capabilities including authentication, authorization, quota management, cost attribution, rate limiting, and governance controls.
  • →Partner closely with ML Platform, Model Serving, Data, and Product Engineering teams to enable seamless deployment and operation of AI workloads
  • →Lead architecture and design reviews, raise engineering standards, and mentor senior engineers across multiple teams.
  • →Optimize system performance, latency, throughput, and infrastructure efficiency for large-scale inference workloads.
  • →Define observability standards through metrics, tracing, logging, and SLO-based operations for business-critical AI services.
  • →Investigate complex production issues, drive root-cause analysis, and implement long-term architectural solutions.
  • →Collaborate with engineering leaders across Coupang to establish common platform standards and unlock AI innovation across the organization.

Requirements

~2 min read
  • 6+ years of professional software development experience.
  • 4+ years of experience designing and operating large-scale distributed systems in production.
  • Strong hands-on programming expertise in one or more of Go, Java, or Python.
  • Proven track record of building highly available, mission-critical platform or infrastructure services.
  • Experience designing API platforms, service gateways, service mesh, or large-scale networking infrastructure.
  • Deep understanding of microservices architecture, distributed systems design, and cloud-native technologies.
  • Experience with Kubernetes and containerized workloads in production environments.
  • Experience operating services on AWS, Azure, or GCP.
  • Strong understanding of observability, reliability engineering, capacity planning, and production operations.
  • Experience building AI/ML inference platforms, LLM gateways, model serving infrastructure, or GPU-accelerated workloads.
  • Deep expertise in Kubernetes ecosystem technologies such as Gateway API, Ingress Controllers, Service Mesh (Istio, Linkerd, Envoy), and platform networking.
  • Experience with inference serving frameworks such as vLLM, Triton Inference Server, TensorRT-LLM, Ray Serve, KServe, SGLang, or similar technologies.
  • Strong understanding of high-performance networking, gRPC, HTTP/2, streaming protocols, API gateways, and service proxy architectures.
  • Experience designing large-scale traffic management systems including routing, retries, circuit breaking, rate limiting, and request prioritization.
  • Experience optimizing latency, throughput, and resource utilization for CPU and GPU workloads.
  • Familiarity with GenAI and LLM ecosystems including model deployment, prompt routing, RAG systems, model observability, and AI governance.
  • Experience with distributed data systems such as Kafka, Cassandra, Redis, MongoDB, or similar technologies.
  • Strong understanding of concurrency, synchronization, asynchronous programming, and non-blocking I/O.

What We Offer

~1 min read

Our compensation reflects the cost of living across several US geographic markets. At Coupang, your base pay is one part of your total compensation.    

The base pay for this position ranges from $152,000/year in our lowest geographic market to $261,000/year in our highest geographic market. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.   

✓Medical/Dental/Vision/Life, AD&D insurance
✓Flexible Spending Accounts (FSA) & Health Savings Account (HSA)
✓Long-term/Short-term Disability
✓Employee Assistance Program (EAP) program
✓401K Plan with Company Match
✓18-21 days of the Paid Time Off (PTO) a year based on the tenure
✓12 Public Holidays
✓Paid Parental leave
✓Pre-tax commuter benefits
✓MTV - [Free] Electric Car Charging Station
  • Application Review - Job Fit Interview - Focus Interview – Offer
  • The exact nature of the recruitment process may vary according to the specific job and may be changed due to scheduling or other circumstances.
  • Interview schedules and the results will be informed to the applicant via the e-mail address submitted at the application stage.
  • This job posting may be closed prior to the stated end date for application if all openings are filled.
  • Coupang has the right to rescind an offer of employment if a candidate is found to have submitted false information as part of the application process.
  • Those eligible for employment protection (recipients of veteran’s benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws.

Coupang is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, or gender (including pregnancy, gender identity, gender expression, sexual orientation, transgender status), national origin, age, disability, medical condition, HIV/AIDS or Hepatitis C status, marital status, military or veteran status, use of a trained dog guide or service animal, political activities, or affiliations, citizenship, or any other characteristic or class protected by the laws or regulations in the locations where we operate. If you need assistance and/or reasonable accommodation in the recruiting process due to a disability, please contact us at usrecruiting@coupang.com.

 

Location & Eligibility

Where is the job
Seattle, United States
On-site at the office
Who can apply
US

About this job

Pay per year
$152,000 a year
18% below the $186,300 median for Software Engineer jobs on Jobera (7,481 salaries).
Who can apply
United States
Posted
Today
Employer
has 706 open jobs on Jobera in 7 countries.

Listing Details

Posted
November 21, 2026
First seen
November 21, 2026
Last seen
November 21, 2026

Posting Health

Days active
-1
Repost count
1
Trust Level
72%
Scored at
November 21, 2026

Signal breakdown

freshnesssource trustcontent trustemployer trust

Coupang is a U.S. retail company known for its fast delivery services and commitment to customer satisfaction.

Employees
5,000+
View company profile
Newsletter

Stay ahead of the market

Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

A
B
C
D
Join 12,000+ marketers

No spam. Unsubscribe at any time.

Staff Software Engineer$152,000/year