Senior Python Dev. (AI Engineer)
Quick Summary
ROKO Labs is a fast-growing strategic product and technology consultancy based in NYC. We are seeking a highly motivated and resourceful person who enjoys solving complex problems! We have a great track record of working with large Fortune 500 companies and VC-backed start-ups.
Architect and develop scalable, production-grade Python applications, including LLM-powered systems, RESTful APIs, and microservices using FastAPI, Flask, or Django Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines,…
7+ years of software development experience, with the latest 1–2 years focused on AI/LLM-powered solutions Strong, expert-level Python skills — Python is the primary language for this role Proven hands-on experience building and deploying LLM…
ROKO Labs is a fast-growing strategic product and technology consultancy based in NYC. We are seeking a highly motivated and resourceful person who enjoys solving complex problems! We have a great track record of working with large Fortune 500 companies and VC-backed start-ups. We are incredibly proud of our work and would be excited to share it with you! Our clients value that we understand their businesses and help to build products that users love! Additionally, our extended team spans multiple countries, making for fun cultural exchanges.
ROKO Labs is looking for a Senior Python Engineer with deep AI expertise to join our team working on large-scale, production-grade intelligent systems. If you love writing clean, well-tested Python code, thrive in cross-functional environments, and are excited about building real-world AI solutions — come join a team of like-minded, caring professionals.
About the Role
~1 min readYou will be a core technical contributor on complex AI-powered projects, combining strong Python engineering fundamentals with hands-on experience in modern AI/ML technologies. You'll work closely with Product Owners, customers, engineering, and data teams to translate requirements into robust, scalable systems — and take real ownership of technical decisions.
Responsibilities
~1 min read- →Architect and develop scalable, production-grade Python applications, including LLM-powered systems, RESTful APIs, and microservices using FastAPI, Flask, or Django
- →
Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines, embedding workflows, and semantic search solutions in Python
- →
Build, optimize, and maintain data ingestion pipelines and background task processing using Celery, RabbitMQ, or Kafka
- →
Integrate and manage LLM APIs and AI platforms (e.g., OpenAI, Anthropic, Azure OpenAI) within robust Python service architectures
- →
Design and optimize database schemas and queries across relational (PostgreSQL, MySQL) and NoSQL (MongoDB, DynamoDB) databases
- →
Design scalable vector database architectures (e.g., Pinecone, Weaviate) to support AI-driven search and retrieval features
- →
Containerize and orchestrate Python services using Docker and Kubernetes for reliable, repeatable cloud deployments (AWS, Azure, or GCP)
- →
Identify and resolve performance bottlenecks in Python applications through profiling, caching strategies, and code optimization
Requirements
~1 min read- 7+ years of software development experience, with the latest 1–2 years focused on AI/LLM-powered solutions
- Strong, expert-level Python skills — Python is the primary language for this role
- Proven hands-on experience building and deploying LLM applications, especially RAG-based systems
- Good knowledge of Python web frameworks and libraries: Django, Flask, FastAPI
- Experience with data-processing libraries: Pandas, NumPy, Scikit-learn
- Solid understanding of vector databases (e.g., Pinecone, Weaviate) and semantic search architectures
- Experience integrating LLM APIs (OpenAI, Anthropic, Azure OpenAI)
- Strong understanding of RESTful APIs, microservices, and scalable backend architecture
- Good working knowledge of cloud platforms: AWS, Azure, or GCP
- Solid experience with SQL and relational databases (PostgreSQL, MySQL)
- Experience with messaging queues (RabbitMQ, Kafka) and Docker
- Experience with NoSQL databases (MongoDB, DynamoDB) — a plus
- Strong testing, debugging, and problem-solving skills
- Strong communication skills; Intermediate English or higher
- BSc/MSc in Computer Science, Engineering, AI, or a related field
Nice to Have
~1 min read- Experience with multi-agent AI system design
- Familiarity with alternative vector databases (FAISS, Milvus)
- Experience with the Hugging Face ecosystem or fine-tuning open-source models
- Hands-on experience with advanced MLOps frameworks and model governance
- Experience with system architecture or leading a software team
- PhD (completed or in progress) in a relevant field
What We Offer
~2 min readLocation & Eligibility
Listing Details
- Posted
- April 23, 2026
- First seen
- May 6, 2026
- Last seen
- May 8, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 28%
- Scored at
- May 6, 2026
Signal breakdown
Please let roko-labs know you found this job on Jobera.
3 other jobs at roko-labs
View all →Explore open roles at roko-labs.
Similar Python jobs
View all →Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.