Primoria AI is entering Year 2, and we're looking for a Senior AI/ML Lead Engineer to help build the infrastructure layer for the next generation of AI agents. This is a high-ownership, high-impact role. If you've shipped production ML systems, understand orchestration, and want to work on real problems — keep reading.
🧠
About Primoria AI
Primoria AI builds memory-first, model-agnostic AI infrastructure. Our Router V3 powers adaptive inference across multiple models (OpenAI, Anthropic, Llama, open-source) with persistent memory, real-time web search, and enterprise-grade audit logging.
We're backed by Microsoft for Startups, AWS, GCP, and Cloudflare with $500K in cloud credits. 16x H100 cluster spinning up this week. 137 users in alpha. And we're open-sourcing our orchestration engine.
We move fast, ship real code, and value builders over talkers.
🎯
The Role
This is not a "fine-tune a model and call it a day" role.
You'll be architecting and building core AI infrastructure — orchestration, memory systems, inference optimization, and multi-model routing. You'll work directly with the Founder/CEO and have real ownership over technical direction.
🔧
Responsibilities
→ Design and implement production ML pipelines and inference systems
→ Optimize model serving (vLLM, TensorRT, quantization, batching)
→ Build and improve our multi-model orchestration layer (Router V3)
→ Develop persistent memory and RAG systems (Azure AI Search, vector DBs)
→ Train and fine-tune large language models (70B+ parameters)
→ Implement evaluation frameworks and observability
→ Contribute to open-source releases
→ Ship code. Every week.
✅
What We're Looking For
→ 5+ years in ML/AI engineering (production systems, not just notebooks)
→ Deep experience with LLMs, transformers, and inference optimization
→ Strong Python skills (FastAPI, async, production-grade code)
→ Experience with cloud infrastructure (Azure preferred, AWS/GCP also fine)
→ Familiarity with vLLM, DeepSpeed, or similar serving/training frameworks
→ Understanding of RAG, vector databases, and retrieval systems
→ Ability to work independently with minimal supervision
→ Bias toward shipping over perfecting
🔥
Bonus Points
→ Experience with MoE architectures or multi-model routing
→ Contributions to open-source AI projects
→ Experience scaling ML systems to production traffic
→ Familiarity with AKS, Kubernetes, containerized ML deployments
🚫
This Role Is Not
→ Entry-level or junior
→ A research-only position (we ship production code)
→ A role for someone who needs hand-holding
→ Remote-optional with "flexible" meaning "slow"
Ownership, speed, and craft are required.
📩
How to Apply
Send your resume, GitHub, and a short note on what you've shipped to: careers@primoria.com
Do not DM applications.
If you've read this far and thought "finally, a real engineering role" — we want to hear from you.
— AJ
Founder & CEO, Primoria AI
Work at primoria.com? Sign in to claim this org and manage its profile.