P-1592
At Confidential (Registered Users Only), we are passionate about enabling data and AI teams to solve the world's toughest problems, from making the next mode of transportation a reality to accelerating medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers, and customer obsessed, we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started.
As part of the Unity AI Gateway team, you'll build the control plane that every AI request at Confidential (Registered Users Only) passes through: partner and self-hosted models, agents, coding assistants, and MCP servers. It enforces budgets, routes each request to the right model, and applies guardrails inline. Unity AI Gateway is one of our fastest-growing businesses, moving trillions of tokens per week for thousands of customers.
The impact you will have:
- Build the routing layer that picks the right model for each request across quality, cost, latency, availability, and remaining budget
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with research, platform, infra, and AI/ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Confidential (Registered Users Only)
What we look for:
- 8+ years of experience in backend or infrastructure engineering
- Strong programming skills in Scala, or Go
- Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure
- Familiarity with service-oriented architecture, deployment pipelines, and system observability
- Strong product and ownership mindset. You care about building the right solution, not just any solution
Bonus points for:
- Experience with real-time serving, AI infrastructure, or GPU orchestration
- Exposure to platforms like Bedrock, Vertex AI, or Azure ML
- Experience building developer platforms or internal tools supporting AI workflows