Staff Backend Engineer, ML Inference Systems
New York, NY, USA•Mountain View, USA
Posted 4 hours ago
Last seen 4 hours ago
Active
full-time
AI & Machine Learning
$192,600—$271,900 USD
Job Summary
Join Unity's Vector Gamer AI team as a Staff Backend Engineer to build and operate the critical infrastructure for large-scale ML inference systems, impacting billions of daily gaming experiences. This role offers the chance to drive technical direction and ensure the performance and reliability of distributed systems.
About this job
As a Staff Backend Engineer, you will design, develop, and deploy production-grade backend services and distributed systems for large-scale online model inference. You will focus on the performance, reliability, and scalability of inference systems, partnering with ML engineers to ensure infrastructure scales with growing model complexity and inference volumes. This role involves optimizing cloud infrastructure on GCP and orchestrating workloads with Kubernetes.
Requirements
- 5+ years designing, deploying, and maintaining distributed systems at scale
- Expertise in Golang for building high-performance, low-latency backend infrastructure
- Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes
- Strong grounding in monitoring and observability tooling, including Prometheus and Grafana
- Experience in ad tech, recommender systems, real-time personalization, or other performance-critical domains
- Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices
- Familiarity with machine learning platforms, workflows, and serving infrastructure
- Experience with ML inference servers like NVIDIA Triton Inference Server
- Familiarity with auction mechanics or bidding systems in an ad tech context
- Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security
Benefits & Perks
- Comprehensive health, life, and disability insurance
- Commute subsidy
- Employee stock ownership
- Competitive retirement/pension plans
- Generous vacation and personal days
- Support for new parents through leave and family-care programs
- Office food snacks
- Mental Health and Wellbeing programs and support
- Employee Resource Groups
- Global Employee Assistance Program
- Training and development programs
- Volunteering and donation matching program
Apply for this position
You'll be redirected to the company's application page to complete your application.
Related Jobs
Similar positions you might be interested in
Explore Categories
Browse jobs by department and skill area