Machine Learning Engineer - Vision Foundation Models
Zoox
With an account: save jobs, track applications, build tailored resumesAlready have an account? Log in
- Pay
- $254K to $305K
- a year
- Location
- Foster City, CA
- Work style
- Hybrid
- Job type
- Full time
- Posted
- Oct 27
- 3 days ago
Career path
See where this role leads
Jigup maps the next three moves from a job like this one, with the titles and the skills each step asks for.
About the company
Zoox
Automotive · 1,001 to 5,000 employees
What you'll do
- Design, train, and evaluate vision-based in-cabin perception models
- Independently own a model area end to end
- Curate data and train models
- Evaluate and deploy models under real-time and compute constraints
- Work closely with partners across the company
What you need
- MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field with 6+ years of industry experience (PhD with 3+ years).
- Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, and fine-grained classification, with hands-on experience with modern architectures (convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3).
- Strong proficiency in Python and PyTorch for model design, training, and evaluation.
- Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes.
- Track record of owning the full ML lifecycle on real-world data: dataset curation and labeling guidelines, training, metric design (precision, recall, and false-positive rate at an operating point), and error analysis.
- Experience with in-cabin or occupant monitoring (occupant or driver monitoring systems), ideally including multi-camera or fisheye imagery and low-light conditions.
- Experience deploying deep learning models to real-time, resource-constrained systems (robotics, automotive, or edge devices) with TensorRT / ONNX or similar.
- Proficiency in C++ for model integration.
Keywords for your resumePro
The words this employer's screening is likely to look for.
This job lists resume keywords
The terms this posting uses, pulled out so you can mirror them in your resume. Jigup Pro members see the list on the job board.
See full description on company page, apply now
Read the full posting here
The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin. In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle. These models support rider safety and the operations that keep each ride running smoothly.
You will independently own a model area end to end, from data curation and training through evaluation and deployment under real-time and compute constraints, working closely with partners across the company. Your work has a direct impact on rider safety and experience as Zoox scales its robotaxi service.