PhD Research Intern — Learned End-to-End Driving and Actuation

Zendar

Berkeley, CAOn-siteInternship
Invite-only right now: save jobs, track applications, build tailored resumesAlready have an account? Log in
Location
Berkeley, CA
Work style
On-site
Job type
Internship
Posted
Oct 13
6 days ago
Career path

See where this role leads

Jigup maps the next three moves from a job like this one, with the titles and the skills each step asks for.

Join the waitlist

About the company

Zendar

Computer software · 51 to 200 employees

Most autonomy stacks are built around a single major sensor, usually the camera, with every other sensor secondary. Zendar took a different path: an early-fusion camera and radar perception system, in bird's-eye view and in 3D, in which each sensor plays a major role, trained data-efficiently on a multi-million-sample labelled dataset we collected ourselves. We own the whole pipeline, sensor setup and calibration, learned perception, lane estimation and map integration, and that vertical integration lets us move fast on hard problems. We are now turning to what comes after perception: action and actuation, using the full pipeline to actuate autonomously in the real world, for autonomous vehicles and robotics, in a learned, end-to-end way. A learned motion planner drives on that stack today; this role is about the research that takes it further.

Zendar on LinkedIn

What you'll do

  • Own a research direction on the production planner, evaluate changes against the current planner, investigate failures, and present results to the team's leads.

What you need

  • Must be a final-year PhD student, or within 12 months of defending, in computer science, electrical engineering, robotics or a related field.
  • Requires first-author research in a relevant area, Python and PyTorch, and an end-to-end grasp of the ML pipeline, including real sensor data.
  • Education: a postgraduate degree

Key skills

PythonPyTorchmotion forecastinggenerative modelsreinforcement learningimitation learningclosed-loop simulationreal sensor dataCommunicationteamwork

Keywords for your resumePro

The words this employer's screening is likely to look for.

This job lists resume keywords

The terms this posting uses, pulled out so you can mirror them in your resume. Jigup Pro members see the list on the job board.

Join the waitlist

Perks

  • Daily catered lunches
  • fully stocked fridge

See full description on company page, apply now

Read the full posting here
Most autonomy stacks are built around a single major sensor, usually the camera, with every other sensor secondary. Zendar took a different path: an early-fusion camera and radar perception system, in bird's-eye view and in 3D, in which each sensor plays a major role, trained data-efficiently on a multi-million-sample labelled dataset we collected ourselves. We own the whole pipeline, sensor setup and calibration, learned perception, lane estimation and map integration, and that vertical integration lets us move fast on hard problems. We are now turning to what comes after perception: action and actuation, using the full pipeline to actuate autonomously in the real world, for autonomous vehicles and robotics, in a learned, end-to-end way. A learned motion planner drives on that stack today; this role is about the research that takes it further. The Perception and Machine Learning Team is looking for a final-year PhD student to join us as a Research Intern on learned planning and actuation, on-site in Berkeley, CA. The internship is a mutual trial for a full-time research position on the team. The Role You will own one research direction on the production planner, working with the researchers who ship it, on real fleet data, and present your results to the people who decide what ships. What a successful planner means to us, and what we will measure you against: Understands what is missing: finds the mechanism behind a driving planner's failures and shows which gap matters before changing anything. Handles the long tail, never gets stuck and knows how to get itself unstuck: agile, it commits, launches, re-plans and recovers on its own. Collision- and comfort-aware, and generalizes across structured environments (roads, lanes, intersections) and unstructured ones (lots, yards, sites, robotics settings). Knows how to test and evaluate actuation and planning pipelines: open-loop, closed-loop and on-vehicle, with metrics that predict road behavior. Production quality, not a proof of concept: tested code, reproducible results, behavior that holds across checkpoints and scenes. This is our standard and our measure of success. Potential Projects Generative planning with flow matching: a flow-matching or diffusion policy over ego trajectories with few-step inference and explicit constraint guidance in the sampler. The long tail: data balancing and hard-case mining, counterfactual and generative scenario synthesis, or reasoning-augmented planners. Closed-loop evaluation and training that matches our sensors: counterfactual observations faithful to radar and camera features, so closed-loop metrics predict road behaviour. Post-training with reinforcement learning: rule-reward or closed-loop fine-tuning, parallel imitation + RL—and whether the gain survives a real sensor stack and a safety layer. Your own idea: tokenized planning with learned scoring, a world model as the planner's critic, uncertainty-aware ranking, self-play traffic. Every change is evaluated closed-loop and open-loop against the current planner, failures examined and not just counted, and results presented to the team's leads. We support publication of non-proprietary findings. What We Look For Final-year PhD student (or within 12 months of defending) in computer science, electrical engineering, robotics or a related field, available for an on-site internship in Berkeley. First-author work in motion forecasting or planning, generative models for sequential decision making (diffusion, flow matching), reinforcement or imitation learning for control, or closed-loop simulation and evaluation. Python and PyTorch: you can read a large model file, change the loss, and prove it did what you intended; a solid grasp of the ML pipeline end to end, including real sensor data and its problems. Communication, teamwork and brainstorming matter to us as much as the technical bar: work in the open, take and give review well, bring half-formed ideas to the whiteboard early. Research here is a team sport. Bonus Points Publications at CVPR, ICCV, ECCV, NeurIPS, ICLR, ICRA, CoRL or RSS on end-to-end driving, trajectory generation, world models or RL post-training. Results on a closed-loop benchmark (Bench2Drive, NAVSIM v2, Waymo Sim Agents, nuPlan), and an opinion on where those benchmarks mislead. Radar, lidar or multi-sensor BEV perception; multi-day GPU-cluster training kept honest (checkpoint variance, clean ablations); vision-language-action models or constraint-guided sampling. What We Offer A research problem with a direct line to the product, and a defined path to a full-time research position on the team. A dedicated multi-GPU cluster allocation and access to Zendar's fleet data, labels and closed-loop evaluation pipeline from day one; mentorship by the team's technical lead and a weekly research review with its research leads. A young, venture-backed company in an emerging market, with a multidisciplinary team of experts in hardware, signal processing and machine learning. Daily catered lunches and a fully stocked fridge. Zendar is committed to creating a diverse environment where talented people come to do their best work. We are proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. Zendar participates in E-Verify

More entry level jobs in Berkeley, CA

All jobs in Berkeley, CA

Ready to apply?

Jigup is invite-only right now. Join the waitlist to save jobs, track applications, and build tailored resumes.

Join the waitlist