Research Scientist - Geo-Distributed Inference

Pluralis Research

San Francisco, CARemote onlyFull time
Invite-only right now: save jobs, track applications, build tailored resumesAlready have an account? Log in
Location
San Francisco, CA
Work style
Remote only
Job type
Full time
Posted
Oct 14
5 days ago
Career path

See where this role leads

Jigup maps the next three moves from a job like this one, with the titles and the skills each step asks for.

Join the waitlist

About the company

Pluralis Research

Internet · 2 to 10 employees

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report https://arxiv.org/abs/2607.13332). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning https://pluralis.ai/blog/a-third-path-protocol-learning/.

Pluralis Research on LinkedIn

What you'll do

  • Build and own the inference stack end-to-end, including execution, placement, routing, transport, serving, and failure handling.
  • Develop and deploy inference algorithms, and keep the rollout pipeline reliable for RL training before evolving it into model serving.

What you need

  • Must have shipped serving-engine internals or built a large-scale inference system, and be able to work hands-on.
  • Research ability and low-bandwidth networking experience are strong signals; professional-level written and spoken English is required.

Key skills

serving-engineer internalslarge-scale inference systemdistributed inferencepipeline parallelismlow-bandwidth networkingRL post-trainingApple siliconMLXP2P networkingNAT traversalprofessional-level English

Keywords for your resumePro

The words this employer's screening is likely to look for.

This job lists resume keywords

The terms this posting uses, pulled out so you can mirror them in your resume. Jigup Pro members see the list on the job board.

Join the waitlist

Perks

  • Equity-Heavy Package
  • Visa Sponsorship
  • relocation support
  • Flexible work environment

See full description on company page, apply now

Read the full posting here
Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report https://arxiv.org/abs/2607.13332). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning https://pluralis.ai/blog/a-third-path-protocol-learning/. Our inference pipeline generates the rollouts for reinforcement learning (RL) training today, and it'll serve our models once they're trained. It also runs in a permissionless, trustless setting, which makes the usual serving problem much harder. The hardware is Macs and consumer GPUs owned by strangers, the network is the public internet, nodes join and leave mid-run, and the weights change under the server as training moves. Your primary role is to build the systems that keep this pipeline fast and reliable under these conditions. KEY RESPONSIBILITIES - Own the inference stack: You build and own it end-to-end. Pipeline-parallel execution, placement and routing, the transport, the serving engine, and failure handling. You set the direction, and you make things happen. - Invent the algorithms: Making inference fast on consumer hardware over the public internet takes methods that don't exist yet. You design them, validate them, and put them in production. - Serve training and users: You keep the rollout pipeline fast and reliable for RL training now, and turn it into the serving layer for our models once they're trained. WHAT WE'RE LOOKING FOR - Shipped serving systems: You've shipped serving-engine internals or built a large-scale inference system yourself, and you can do this work hands-on today. - Research ability: Publications (papers and blogposts) in distributed inference or a nearby field, such as LLM serving systems, pipeline parallelism over slow networks, or decentralized training, are a strong signal. So is unpublished work you can walk us through. - Low-bandwidth networking: Experience with systems that run in low-bandwidth, high-latency settings like the public internet is a strong signal. - Mission alignment: You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI. NICE TO HAVE - Familiarity with RL post-training. - Exposure to Apple silicon or MLX. - Experience with P2P networking and NAT traversal. - Experience at proprietary, open-weight and open-source AI labs COMPENSATION & BENEFITS - Equity-Heavy Package: We offer significant ownership for key technical contributors in addition to a high base salary. - Remote-First Culture: Flexible work environment with team members distributed globally. - Visa Sponsorship: Optional full visa sponsorship and relocation support to either Australia or the US. - Open Problems: Training and serving frontier models on hardware you don't control, over networks you don't own, mostly has no published answers yet. You'll write some of the first ones. FYI'S - We work remotely across the world, with the main teams in Australia and North America. You'll need to be comfortable working across timezones. - Applicants must have professional-level English proficiency (written and spoken). - Recruiters: we aren't looking for agency support at this time. We'll reach out if we need help. We are backed by Union Square Ventures https://www.usv.com/ and other tier-1 investors, and we are a world-class, deeply technical team of ML researchers. Pluralis is unapologetically ideological. We believe AI, and the world, end up on a better path if we succeed in implementing the protocol for intelligence. If this resonates, please apply.

More entry level jobs in San Francisco, CA

All jobs in San Francisco, CA

More jobs at Pluralis Research

Ready to apply?

Jigup is invite-only right now. Join the waitlist to save jobs, track applications, and build tailored resumes.

Join the waitlist