Research Scientist
Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report https://arxiv.org/abs/2607.13332). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning https://pluralis.ai/blog/a-third-path-protocol-learning/.
This setting breaks nearly every assumption of datacenter training and inference: communication-efficient training across different parallelism axes, fault tolerance as nodes join and drop mid-run, heterogeneous compute and networks, and robustness to malicious participants. Our published methods include Subspace Networks https://arxiv.org/abs/2506.01260, Factored Gossip DiLoCo https://arxiv.org/abs/2606.22768, AsyncMesh https://arxiv.org/abs/2601.22442, and Sentinel https://arxiv.org/abs/2603.03592.
As a Research Scientist you work on the problems that stay open as we push from the 8B run toward frontier scale, and you publish what you find. These are foundational papers up for grabs.
KEY RESPONSIBILITIES
- Solve the open problems: Identify the questions that block Protocol Learning at scale. communication efficiency, convergence under churn and staleness, heterogeneity, robustness to malicious participants.
- Publish in Tier-1 venues: The problems are hard and largely unclaimed. Solve them, and publish.
- Get the methods into runs: Work with the engineering team so your results land in live training runs, not just papers.
WHAT WE'RE LOOKING FOR
- Research excellence (required): PhD in machine learning with publications in top-tier conferences (NeurIPS, ICML, ICLR).
- Distributed ML experience: Hands-on experience in large-scale distributed training and compression strategies.
- Implementation skills: Strong programming ability in PyTorch.
- Mission alignment: You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI.
NICE TO HAVE
- Experience with foundation model pre-training, post-training, or RL.
- Experience at proprietary, open-weight and open-source AI labs
COMPENSATION & BENEFITS
- Equity-Heavy Package: We offer significant ownership for key technical contributors in addition to a high base salary.
- Remote-First Culture: Flexible work environment with team members distributed globally.
- Visa Sponsorship: Optional full visa sponsorship and relocation support to either Australia or the US.
- Open Problems: Training and serving frontier models on hardware you don't control, over networks you don't own, mostly has no published answers yet. You'll write some of the first ones.
FYI'S
- We work remotely across the world, with the main teams in Australia and North America. You'll need to be comfortable working across timezones.
- Applicants must have professional-level English proficiency (written and spoken).
- Recruiters: we aren't looking for agency support at this time. We'll reach out if we need help.
We are backed by Union Square Ventures https://www.usv.com/ and other tier-1 investors, and we are a world-class, deeply technical team of ML researchers. Pluralis is unapologetically ideological. We view AI and the world on a better path for everyone if we are able to implement the protocol for intelligence.
Apply on Pluralis Research's site
Attention Head lists this role as published on Pluralis Research's own job board. Applications go to the employer.
Similar roles at other employers
- Research Engineer, FinetuningAnthropic · San Francisco, CA | New York City, NY | Seattle, WA$500K–850K
- Researcher, Cyber Safety TrainingOpenAI · San Francisco$380K–500K
- Base Labs Research Scientist - RL EnvironmentsBaseten · San Francisco; New YorkNov 20, 2026
- Machine Learning ScientistCartesian Systems · Cambridge, MANov 20, 2026
- Research Engineer, Computer VisionAvride · Austin, TexasNov 20, 2026
All mid-level Research roles in the United States →
More roles at Pluralis Research
- Research Scientist - Pre-trainingSan Francisco; AustraliaOct 14, 2026
- Research Scientist - Decentralized Training and Inference VerificationSan Francisco; AustraliaOct 14, 2026
- Research Scientist - Geo-Distributed InferenceSan Francisco; AustraliaOct 14, 2026
- Research Scientist - Post-TrainingSan Francisco; AustraliaOct 14, 2026
- Machine Learning Engineer - ML Training PlatformSan Francisco; AustraliaAug 31, 2026
- Research Engineer InternAustraliaAug 31, 2026
- Research Scientist InternSan Francisco; AustraliaAug 31, 2026
- Research Engineer - Decentralized Training and Inference VerificationSan Francisco; AustraliaAug 31, 2026