Research Scientist Intern
Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report https://arxiv.org/abs/2607.13332). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning https://pluralis.ai/blog/a-third-path-protocol-learning/.
This setting breaks nearly every assumption of datacenter training and inference: communication-efficient training across different parallelism axes, fault tolerance as nodes join and drop mid-run, heterogeneous compute and networks, and robustness to malicious participants. Our published methods include Subspace Networks https://arxiv.org/abs/2506.01260, Factored Gossip DiLoCo https://arxiv.org/abs/2606.22768, AsyncMesh https://arxiv.org/abs/2601.22442, and Sentinel https://arxiv.org/abs/2603.03592.
As a Research Scientist Intern you join us for a 6-month, fixed-term research internship during your PhD, focused on publishing. You work on the problems that stay open as we push from the 8B run toward frontier scale, with access to significant compute and focused mentorship from senior scientists. These are foundational papers up for grabs.
KEY RESPONSIBILITIES
- Publish in Tier-1 venues: Conduct novel research in Protocol Learning with the explicit goal of publishing in tier-1 ML conferences (NeurIPS, ICML, ICLR).
- Own a real problem: Pick a question that blocks Protocol Learning at scale and answer it — the internship is scoped so a foundational paper is a realistic outcome, not a stretch goal.
WHAT WE'RE LOOKING FOR
- Publication track record (required): Current PhD candidate with at least one publication in top-tier ML venues (NeurIPS, ICML, ICLR).
- Research focus: You work in a core technical area relevant to frontier models.
- Technical depth: Strong theoretical understanding of deep learning and distributed systems principles.
- Implementation skills: Proficiency in PyTorch and experience with large-scale training infrastructure.
- Mission alignment: You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI.
FYI'S
- This is a 6-month, fixed-term research internship. We only hire in Australia and the US, and visa sponsorship is limited to these countries.
- We work remotely across the world, with the main teams in Australia and North America. You'll need to be comfortable working across timezones.
- Applicants must have professional-level English proficiency (written and spoken).
- Recruiters: we aren't looking for agency support at this time. We'll reach out if we need help.
We are backed by Union Square Ventures https://www.usv.com/ and other tier-1 investors, and we are a world-class, deeply technical team of ML researchers. Pluralis is unapologetically ideological. We believe AI, and the world, end up on a better path if we succeed in implementing the protocol for intelligence. If this resonates, please apply.
Apply on Pluralis Research's site
Attention Head lists this role as published on Pluralis Research's own job board. Applications go to the employer.
Similar roles at other employers
- Research Intern - AI /Machine Learning Numerics & EfficiencyMicrosoft · Mountain View, CA, US; Redmond, WA, US$6.8K–13K/mo
- AI Research Scientist InternBiohub · New York, NY (Hybrid); Redwood City, CA (Hybrid)$64.42–88.32/h
- Intern, Architecture Research Engineer (Agentic AI Workload Characterization)Samsung Semiconductor · San Jose, California, United States$28–68/h
- Research Intern, Summer 2027Basis Research Institute · New York Office; Cambridge Office$100K
- Research Intern: Multimodal Foundation Models for HealthcareBosch Group · Pittsburgh, PA, United StatesNov 16, 2026
All intern Research roles in the United States →
More roles at Pluralis Research
- Research Scientist - Pre-trainingSan Francisco; AustraliaOct 14, 2026
- Research Scientist - Decentralized Training and Inference VerificationSan Francisco; AustraliaOct 14, 2026
- Research Scientist - Geo-Distributed InferenceSan Francisco; AustraliaOct 14, 2026
- Research Scientist - Post-TrainingSan Francisco; AustraliaOct 14, 2026
- Machine Learning Engineer - ML Training PlatformSan Francisco; AustraliaAug 31, 2026
- Research Engineer InternAustraliaAug 31, 2026
- Research Engineer - Decentralized Training and Inference VerificationSan Francisco; AustraliaAug 31, 2026
- Research Engineer - Geo-Distributed InferenceSan Francisco; AustraliaAug 31, 2026