AI Researcher — Distillation
Open 9 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
ABOUT THE ROLE
We’re looking for an AI Researcher focused on model distillation to help us push the frontier of efficient, high-performance models. You’ll work on turning large, expensive models into smaller, faster, and more deployable systems—while maintaining or improving quality.
This role is ideal for someone who enjoys publishing research, working close to real systems, and seeing their ideas move from papers → code → production.
WHAT YOU’LL WORK ON
- Design and evaluate model distillation techniques (teacher–student training, self-distillation, layer-wise distillation, representation matching, etc.)
- Research tradeoffs between model size, latency, memory, and accuracy
- Develop novel distillation approaches for:
- Large language models
- Long-context or specialized architectures
- Inference-constrained environments
- Run large-scale experiments and ablations; analyze results rigorously
- Collaborate with engineers to productionize research outcomes
- Write and submit research papers to top-tier venues (NeurIPS, ICML, ICLR, COLM, etc.)
- Contribute to internal research notes, technical blogs, and open-source projects when appropriate
WHAT WE’RE LOOKING FOR
Required
- Strong background in machine learning research
- Hands-on experience with model distillation or closely related topics (compression, pruning, quantization, representation learning)
- Publication experience (conference or journal papers, workshop papers, or arXiv preprints)
- Solid understanding of deep learning fundamentals (optimization, training dynamics, generalization)
- Fluency in PyTorch (or equivalent) and research-grade experimentation
- Ability to clearly communicate research ideas, results, and limitations
Nice to Have
- Experience distilling large language models
- Work on efficiency-focused research (latency, memory, throughput)
- Experience with long-context models or non-Transformer architectures
- Open-source contributions in ML or research tooling
- Prior startup or applied research experience
WHY JOIN US
- Real ownership over research direction at a Series A stage
- Strong support for publishing and open research
- Tight feedback loop between research and real-world deployment
- Access to meaningful compute and production-scale problems
- Small, highly technical team with deep ML and systems expertise
EXAMPLE BACKGROUNDS
- ML researchers from academia transitioning to industry
- Research engineers with published work in model efficiency
- PhD / Post-doc graduates or industry researchers who still want to publish
Apply on Featherless AI's site
Attention Head lists this role as published on Featherless AI's own job board. Applications go to the employer.
Similar roles at other employers
- Research Engineer, FinetuningAnthropic · San Francisco, CA | New York City, NY | Seattle, WA$500K–850K
- Researcher, Cyber Safety TrainingOpenAI · San Francisco$380K–500K
- Base Labs Research Scientist - RL EnvironmentsBaseten · San Francisco; New YorkNov 20, 2026
- Research EngineerTuring · Bengaluru, Karnataka, IndiaNov 20, 2026
- Machine Learning ScientistASOS · London, England, United KingdomNov 20, 2026
All mid-level Research roles →
More roles at Featherless AI
- Founding Business Development Rep (AI Cloud US/CA)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; San Francisco Office; Austin; Montreal; Toronto; Halifax; Charlotte; Seattle; Dallas-Fort Worth; Fairfax; Boston; Houston; Raleigh; Washington; Chicago; Phoenix; Scottsdale; Denver; VancouverSep 18, 2026
- Founding Account Executive (AI Cloud)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; Austin; Montreal; Toronto; Halifax; Dallas-Fort Worth; Boston; Houston; Washington; VancouverSep 18, 2026
- Business Development Rep (AI Cloud)Europe; Prague; Lisbon; London; Milan; Munich; Madrid; Berlin; Amsterdam; Barcelona; Oslo; Manchester; Helsinki; Paris; Dublin; Bucharest; Athens; Cambridge; StockholmMay 15, 2026
- AI Researcher — Training OptimizationRemote (world)Jan 23, 2026
- AI Researcher – Multilingual DataRemote (world)Jan 23, 2026
- AI Researcher — AI Architecture ResearchRemote (world)Jan 23, 2026
- AI Researcher — Inference OptimizationRemote (world)Jan 23, 2026
- Machine Learning Engineer — AI Architecture ResearchRemote (world)Jan 22, 2026