Machine Learning Engineer — Distillation
Open 9 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
ABOUT THE ROLE
We’re looking for a Machine Learning Engineer focused on model distillation to help us build smaller, faster, and more efficient models without sacrificing quality. You’ll work at the intersection of research and production—taking cutting-edge techniques and turning them into systems that scale.
This is a hands-on role with real ownership: you’ll design distillation pipelines, run large-scale experiments, and ship models used in production.
WHAT YOU’LL DO
- Design and implement knowledge distillation pipelines (teacher–student, self-distillation, multi-teacher, etc.)
- Distill large foundation models into smaller, faster, and cheaper models for inference
- Run and analyze large-scale training experiments to evaluate quality, latency, and cost tradeoffs
- Collaborate with research to translate new distillation ideas into production-ready code
- Optimize training and inference performance (memory, throughput, latency)
- Contribute to internal tooling, evaluation frameworks, and experiment tracking
- (Optional) Contribute back to open-source models, tooling, or research
WHAT WE’RE LOOKING FOR
- Strong background in machine learning or deep learning
- Hands-on experience with model distillation (LLMs or other neural networks)
- Solid understanding of training dynamics, loss functions, and optimization
- Experience with PyTorch (or JAX) and modern ML tooling
- Comfort running experiments on multi-GPU or distributed setups
- Ability to reason about model quality vs. performance tradeoffs
- Pragmatic mindset: you care about shipping, not just papers
NICE TO HAVE
- Experience distilling LLMs or large sequence models
- Experience with inference optimization (quantization, pruning, kernels, etc.)
- Familiarity with evaluation for language models
- Open-source contributions or research publications
- Experience in early-stage or fast-moving startups
WHY JOIN
- Work on core model quality and cost efficiency—not side projects
- High ownership and direct impact on product and roadmap
- Small, senior team with strong research + engineering culture
- Competitive compensation + meaningful equity
- Remote-friendly, async-first environment
Apply on Featherless AI's site
Attention Head lists this role as published on Featherless AI's own job board. Applications go to the employer.
Similar roles at other employers
- Robotics Machine Learning EngineerPantograph · San Francisco$150K–260K
- AI Training EngineerBlank Metal · Minneapolis, MNNov 20, 2026
- AI Process Automation Engineer - Security (Job 1534)DLH · Bethesda, Maryland$110K–145K
- Forward Deployed EngineerHandshake · San Francisco, CA$151K–189K
- Forward Deployed Software Engineer, Connected Warfare (Active Clearance)Anduril · Washington, District of Columbia, United States$166K–253K
All mid-level AI/ML Engineering roles →
More roles at Featherless AI
- Founding Business Development Rep (AI Cloud US/CA)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; San Francisco Office; Austin; Montreal; Toronto; Halifax; Charlotte; Seattle; Dallas-Fort Worth; Fairfax; Boston; Houston; Raleigh; Washington; Chicago; Phoenix; Scottsdale; Denver; VancouverSep 18, 2026
- Founding Account Executive (AI Cloud)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; Austin; Montreal; Toronto; Halifax; Dallas-Fort Worth; Boston; Houston; Washington; VancouverSep 18, 2026
- Business Development Rep (AI Cloud)Europe; Prague; Lisbon; London; Milan; Munich; Madrid; Berlin; Amsterdam; Barcelona; Oslo; Manchester; Helsinki; Paris; Dublin; Bucharest; Athens; Cambridge; StockholmMay 15, 2026
- AI Researcher — Training OptimizationRemote (world)Jan 23, 2026
- AI Researcher – Multilingual DataRemote (world)Jan 23, 2026
- AI Researcher — AI Architecture ResearchRemote (world)Jan 23, 2026
- AI Researcher — DistillationRemote (world)Jan 23, 2026
- AI Researcher — Inference OptimizationRemote (world)Jan 23, 2026