Machine Learning Engineer — Training Optimization
Open 9 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
ABOUT THE ROLE
We’re looking for an ML Engineer focused on training optimization to help us scale and improve large-scale model training. You’ll work at the intersection of research and production, optimizing training pipelines for speed, stability, and cost—while collaborating closely with researchers pushing model architecture and capability forward.
This is a high-impact role with real ownership: your work directly affects how fast we can iterate, how large we can scale, and how efficiently we deploy new models.
WHAT YOU’LL DO
- Optimize large-scale model training pipelines (throughput, convergence, stability, and cost)
- Improve distributed training strategies (data, model, and pipeline parallelism)
- Tune optimizers, schedulers, batch sizing, and precision (bf16 / fp16 / fp8)
- Reduce training time and compute cost via profiling, bottleneck analysis, and systems-level improvements
- Collaborate with researchers on architecture-aware training strategies
- Build and maintain robust training infrastructure (checkpointing, fault tolerance, reproducibility)
- Evaluate and integrate new training techniques (e.g. gradient checkpointing, ZeRO, FSDP, custom kernels)
- Own training performance metrics and continuously push them forward
WHAT WE’RE LOOKING FOR
- Strong experience training large neural networks (LLMs or similarly large models)
- Hands-on experience with training optimization (not just model usage)
- Solid understanding of:
- Backpropagation, optimization algorithms, and training dynamics
- Distributed systems for ML training
- Experience with PyTorch (required)
- Comfort working close to hardware (GPUs, memory, networking constraints)
- Ability to move fluidly between research ideas and production-ready code
NICE TO HAVE
- Experience with large-scale distributed training (multi-node, multi-GPU)
- Familiarity with DeepSpeed, FSDP, Megatron, or custom training stacks
- Experience optimizing training on AMD or NVIDIA GPUs
- Contributions to open-source ML infrastructure or research codebases
- Exposure to non-Transformer architectures (RNNs, hybrid models, etc.)
WHY JOIN US
- Real ownership at Series-A stage — your work shapes the company’s trajectory
- Work on cutting-edge models and training systems at scale
- Small, highly technical team with fast feedback loops
- Strong emphasis on engineering quality and research rigor
- Competitive compensation + meaningful equity
Apply on Featherless AI's site
Attention Head lists this role as published on Featherless AI's own job board. Applications go to the employer.
Similar roles at other employers
- Robotics Machine Learning EngineerPantograph · San Francisco$150K–260K
- AI Training EngineerBlank Metal · Minneapolis, MNNov 20, 2026
- AI Process Automation Engineer - Security (Job 1534)DLH · Bethesda, Maryland$110K–145K
- Forward Deployed EngineerHandshake · San Francisco, CA$151K–189K
- Forward Deployed Software Engineer, Connected Warfare (Active Clearance)Anduril · Washington, District of Columbia, United States$166K–253K
All mid-level AI/ML Engineering roles →
More roles at Featherless AI
- Founding Business Development Rep (AI Cloud US/CA)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; San Francisco Office; Austin; Montreal; Toronto; Halifax; Charlotte; Seattle; Dallas-Fort Worth; Fairfax; Boston; Houston; Raleigh; Washington; Chicago; Phoenix; Scottsdale; Denver; VancouverSep 18, 2026
- Founding Account Executive (AI Cloud)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; Austin; Montreal; Toronto; Halifax; Dallas-Fort Worth; Boston; Houston; Washington; VancouverSep 18, 2026
- Business Development Rep (AI Cloud)Europe; Prague; Lisbon; London; Milan; Munich; Madrid; Berlin; Amsterdam; Barcelona; Oslo; Manchester; Helsinki; Paris; Dublin; Bucharest; Athens; Cambridge; StockholmMay 15, 2026
- AI Researcher — Training OptimizationRemote (world)Jan 23, 2026
- AI Researcher – Multilingual DataRemote (world)Jan 23, 2026
- AI Researcher — AI Architecture ResearchRemote (world)Jan 23, 2026
- AI Researcher — DistillationRemote (world)Jan 23, 2026
- AI Researcher — Inference OptimizationRemote (world)Jan 23, 2026