Machine Learning Engineer — AI Architecture Research
Open 9 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
ABOUT THE ROLE
We’re looking for a Machine Learning Engineer focused on AI architecture research to help design, prototype, and validate next-generation model architectures. You’ll work at the intersection of research and production — turning new ideas into scalable, real-world systems.
This role is ideal for someone who enjoys questioning architectural assumptions, experimenting with novel model designs, and pushing beyond standard Transformer-style approaches.
WHAT YOU’LL WORK ON
- Research and develop new neural network architectures (e.g. alternatives or extensions to Transformers, recurrent / hybrid models, long-context systems)
- Design and run architecture-level experiments (scaling laws, memory mechanisms, compute trade-offs)
- Prototype models end-to-end — from research code to training-ready implementations
- Collaborate with inference and systems engineers to ensure architectures are deployable and efficient
- Analyze model behavior, failure modes, and inductive biases
- Read, reproduce, and extend cutting-edge research papers
- Contribute to internal research notes, benchmarks, and open-source efforts (where applicable)
WHAT WE’RE LOOKING FOR
- Strong background in machine learning fundamentals and deep learning
- Hands-on experience implementing model architectures from scratch
- Solid understanding of:
- Attention mechanisms, RNNs, state-space models, or hybrid architectures
- Training dynamics, scaling behavior, and optimization
- Memory, latency, and compute constraints at the model level
- Comfortable working in PyTorch or JAX
- Ability to move fluidly between theory, experimentation, and engineering
- Clear communicator who can explain architectural trade-offs
NICE TO HAVE
- Experience with non-Transformer architectures (RNN variants, SSMs, long-context models)
- Background in research-driven startups or open-source ML projects
- Experience with large-scale training or custom training loops
- Publications, preprints, or notable research contributions
- Familiarity with inference optimization and deployment constraints
WHY JOIN
- Work on core model architecture, not just fine-tuning
- Direct influence on the technical direction of a Series-A company
- Small, high-caliber team with fast feedback loops
- Opportunity to ship research into production
- Competitive compensation + meaningful equity
Apply on Featherless AI's site
Attention Head lists this role as published on Featherless AI's own job board. Applications go to the employer.
Similar roles at other employers
- Robotics Machine Learning EngineerPantograph · San Francisco$150K–260K
- AI Training EngineerBlank Metal · Minneapolis, MNNov 20, 2026
- AI Process Automation Engineer - Security (Job 1534)DLH · Bethesda, Maryland$110K–145K
- Forward Deployed EngineerHandshake · San Francisco, CA$151K–189K
- Forward Deployed Software Engineer, Connected Warfare (Active Clearance)Anduril · Washington, District of Columbia, United States$166K–253K
All mid-level AI/ML Engineering roles →
More roles at Featherless AI
- Founding Business Development Rep (AI Cloud US/CA)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; San Francisco Office; Austin; Montreal; Toronto; Halifax; Charlotte; Seattle; Dallas-Fort Worth; Fairfax; Boston; Houston; Raleigh; Washington; Chicago; Phoenix; Scottsdale; Denver; VancouverSep 18, 2026
- Founding Account Executive (AI Cloud)Remote (US & Canada); Atlanta; Los Angeles; Tampa; Miami; Orlando; Ottawa; New York City; Salt Lake City; Nashville; Ashburn; Austin; Montreal; Toronto; Halifax; Dallas-Fort Worth; Boston; Houston; Washington; VancouverSep 18, 2026
- Business Development Rep (AI Cloud)Europe; Prague; Lisbon; London; Milan; Munich; Madrid; Berlin; Amsterdam; Barcelona; Oslo; Manchester; Helsinki; Paris; Dublin; Bucharest; Athens; Cambridge; StockholmMay 15, 2026
- AI Researcher — Training OptimizationRemote (world)Jan 23, 2026
- AI Researcher – Multilingual DataRemote (world)Jan 23, 2026
- AI Researcher — AI Architecture ResearchRemote (world)Jan 23, 2026
- AI Researcher — DistillationRemote (world)Jan 23, 2026
- AI Researcher — Inference OptimizationRemote (world)Jan 23, 2026