Member of Technical Staff — Training Infrastructure
Open 12 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.
To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.
Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.
We look for infrastructure engineers who are excited to tackle unsolved problems. Training an LPM means scaling novel architectures over multimodal physical data — a problem where the playbooks from language and vision only partially apply. Your mission is to make large-scale training fast, efficient, and reliable, so that every GPU cycle accelerates research progress.
Responsibilities
- Design, implement, and optimize distributed training systems that scale across thousands of GPUs
- Research and test parallelization strategies and numerical precision trade-offs across model scales, including for architectures that don't map cleanly onto existing LLM training stacks
- Analyze, profile, and debug low-level GPU operations to maximize throughput and hardware utilization
- Build reusable frameworks for checkpointing, fault tolerance, and reproducibility that stay robust under rapid research iteration
- Collaborate with researchers to bring novel model architectures from prototype to full scale
- Stay up-to-date on research to bring new ideas to work
What we're looking for
We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.
- Demonstrated proficiency with distributed training frameworks and techniques (e.g. FSDP, DeepSpeed, Megatron, Pytorch, JAX/XLA) to train large foundation models
- Strong grasp of state-of-the-art techniques for optimizing training workloads: parallelism strategies, memory optimization, mixed precision, communication overlap
- Ability to profile and debug performance in complex codebases, from framework internals down to kernels and collectives
- Deep understanding of deep learning frameworks (e.g. PyTorch, JAX) and their underlying system architectures
- Bonus: contributions to open-source ML infrastructure (e.g. PyTorch, Megatron-LM, DeepSpeed, XLA)
Attention Head lists this role as published on Causal Labs' own job board. Applications go to the employer.
Similar roles at other employers
- Sr. Staff Forward Deployed EngineerDatabricks · Remote - Washington D.C.; Washington, D.C.Nov 21, 2026
- Staff Applied AI EngineerBILL · United States$209K–250K
- Staff AI Agent Engineer – Moveworks | Partner SuccessServiceNow · New York, New York, United States$167K–291K
- Principal AI EngineerGallatin · El Segundo, CA; Washington, D.C.; Austin, TX; San Francisco, CA$240K–310K
- Member of Technical Staff, Core InfrastructureParallel Web Systems · San Francisco; New York, New York; Palo Alto$150K–300K
All staff and principal AI/ML Engineering roles in the United States →
More roles at Causal Labs
- Member of Technical Staff — DevOpsSan Francisco; SingaporeOct 1, 2026
- Member of Technical Staff — Security EngineeringSan Francisco; SingaporeJul 30, 2026
- Member of Technical Staff — Research, PhysicsSan Francisco; SingaporeJul 21, 2026
- Member of Technical Staff — Research, Atmospheric ScienceSan Francisco; SingaporeJul 20, 2026
- Member of Technical Staff — Research Engineering, EvaluationSan Francisco; SingaporeJul 20, 2026
- Member of Technical Staff — ML Research, PlanningSan Francisco; SingaporeJul 20, 2026
- Member of Technical Staff — ML Research, MultimodalSan Francisco; SingaporeJul 20, 2026
- Member of Technical Staff — Research, Operations & Decision ScienceSan Francisco; SingaporeJul 20, 2026