attention head AI jobs Alerts Saved
Jobs › Rakuten Group, Inc.

Distributed Training & Inference Optimization Engineer (LLM) - GPU Optimization Department (GPUOD)

Rakuten Group, Inc. · Tokyo, Japan
Apply on Rakuten Group, Inc.'s site
Tailor my resume
Posted
Aug 26, 2026
Last verified
22 min ago
Level
Mid
Function
AI/ML Engineering
AI rolePyTorchCUDATritonKubernetesLLMsGPU

Job Description:
Business Overview
AI & Data Division (AIDD) spearheads data science & AI initiatives by leveraging data from Rakuten Group. We build a platform for large-scale field experimentations using cutting-edge technologies to provide critical insights that enable faster and better and faster contribution for our business. Our division boasts an international culture created by talented employees from around the world. Following the strategic vision “Rakuten as a data-driven membership company”, AIDD is expanding its data & AI related activities across multiple Rakuten Group companies.

Department Overview
GPU Optimization Department (GPUOD) is responsible for the strategic management, optimization, and governance of Rakuten's company-wide AI infrastructure, ensuring high-performance, cost-efficient utilization of compute resources for machine learning workloads. We oversee a large-scale hybrid infrastructure spanning thousands of accelerators, including the latest Hopper and upcoming Blackwell architectures.
As a central enabler for AI innovation, we:

Position:
Why We Hire

Position Details
As a GPU Training & Inference Optimization Engineer, you will focus on maximizing the performance, efficiency, and scalability of LLM training and inference workloads on Rakuten’s GPU clusters. You will deeply optimize training frameworks (e.g., PyTorch, DeepSpeed, FSDP) and inference engines (e.g., vLLM, TensorRT-LLM, Triton, SGLang), ensuring Rakuten’s AI models run at peak efficiency.
This role requires strong expertise in GPU-accelerated ML frameworks, distributed training, and inference optimization, with a focus on reducing training time, improving GPU utilization, and minimizing inference latency.

Key Responsibilities

Mandatory Qualifications:

Desired Qualifications:

#engineer #applicationsengineer #AI #aianddatadiv

Languages:
English (Overall - 3 - Advanced)

Apply on Rakuten Group, Inc.'s site

Attention Head lists this role as published on Rakuten Group, Inc.'s own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All mid-level AI/ML Engineering roles in Japan →

More roles at Rakuten Group, Inc.

All roles at Rakuten Group, Inc. →