预训练数据工程师
Moonshot AI · 北京市
Apply on Moonshot AI's siteTailor my resume
Posted
Jun 9, 2026Last verified
20 min agoEmployment
Full-timeLevel
MidFunction
AI/ML EngineeringAI roleSpark
岗位职责
- 设计和优化大规模 Web 爬虫的 URL 发现与调度系统,持续扩大数据覆盖面
- 建设多因子抓取优先级体系,在有限资源下最大化高质量页面的获取效率
- 主导反爬对抗和动态渲染方案,提升核心站点的抓取成功率
- 建立数据质量评估闭环,从域名到页面的多层级质量管控
- 优化大规模数据处理管线的性能和稳定性
希望你具备以下经验
- 大规模搜索引擎或 Web 爬虫系统实战经验,做过百亿级以上 URL 池的全链路
- 深入理解全网 URL 发现的多种手段
- 熟悉主流反爬机制及对抗方案
- 扎实的分布式数据处理能力(Spark / Flink 等)
强烈加分
- 有大模型预训练语料采集和清洗经验
Attention Head lists this role as published on Moonshot AI's own job board. Applications go to the employer.
Similar roles at other employers
- AI Developer — Interconnect Hardware FrontendNVIDIA · China, ShanghaiNov 16, 2026
- AI Application Engineer, Product EngineeringWestern Digital · Shenzhen, Guangdong Province, ChinaNov 13, 2026
- 泊车感知算法工程师_XCBosch Group · Shanghai, Shanghai, ChinaNov 10, 2026
- AI & ML Engineer | BankingCapco · China - Hong KongNov 6, 2026
- Machine Learning Engineer — AI Agent PlatformVirtuos · Shanghai, ChinaNov 5, 2026
All mid-level AI/ML Engineering roles in China →
More roles at Moonshot AI
- Nov 20, 2026
- Nov 4, 2026
- Nov 2, 2026
- Oct 20, 2026
- Sep 18, 2026
- Sep 18, 2026
- Sep 18, 2026
- Sep 4, 2026