attention head AI jobs Alerts Saved
Jobs › Microsoft

Senior Applied Scientist

Microsoft · Redmond, WA, US
Apply on Microsoft's site
Tailor my resume
Posted
Oct 14, 2026
Last verified
19 min ago
Salary
$120K – $235K / year
Level
Senior
Function
Research
AI roleLLMsEvals

11% below the median for senior Research roles in the United States · median $200K a year, from 134 roles that state pay

Not mentioned in the posting. Microsoft filed 13,473 H-1B, H-1B1 or E-3 applications in FY2025–FY2026, 1,822 for workers changing employer. Its US visa filings

Overview
The Copilot Offline Evaluation Platform (COEP) team provides the evaluation data, environments, and capabilities that Microsoft Copilot product teams use to make faster, more confident release decisions. We are seeking a Senior Applied Scientist to improve how well offline evaluations represent and predict real customer experiences. You will develop scientific methods for extracting representative query and intent patterns from Copilot traffic, generating high-quality synthetic evaluation data, measuring and improving query-set and tenant representativeness, reproducing customer dissatisfaction scenarios as compliant evalsets, and increasing alignment between offline evaluation results and online shadow experiments. You will partner closely with engineering, product, and research teams to turn these methods into scalable capabilities used across Copilot, including evaluation of long-running agents and generative AI systems.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

Qualifications
Required Qualifications:

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

Preferred Qualifications:

#AppliedSciences #MachineLearning #ArtificialIntelligence #Copilot #Evaluation #MicrosoftCareers

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Apply on Microsoft's site

Attention Head lists this role as published on Microsoft's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Research roles in the United States →

More roles at Microsoft

All roles at Microsoft →