Overview

Microsoft AI is looking for a Member of Technical Staff – Full Stack Software Engineer to help build the next wave of capabilities for our personalized AI assistant, Copilot. At Microsoft AI, we push boundaries to deliver exceptional products and services that empower users to be more productive and efficient. If you are passionate about innovation and want to shape the future of AI, this is your opportunity. 

In this role, you will work across all four stages of our evaluation platform: data sampling, AI data collection and processing, data analysis and evaluation, and insight generation. You will contribute across the full stack—from backend databases and middle-tier services to browser automation, statistical analysis, and dashboard creation. Expect to dive into prompt engineering and leverage cutting-edge AI tools to drive meaningful impact. 

This engineering position offers exposure to a wide range of technologies and surfaces, including desktop, web, and mobile. You will collaborate closely with teams across Microsoft AI to assess Copilot’s relevance, performance, trustworthiness, and visual appeal. Our platform supports desktop and mobile automation and UX studies—enabling scenarios like multi-turn conversations with voice input on iOS and Android apps. The possibilities are endless. 

Our newly formed organization, Microsoft AI, is dedicated to advancing Copilot and other consumer AI products and research. This Copilot team collaborates with Bing, Edge, MSN, and Shopping. Join us in shaping the future of personal computing powered by AI. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

By applying for this position, you are required to be local to Redmond, WA or Mountain View, CA locations and in office 4 days a week.  

Responsibilities

• Expertise in experimentation methodologies, including A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis. 
• Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.
• Designing pipeline architecture to ensure rapid iteration and scalability.
• Conducting post-analysis of labeled data and developing dashboards to visualize insights.
• Collaborating closely with the product team to enhance quality and address gaps.
• Embody our Culture and Values.

Qualifications

Required Qualifications: 

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, or Python 
  • OR equivalent experience. 

Preferred Qualifications: 

• 2+ years’ experience with SQL, PostgreSQL or MySQL 
• 2+ years' experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP. Extensive use datastores like RDBMS, key-value stores, etc.  
• Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code 
• HTML, CSS, JavaScript, ASP.NET, REST, jQuery  
• Familiarity with browser automation tools like Selenium, Puppeteer or Playwright  
• Familiarity with mobile automation tools like Appium 
• Familiarity with LLMs and AI ChatBots 
• Prompt EngineeringAzure DevOps, GIT 
• Azure Open AI, Azure Foundry 
• Experience in leading technical projects and supporting architectural decisions with data.  

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.