Overview The M365 Core Foundation team is at the heart of Microsoft 365’s infrastructure, powering mission-critical services that serve billions of users. We are seeking talents to help design and implement an intelligent ultra-large-scale Load Balancing system. This system will utilize machine learning, reinforcement learning, and LLMs to analyze the real-time system status data. It will make intelligent load balancing decisions to ensure optimal shard placement and system resource allocation with the highest efficiency and precision.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

• Responsibilities- Build a global optimization engine that generates placement plans (blueprint) to avoid hotspots based on resource constraints, move cost, and availability goals.
• Design and implement centralized algorithms to maximize the utilization of system throughput resources, ensuring swift mitigation of hotspots.
• Collaborate with distributed LB execution layers to coordinate plan rollout and shard migration.
• Partner with Performance, Capacity, Search and Copilot teams to align placement strategies with performance and SLA targets.
• Contribute to observability and debugging tools to ensure transparency and traceability of placement decisions.

Qualifications:

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.
• 3+ years of software development experience, including 2+ years in distributed systems or infrastructure.
• Solid coding skills in C#, C++, or Python.
• Experience with large-scale scheduling, optimization, or resource management systems.
• Familiarity with cloud platforms (Azure preferred) and telemetry pipelines.
• Experience applying ML models or leveraging LLMs to optimize decision-making is preferred.
• Excellent problem-solving and collaboration skills.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:- Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

• OR equivalent experience.
• Experience with telemetry systems and QoS metric analysis.
• Experience applying ML, RL, and LLMs to optimize decision-making.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.