Overview#MSC IDC
Are you looking for an opportunity to work with the latest Azure offerings and push the limits of cloud computing?

Are you inspired to push the boundaries of how intelligent systems transform cloud experiences?

Do you want to solve real-life challenges in intelligent cloud and enable customers to achieve more?

If so, we have the perfect role for you!

We are part of the Microsoft Specialized Cloud organization, delivering Azure to customers on their premises.

Our team is innovating new technologies for managing Edge Devices from Azure in a safe, secure, sovereign, reliable, and scalable model for our global customers across various Azure Geographies.

We pride ourselves in developing technologies that enhance customer experience and enable using edge computing to address customer workload needs and managing edge devices in Azure.

We build ecosystems that bring intelligence to locations where customers are running their business.

We enable real-time decision-making, ultra-low-latency experiences, and trustworthy AI systems that operate securely at the edge and in the cloud.

If you’re passionate about AI-driven engineering — from intent understanding and data-driven insights to autonomous orchestration and predictive edge intelligence — this is where your work will have global impact.

As part of this role in the Microsoft Specialized Cloud team, you operate as a senior technical leader shaping the data & analytics foundations that power this org’s products and platforms at a global scale.

The engineer will collaborate with Product, Engineering, and Data Science stakeholders from multiple teams to analyse data requirements, understand the data flow across existing and new products, differentiate human vs. AI Agent generated data, lead the design of data models, run the product with an AI first mindset.

You will be responsible for identifying data sources, building code to extract raw data, and transforming it into formats compatible with downstream consumers.

You will develop tools, do performance monitoring, and perform root cause analysis of issues to ensure robust and reliable data pipelines.

You will define architectural direction, influence multi-team roadmaps, and set data engineering standards that enable reliable, secure, and scalable analytics for AI-driven products.

To accelerate our Copilot and agent-driven initiatives across Edge you will have to own the technical vision, system design, and implementation strategy for next-generation AI copilots.

Responsibilities:

• Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support products data analytics initiatives.
• Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas.
• Data Governance & Trust: Enforce best practices for data quality, lineage, security, and compliance.
• Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable.
• Cross-functional Collaboration: Work closely with product managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals.
• Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information.
• Translate ambitious vision into actionable roadmaps and measurable outcomes.
• Design, architect, and implement backend, and service components to support multi-step Copilot flows, including data orchestration, context management, and state persistence
• Integrate LLMs and APIs to enable context-aware, human-in-the-loop experiences across customer scenarios
• Evaluate AI/ML different models, and tune then to suit the product needs

Qualifications:

• 10+ years of experience in Software Development.
• 4+ years of experience designing, developing, deploying, and monitoring cloud services/RESTful service/Distributed system.
• Deep experience architecting and operating large-scale distributed data systems in cloud environments, preferably Azure.
• Exposure to AI/LLM integration, function calling, or semantic retrieval systems is highly desirable.
• Ability to write clean, working code using core algorithms, data structures, and analytics oriented problem solving.
• Extensive experience in implementing and optimizing data pipelines and distributed data systems (e.g., Azure Data Lake, Spark, Synapse, SQL databases).
• Understanding of data governance, privacy, lineage, and security best practices, especially within highly regulated or enterprise environments.
• Excellent communication skills to convey complex technical concepts to both technical and non-technical audiences.
• Expertise with modern data engineering languages and frameworks (e.g., Azure Data Explorer, Py Spark, SQL, etc).

Experience: collaborating in cross-functional teams and building consensus among stakeholders with diverse backgrounds (engineering, analytics, product, business).

• Track record of driving innovation in data engineering, including experience leading technical projects and mentoring others.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer.

All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances.

If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.