Senior Data Lead - Azure Data Factory (ADF), Databricks

Job Summary

6-8 Years experience as Azure data engineer along with testing experience who is able to independently work on building and supporting batch and streaming data pipelines using given skills. He will also be involved in solution design and implementation and mentor junior engineers in the team.

Key Responsibilities

Design, build, and optimize scalable data pipelines and analytics solutions using Databricks, SQL, Snowflake, and Azure to support enterprise reporting and AI workloads.

Develop and deploy cloud-native services leveraging Azure Functions, REST/GraphQL APIs, and event-driven architectures with Kafka for real-time data processing.

Implement CI/CD pipelines to automate build, test, and deployment processes, ensuring reliable and secure releases across environments.

Provision and manage cloud infrastructure using Terraform, enforcing infrastructure-as-code and governance best practices.

Integrate AI and GenAI solutions into applications and data platforms, enabling intelligent automation and advanced analytics use cases.

Build, secure, and maintain API integrations, ensuring high performance, scalability, and adherence to enterprise standards.

Skill Requirements

Azure data Engineer, Cloud Data Platforms, SQL, Azure Function, ETL Testing, Integration Testing, Regression Testing, CICD

Other Requirements

1.Relevant certifications in Snowflake, Azure Data Factory (ADF), Data Bricks are a plus.