
Azure Senior Data Lead
About the role
Job Summary
Job Summary
We are looking for a highly skilled Senior Data Engineer to design, build, and maintain scalable data platforms that support analytics, reporting, and data science initiatives. The role requires deep hands-on expertise in** data engineering, cloud platforms, and big data technologies**, along with the ability to guide best practices and mentor junior engineers.
Key Responsibilities
Key Responsibilities
-
Design, develop, and maintain scalable, reliable, and high-performance data pipelines
-
Build and manage ETL/ELT workflows for structured and semi-structured data
-
Develop data solutions using cloud-native services (Azure / AWS / GCP)
-
Implement and optimize data models for analytics and reporting use cases
-
Work with big data frameworks (Spark, Databricks) for large-scale data processing
-
Ensure data quality, consistency, and integrity across systems
-
Optimize data pipelines for performance, cost, and reliability
-
Collaborate with Data Analysts, BI Developers, Data Scientists, and Product Teams
-
Implement data governance, security, and access controls
-
Support CI/CD pipelines and infrastructure automation
-
Mentor junior team members and conduct code/design reviews
-
Participate in Agile ceremonies and provide technical leadership
Skill Requirements
Required Skills & Experience
-
7+ years of hands-on experience in Data Engineering
-
Strong expertise in SQL and at least one programming language (Python preferred)
-
Hands-on experience with:
Big Data technologies (Spark, Databricks, Delta Lake)
-
Cloud platforms (Azure/AWS/GCP)
-
Experience working with:
Data warehouses (Snowflake, Synapse, Redshift, BigQuery, etc.)
-
Data lakes and lakehouse architectures
-
Strong understanding of:
Data modeling (star/snowflake schemas)
-
Data warehousing and ETL/ELT concepts
-
Experience with orchestration tools (Airflow, ADF, Prefect, etc.)
-
Knowledge of version control (Git)and CI/CD pipelines
-
Familiarity with DevOps/DataOps best practices
-
Excellent problem-solving and debugging skills
Other Requirements
Nice to Have
-
Experience with streaming technologies (Kafka, Event Hubs, Kinesis)
-
Exposure to Power BI / Tableau / Looker (consumer perspective)
-
Knowledge of data governance and metadata tools
-
Experience with containerization (Docker, Kubernetes)
-
Cloud certifications (Azure Data Engineer, AWS, GCP)
-
Experience in regulated domains (Banking, Healthcare, Insurance)
Required skills
Data engineering
SQL
Python
ETL/ELT
Cloud platforms
Spark
Databricks
Data modeling
About HCL Technologies
Chennai
Headquarters