
Senior Technical Architect
About the role
Job Summary
Job Title: Data Engineering – Technical Architect (Azure & Databricks) Experience: 12+ Years Location: Noida / Hyderabad Role Overview We are looking for a highly experienced Data Engineering Technical Architect with deep expertise in Azure cloud and Databricks to design, build, and scale modern data platforms. The ideal candidate will lead architecture decisions, drive data modernization initiatives, and enable advanced analytics capabilities across the enterprise. Key Responsibilities Architect and design modern data platforms on Azure leveraging Databricks Lakehouse architecture Define and implement end-to-end data pipelines (batch + real-time ingestion, transformation, and serving layers) Lead the design of scalable, high-performance data solutions using Azure services Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks Develop and enforce data architecture standards, governance, and best practices Design and implement data models (Dimensional, Data Vault, Medallion/Lakehouse architecture) Drive data platform modernization initiatives (on-prem to Azure migration) Collaborate with stakeholders to translate business requirements into technical solutions Ensure data quality, lineage, governance, and security compliance Optimize performance of large-scale distributed data processing systems Lead technical teams, provide mentorship, and conduct architecture reviews Enable CI/CD pipelines and DevOps practices for data engineering workflows Evaluate new tools/technologies and drive innovation Required Skills & Qualifications Azure Data Engineering Expertise Strong hands-on experience in: Azure Data Factory (ADF) Azure Databricks (PySpark, Spark SQL) Azure Data Lake Storage (ADLS Gen2) Azure Synapse Analytics Experience with Delta Lake, Lakehouse architecture, and Medallion design (Bronze/Silver/Gold layers) Databricks & Big Data Deep expertise in: Apache Spark (Py Spark/Scala) Databricks workflows, jobs, clusters, notebooks Performance tuning and optimization in distributed environments Experience with streaming frameworks (Structured Streaming, Kafka/Event Hub) Data Engineering & Architecture Strong experience in data warehousing concepts and data modeling Expertise in ETL/ELT frameworks and pipeline orchestration Advanced SQL skills across platforms (Synapse, SQL Server, Snowflake, Teradata preferred) Experience designing real-time and batch data pipelines Programming & DevOps Proficiency in: Python (mandatory) SQL and optionally Scala Experience with: Git, CI/CD pipelines (Azure DevOps) Infrastructure as Code (ARM templates, Terraform – good to have) Data Governance & Security Strong understanding of: Data governance frameworks Data lineage & cataloging (Purview preferred) Access control, security, and compliance models in Azure Leadership & Architecture Skills Proven experience in enterprise-scale solution architecture Ability to define technical roadmaps and architecture strategy Strong stakeholder management and cross-team collaboration Experience leading large data engineering teams Soft Skills Excellent communication and presentation skills Strong analytical and problem-solving capabilities Leadership mindset with mentoring ability Ability to work in a fast-paced, agile environment Education Bachelor’s or Master’s degree in Computer Science, Engineering, or related field Preferred Qualifications Azure certifications such as: AZ-305 (Azure Solutions Architect) DP-203 (Data Engineer Associate) Experience in multi-cloud or hybrid architectures Exposure to BI tools (Power BI preferred) Experience with enterprise data p
Key Responsibilities
platforms or large transformation programs
Why Join Us:
Work on cutting-edge Azure & Databricks data platforms
Opportunity to lead large-scale data transformation initiatives
Collaborate with high-performing teams in a growth-focused environment
Skill Requirements
null
Other Requirements
null
Required skills
Azure Data Factory
Azure Databricks
ADLS
Synapse
Spark
PySpark
SQL
Delta Lake
About HCL Technologies
Gautam Buddha Nagar
Headquarters