
Senior Technical Lead
About the role
Job Summary
Job Summary:
We are seeking an innovative and results-driven Data Fabric Developer to design and build our next-generation data architecture. You will bridge the gap between raw data and actionable intelligence by creating automated, self-service, and policy-governed data pipelines. The ideal candidate has deep technical expertise in unified data platforms and a strong background in data integration, modeling, and governance.Key Responsibilities Pipeline Development: Build and maintain scalable, metadata-driven ETL/ELT pipelines to ingest and transform data from diverse, hybrid, and multi-cloud sources.Data Architecture & Modeling: Design and implement modern data structures (e.g., Medallion architectures, Delta tables, and data warehouses).Governance & Security: Implement policy-driven security, data lineage, metadata cataloging, and access controls to ensure strict data compliance.** Optimization & Performance:** Troubleshoot and fine-tune data integration workflows, Spark jobs, and query performance to ensure cost efficiency and fast processing.Collaboration: Work closely with cross-functional teams (Data Scientists, Analysts, and Business Stakeholders) to turn functional requirements into reliable, production-ready data solutions.Automation & DevOps: Apply CI/CD and version control (e.g., Git integration) practices to data pipelines to ensure safe promotion across development, test, and production environments.Qualifications & Skills Experience:7+ years of hands-on experience in data engineering, ETL development, or designing data platforms.Platform Expertise: Hands-on proficiency with modern data fabric environments, specifically Microsoft Fabric(One Lake, Lakehouses, Data Factory, Dataflows Gen2, and Synapse) or similar platforms (Databricks, Snowflake, Azure Synapse).Programming Languages: Advanced proficiency in** Python**,Py Spark, and Spark SQL.Data Modeling & BI: Deep understanding of dimensional modeling (Star/Snowflake schema), Power BI semantic models, and DAX.Core Competencies: Solid grasp of data governance principles, event-driven data streaming, and hybrid cloud integration.
Key Responsibilities
-
To be responsible for providing technical guidance to a team of developers, enhancing their technical capabilities and increasing productivity.
-
To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure successful delivery of complex projects.
-
To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
-
To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure & closure of escalations.
Skill Requirements
Job Summary:
We are seeking an innovative and results-driven Data Fabric Developer to design and build our next-generation data architecture. You will bridge the gap between raw data and actionable intelligence by creating automated, self-service, and policy-governed data pipelines. The ideal candidate has deep technical expertise in unified data platforms and a strong background in data integration, modeling, and governance.Key Responsibilities Pipeline Development: Build and maintain scalable, metadata-driven ETL/ELT pipelines to ingest and transform data from diverse, hybrid, and multi-cloud sources.Data Architecture & Modeling: Design and implement modern data structures (e.g., Medallion architectures, Delta tables, and data warehouses).Governance & Security: Implement policy-driven security, data lineage, metadata cataloging, and access controls to ensure strict data compliance.** Optimization & Performance:** Troubleshoot and fine-tune data integration workflows, Spark jobs, and query performance to ensure cost efficiency and fast processing.Collaboration: Work closely with cross-functional teams (Data Scientists, Analysts, and Business Stakeholders) to turn functional requirements into reliable, production-ready data solutions.Automation & DevOps: Apply CI/CD and version control (e.g., Git integration) practices to data pipelines to ensure safe promotion across development, test, and production environments.Qualifications & Skills Experience:7+ years of hands-on experience in data engineering, ETL development, or designing data platforms.Platform Expertise: Hands-on proficiency with modern data fabric environments, specifically Microsoft Fabric(One Lake, Lakehouses, Data Factory, Dataflows Gen2, and Synapse) or similar platforms (Databricks, Snowflake, Azure Synapse).Programming Languages: Advanced proficiency in** Python**,Py Spark, and Spark SQL.Data Modeling & BI: Deep understanding of dimensional modeling (Star/Snowflake schema), Power BI semantic models, and DAX.Core Competencies: Solid grasp of data governance principles, event-driven data streaming, and hybrid cloud integration.
Other Requirements
Job Summary:
We are seeking an innovative and results-driven Data Fabric Developer to design and build our next-generation data architecture. You will bridge the gap between raw data and actionable intelligence by creating automated, self-service, and policy-governed data pipelines. The ideal candidate has deep technical expertise in unified data platforms and a strong background in data integration, modeling, and governance.Key Responsibilities Pipeline Development: Build and maintain scalable, metadata-driven ETL/ELT pipelines to ingest and transform data from diverse, hybrid, and multi-cloud sources.Data Architecture & Modeling: Design and implement modern data structures (e.g., Medallion architectures, Delta tables, and data warehouses).Governance & Security: Implement policy-driven security, data lineage, metadata cataloging, and access controls to ensure strict data compliance.** Optimization & Performance:** Troubleshoot and fine-tune data integration workflows, Spark jobs, and query performance to ensure cost efficiency and fast processing.Collaboration: Work closely with cross-functional teams (Data Scientists, Analysts, and Business Stakeholders) to turn functional requirements into reliable, production-ready data solutions.Automation & DevOps: Apply CI/CD and version control (e.g., Git integration) practices to data pipelines to ensure safe promotion across development, test, and production environments.Qualifications & Skills Experience:7+ years of hands-on experience in data engineering, ETL development, or designing data platforms.Platform Expertise: Hands-on proficiency with modern data fabric environments, specifically Microsoft Fabric(One Lake, Lakehouses, Data Factory, Dataflows Gen2, and Synapse) or similar platforms (Databricks, Snowflake, Azure Synapse).Programming Languages: Advanced proficiency in** Python**,Py Spark, and Spark SQL.Data Modeling & BI: Deep understanding of dimensional modeling (Star/Snowflake schema), Power BI semantic models, and DAX.Core Competencies: Solid grasp of data governance principles, event-driven data streaming, and hybrid cloud integration.
Benefits and perks
•Learning Budget
Required skills
ETL
ELT
Data modeling
Data governance
Spark
CI/CD
Git
Data architecture
About HCL Technologies
Noida
Headquarters