Project Role: Data Platform Architect

Project Role Description: Architects the data platform blueprint and implements the design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.

Must have skills: Databricks Unified Data Analytics Platform

Good to have skills: NA

Minimum 5 year(s) of experience is required

Educational Qualification: 15 years full time education

Summary:

We are looking for a highly skilled Senior Databricks Developer with extensive experience in building and managing modern data platforms on Azure using Lakehouse architecture. The ideal candidate will have strong hands-on experience in Py Spark, SQL, and Azure Data Services, and a proven track record in developing scalable and efficient data pipelines.
Your typical day will involve collaborating with Integration Architects and Data Architects to ensure seamless integration between systems and data models, while also addressing any challenges that arise during the implementation process. You will engage in discussions with stakeholders to gather requirements and provide insights that drive the overall architecture of the data platform, ensuring it meets the needs of the organization effectively.

Roles & Responsibilities:

• Design, build, and optimize scalable data pipelines using Databricks, PySpark, and SQL on Azure.
• Implement Lakehouse architecture for structured data ingestion, processing, and storage.
• Build and manage Delta Lake tables and perform schema evolution and versioning.
• Work with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Azure Synapse for data integration and transformation.
• Collaborate with data architects, analysts, and business teams to understand requirements and design efficient data solutions.
• Optimize performance of large-scale data pipelines and troubleshoot data quality or latency issues.
• Contribute to best practices around coding, testing, and data engineering workflows.
• Document technical solutions and maintain code repositories.
• Expected to be an SME.
• Develop and maintain documentation related to the data platform architecture.

Professional & Technical Skills:

• Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform.
• Strong hands-on experience with Py Spark and advanced SQL for large-scale data processing.
• Deep expertise in Databricks platform including notebooks, jobs, and Delta Lake.
• Solid experience with Azure cloud services: ADLS Gen2, ADF, Azure Synapse, Key Vault, etc.
• Knowledge of Lakehouse architecture concepts, implementation, and governance.
• Experience in version control tools like Git and CI/CD pipelines.
• Excellent problem-solving and debugging skills.
• Strong communication and collaboration abilities across cross-functional teams.
• Strong understanding of data integration techniques and best practices.
• Experience with cloud-based data solutions and architectures.
• Familiarity with data governance frameworks and compliance requirements.
• Ability to design scalable and efficient data pipelines.

Good to Have:

• Experience in data quality checks and validation frameworks.
• Exposure to DevOps and Infrastructure as Code (IaC) in Azure environments.
• Familiarity with data governance tools like Unity Catalog or Azure Purview.
• Knowledge of Delta Live Tables (DLT) is a plus.

Additional Information:

• The candidate should have minimum 5 years of experience in Databricks Unified Data Analytics Platform.
• This position is based at our Hyderabad office.
• A 15 years full time education is required.

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.
Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.