Databricks Data Architect

Job Summary

The Databricks Solution Architect leads the design and implementation of enterprise-scale data solutions using Databricks, Apache Spark, and Python. This role provides architectural leadership, ensuring that data platforms are robust, scalable, and aligned with business objectives. The architect drives technical innovation, enforces governance, and establishes best practices to deliver high-impact analytics and data engineering solutions across the organization.

Key Responsibilities

1. Architect End-To-End Data Solutions Using Databricks And Apache Spark, Ensuring Alignment With Business Requirements And Enterprise Data Strategy.
2. Design Scalable Data Pipelines And Advanced Analytics Workflows Utilizing Databricks, Python, And Spark Sql To Support Complex Data Processing And Machine Learning Initiatives.
3. Define And Enforce Architectural Standards, Governance, And Compliance Measures For Databricks-Based Solutions, Ensuring Security And Data Quality.
4. Lead Technical Reviews Of Architecture And Design Deliverables, Providing Expert Guidance On Databricks Platform Optimization And Best Practices.
5. Collaborate With Business Stakeholders To Translate Strategic Objectives Into Technical Requirements And Databricks-Based Solutions.
6. Drive Adoption Of New Features And Emerging Technologies Within The Databricks Ecosystem, Ensuring Continuous Improvement And Innovation.
7. Mentor And Train Technical Teams On Databricks, Spark, And Python, Fostering Skill Development And Ensuring Delivery Excellence.

Skill Requirements

1. Expert Proficiency In Databricks Platform Architecture, Administration, And Solution Design.
2. Excellent Knowledge Of Apache Spark For Distributed Data Processing And Analytics.
3. Advanced Proficiency In Python For Data Engineering, Etl, And Machine Learning Tasks.
4. Strong Understanding Of Data Governance, Security, And Compliance In Cloud Based Data Platforms.
5. Excellent Ability To Design And Optimize Large Scale Data Pipelines And Workflows.
6. Architectural Leadership In Integrating Databricks With Enterprise Data Sources And Bi Tools.

Other Requirements

1. Databricks Certified Data Engineer Professional Or Databricks Certified Data Architect (Optional But Valuable).
2. Microsoft Azure Solutions Architect Expert Or Aws Certified Solutions Architect (Optional But Valuable)