Senior Technical Lead

Job Summary

High-level JD

Pyspark, Data Bricks, with AWS

• Expert-level proficiency in Databricks
• Knowledge of using Databricks Genie.
• Good experience in Pyspark
• Strong experience in writing Complex SQL queries
• Demonstrated expertise in data visualization and reporting using Databricks SQL Dashboard.
• Design, construct, install, test, and maintain highly scalable data management systems. Develop and optimize ETL/ELT pipelines using Py Spark and Databricks to process large volumes of structured and unstructured data.

Key Responsibilities

1. To be responsible for providing technical guidance to a team of developers, enhancing their technical capabilities and increasing productivity.

2. To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure successful delivery of complex projects.

3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).

4. To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure & closure of escalations.

Skill Requirements

null

Other Requirements

null