Azure Senior Data Engineer

Job Summary

The Senior Developer will be responsible for developing and maintaining solutions using Azure Data Factory (ADF), Azure Databricks, SQL, and Python. The primary objectives includes building and optimizing data pipelines for efficient data processing and analysis.

Key Responsibilities

1. Develop and implement end-to-end data pipelines using azure data factory (adf) and azure databricks to extract, transform, and load data.

2. Write complex sql queries to retrieve and manipulate data from databases.

3. Utilize python for scripting and automation tasks related to data processing and analysis.

4. Collaborate with data engineers and analysts to understand data requirements and deliver appropriate solutions.

5. Monitor and optimize data workflows to ensure high performance and scalability.

6. Troubleshoot and resolve issues related to data pipelines and data quality.

Skill Requirements

1. Strong understanding of azure data factory (adf) for building and managing data pipelines.

2. Experience with azure databricks for big data processing and analytics.

3. Strong sql skills for querying and manipulating data in relational databases.

4. Solid knowledge of python programming language for data manipulation and automation.

5. Understanding of data integration concepts and etl processes.

6. Ability to work in a collaborative team environment and communicate effectively with stakeholders.

Other Requirements

1.Azure Data Engineer Associate or Microsoft Certified1.Azure Data & AI Associate certification is a plus.