Data Engineer

Job Description

TCS-WALKIN DRIVE.

Bhubaneshwar.

JD

• Design, develop and implement data pipelines to perform (ETL) from multiple sources into Azure Services.

• Experience on Azure Data & Analytics PaaS Services: Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Stream Analytics and Azure SQL DB, etc.

• Proficiency in programming languages (e.g., Python, SQL, Py Spark etc.) and data manipulation tools.

• Manage Azure Data Storage Solutions including Azure Data Lake, different databases.

• &nbs p; Knowledge of DevOps tools

• Manage and monitor the health of data integration processes, troubleshooting

• Experience in Data Migrations (Perform Data Migrations to Azure from on-premises or other platforms)

• Experience with Azure ARM templates, PowerShell and CI/CD using Azure DevOps.

• Experience with exposing data to end-users via Power BI, Azure API Apps.

• Understanding of on-pr emises and cloud-based data architecture and integration.

• Knowledge of DevOps practices and tools.

• Knowledge of integrating different systems with python.

• Good documentation skills

Desired Candidate Profile
Qualifications :

BACHELOR OF ENGINEERING: