Data Engineer - C

Job Description

Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.

Job Description

• Grade Specific

The involves leading and managing a team of data engineers, overseeing data engineering projects, ensuring technical excellence, and fostering collaboration with stakeholders. They play a critical role in driving the success of data engineering initiatives and ensuring the delivery of reliable and high-quality data solutions to support the organization's data-driven objectives.

Skills (competencies)

Ab Initio

Agile (Software Development Framework)

Apache Hadoop

AWS Airflow

AWS Athena

AWS Code Pipeline:

AWS EFS

AWS EMR

AWS Redshift

AWS S3

Azure ADLS Gen2

Azure Data Factory:

Azure Data Lake Storage:

Azure Databricks

Azure Event Hub:

Azure Stream Analytics:

Azure Sunapse

Bitbucket

Change Management

Client Centricity

Collaboration

Continuous Integration and Continuous Delivery (CI/CD)

Data Architecture Patterns:

Data Format Analysis:

Data Governance

Data Modeling

Data Validation

Data Vault Modeling:

Database Schema Design:

Decision-Making

DevOps

Dimensional Modeling

GCP Big Table:

GCP Big Query:

GCP Cloud Storage:

GCP Data Flow:

GCP Data Proc:

Git

Google Big Tabel:

Google Data Proc:

Greenplum

HQL

IBM Data Stage:

IBM DB2

Industry Standard Data Modeling (FSLDM)

Industry Standard Data Modeling (IBM FSDM))

Influencing

Informatica IICS

Inmon methodology

JavaScript

Jenkins

Kimball

• Linux
• Redhat

Negotiation

Netezza

NewSQL

Oracle Exadata

Performance Tuning

Perl

Platform Update Management:

Project Management

Py Spark

Python

R

RDD Optimization

Sant Os

SaS

Scala Spark

Shell Script

Snowflake

SPARK

SPARK Code Optimization:

SQL

Stakeholder Management

Sun Solaris

Synapse

Talend

Teradata

Time Management

Ubuntu

Vendor Management