AWS Data Senior Technical Specialist - Glue, Snowflake and DevOps

Job Summary

Job description:

Designing, building, and maintaining robust ETL (extract, transform, load) pipelines to process large-scale data.

Deploying and monitoring machine learning models in production environments.

Managing data warehouses, data lakes, and storage systems.

Ensuring data integrity, security, and compliance with organizational standards.

Working with data scientists, analysts, and software engineers to turn prototypes into functional products.

High proficiency in Python and SQL.

Experience with Azure:

Familiarity with Spark, Hadoop, and distributed systems.

Experience with CI/CD tools, containerization (Docker, Kubernetes), and monitoring tools

Key Responsibilities

1. Develop and implement amazon glue workflows for data extraction, transformation, and loading (etl).

2. Design and optimize sql queries for efficient data retrieval and manipulation.

3. Utilize python programming for automation and data processing tasks.

4. Implement devops solutions to streamline development and deployment processes.

5. Manage and optimize snowflake data warehouse for scalability and performance.

Skill Requirements

1. Proficient in amazon glue for etl processes.

2. Strong sql skills for database querying and management.

3. Advanced knowledge of python programming for automation and data manipulation.

4. Experience with devops solutions for continuous integration and deployment.

5. Handson experience with snowflake data warehouse for managing and optimizing large datasets.

Other Requirements

1.Relevant certifications in Amazon Glue, SQL, Python, DevOps Solutions, or Snowflake are a plus.