Data Engineer

Role Overview

We are looking for a DevOps / Data Engineer to build and manage scalable cloud infrastructure, CI/CD pipelines, and data workflows on AWS. This role combines DevOps, automation, and data engineering, with exposure to modern data platforms like Databricks, to enable reliable application delivery and data-driven platforms.
This role requires strong ownership, problem-solving skills, and the ability to work across DevOps, data, and engineering teams.

Key Responsibilities

• Build and maintain CI/CD pipelines using GitHub Actions / Bitbucket Pipelines

• Develop and manage Infrastructure as Code (IaC) using Terraform and AWS CDK (Terramate is a plus)

• Manage and optimize AWS services (EC2, S3, Lambda, RDS, API Gateway)

• Deploy and support containerized applications using Docker and Kubernetes/Open Shift

• Develop and support data pipelines and ETL workflows using Python and SQL

• Work with Databricks or similar data platforms for data processing and analytics

• Implement Dev Sec Ops practices, including SAST and secrets management (Hashi Corp Vault)

• Implement monitoring and observability solutions using tools like Grafana

• Monitor systems, troubleshoot issues, and improve performance, reliability, and observability

Basic Requirements

• Bachelor’s degree in computer science, engineering, or related field

• A minimum of 3 years of experience

• Strong experience in AWS Cloud & DevOps

• Strong programming skills in Python for automation and data processing

• Hands-on with Terraform and AWS CDK

• Experience with CI/CD tools (GitHub Actions, Bitbucket, Bamboo)

• Experience with Docker, Kubernetes/Open Shift

• Knowledge of data pipelines, ETL, and analytics workflows

• Experience with monitoring and visualization tools such as Grafana

• Familiarity with logging, monitoring, and incident management

Preferred Requirements:

• Master’s degree in computer science, engineering, or related field

• Experience with Databricks or similar big data platforms

• Experience with event-driven architecture (AWS Lambda)

• Knowledge of Power BI or data visualization tools

• Exposure to Generative AI / RAG / LLM concepts

• Experience in enterprise or automotive data platforms

• Familiarity with Terramate or similar IaC orchestration tools

• Cloud or DevOps certifications (e.g., AWS Certified Solutions Architect, AWS Certified DevOps Engineer, Kubernetes certifications)

Soft Skills

• Strong problem-solving and analytical skills

• Good communication and stakeholder collaboration

• Experience working in Agile/Scrum environments