Python Senior Technical Lead - Data Analysis, SQL

Job Summary

Data Engineer - Key Requirements

• 10+ years of experience in** Data Engineering**

• Strong hands-on experience with the AWS ecosystem

• Strong expertise in Python

• Strong expertise in SQL

• Strong expertise in Shell scripting

• Proven experience building and maintaining end-to-end data pipelines

• Strong experience with ETL/ELT development

• Experience with data ingestion, transformation, and processing of large datasets

• Strong understanding of data modeling,data warehousing, and data lake concepts

• Experience with AWS data services such as** Glue, Redshift, Lambda, Step Functions, Kinesis, RDS, DynamoDB, and S3**

• Experience with Apache Spark

• Strong knowledge of data quality, data validation, and data integrity practices

• Experience with performance tuning and optimization of data pipelines and queries

• Experience designing scalable and reliable cloud-based data solutions

• Good understanding of data analysis and supporting analytics/reporting use cases

• Experience with automation and scripting for pipeline and platform operations

• Familiarity with CI/CD, DevOps, and Infrastructure as Code in data engineering environments

• Strong problem-solving and troubleshooting skills

• Ability to work with business and technical stakeholders to translate requirements into data solutions

Key Responsibilities

1. Lead technical projects involving sql, data analysis, and python from inception to implementation.

2. Design and develop sql databases, queries, and stored procedures to support various applications.

3. Conduct data analysis to derive valuable insights and make data driven decisions.

4. Develop and maintain python scripts to automate tasks and streamline processes.

5. Collaborate with cross functional teams to integrate technical solutions and ensure compatibility.

6. Troubleshoot technical issues related to sql databases, data analysis, and python scripts.

7. Stay updated on emerging technologies and recommend enhancements to existing systems.

Skill Requirements

1. Proficient in sql to design and optimize databases, write complex queries, and create stored procedures.

2. Strong data analysis skills to extract, clean, and analyze data for business insights and decision-making.

3. Experience in python programming for automation, data manipulation, and scripting tasks.

4. Knowledge of data visualization tools to present findings in a clear and understandable manner.

5. Excellent problem-solving abilities and attention to detail to identify and resolve technical issues efficiently.

6. Strong communication skills to collaborate with team members and stakeholders effectively.

Other Requirements

null