Senior Apache Spark Technical Specialist - Scala, Python

Job Summary

Minimum of 7+ years of experience in data engineering, data platform management, or similar roles Proven experience leading data platform architecture and implementation in cloud-based environments (AWS, Azure, GCP) Stron • Minimum of 7+ years of experience in data engineering, data platform management, or similar roles Proven experience leading data platform architecture and implementation in cloud-based environments (AWS, Azure, GCP) Strong expertise in data modeling, ETL/ELT processes, and big data technologies (e.g., Hadoop, Spark, Kafka) Experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB) Strong commercial experience with Python and Django Background in architectural and systems design Solid understanding of data governance, security best practices, and compliance standards Demonstrated ability to lead and build high-performing teams in a collaborative and fast-paced environment Fluent English is required in spoken and written communication due to working on the Pan-Baltic level g expertise in data modeling, ETL/ELT processes, and big data technologies (e.g., Hadoop, Spark, Kafka) Experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB) Strong commercial experience with Python and Django Background in architectural and systems design Solid understanding of data governance, security best practices, and compliance standards Demonstrated ability to lead and build high-performing teams in a collaborative and fast-paced environment Fluent English is required in spoken and written communication due to working on the Pan-Baltic leve

Key Responsibilities

1. Develop and implement data processing frameworks using apache spark.

2. Write efficient code in scala and python for data analysis and manipulation.

3. Collaborate with cross functional teams to design and implement scalable data solutions.

4. Troubleshoot and resolve technical issues related to apache spark, scala, and python applications.

5. Stay updated with the latest trends and advancements in big data technologies.

Skill Requirements

1. Proficiency in apache spark for developing data processing frameworks.

2. Strong programming skills in scala and python for data analysis and manipulation.

3. Experience in handling big data and implementing scalable solutions.

4. Knowledge of data engineering concepts and methodologies.

5. Ability to collaborate effectively with teams and communicate technical concepts clearly.

Other Requirements

1.Relevant certifications in Apache Spark, Scala, or Python are a plus.