
Apache Spark Technical Lead - Scala, Python
About the role
Job Summary
The Technical Lead will be responsible for leading a team in the development and implementation of solutions using Apache spark, scala, and python.
The primary objectives include overseeing the technical design, development, and deployment of data processing applications using these technologies.
Key Responsibilities
-
Lead a team of developers in the design, implementation, and maintenance of data processing applications using apache spark, scala, and python.
-
Collaborate with cross functional teams to gather requirements, analyze data, and develop scalable solutions.
-
Troubleshoot and resolve technical issues related to data processing applications.
-
Implement best practices in coding, testing, and deployment processes.
-
Stay updated on the latest trends and advancements in apache spark, scala, and python technologies.
Skill Requirements
-
Proficiency in apache spark, scala, and python programming languages.
-
Strong understanding of data processing concepts and distributed computing.
-
Experience in leading and mentoring technical teams.
-
Excellent problem-solving skills and attention to detail.
-
Ability to work effectively in a fast paced and dynamic environment.
-
Good communication and interpersonal skills.
Other Requirements
1.Certification in apache spark, scala, or python is a plus.
Required skills
Apache Spark
Scala
Python
Data Engineering
About HCL Technologies
Sydney
Headquarters