Java Spark Technical Lead

Key Responsibilities:

• Lead the design, development, and implementation of big data solutions using Apache Spark and Java.

• Build scalable ETL workflows and data pipelines using Spark and the Hadoop ecosystem.

• Develop RESTful APIs using Spring Boot for data services and integrations.

• Work closely with BAs and stakeholders to understand requirements and translate them into technical solutions.

• Perform full-cycle development: design, coding, testing, debugging, deployment.

• Troubleshoot and resolve complex issues in Spark jobs and data pipelines.

• Conduct code reviews and enforce coding standards and best practices.

• Optimize Spark applications for performance, scalability, and reliability.

• Mentor junior/intermediate developers and provide technical leadership.

• Actively participate in Agile processes, including sprint planning and reviews.

Required Skills & Experience:

• 7+ years of professional software development experience.

• Minimum 3 years as a Technical Lead in Java + Spark applications.

• Strong hands-on experience with Apache Spark for large-scale data processing.

• Strong Java backend development skills.

• Proficiency in SQL and experience working with relational databases (e.g., Oracle).

• Experience with CI/CD pipelines (Jenkins, GitLab CI, etc.).

• Familiarity with scheduling/automation tools like Autosys.

• Strong problem-solving, debugging, analytical thinking.

• Ability to work independently with minimal supervision.

• Excellent communication and interpersonal skills.