Senior Data Engineer

Career Category

Information Systems:

Job Description

ABOUT THE ROLERole Description:

The role is responsible for designing, developing, and deploying complex software applications, and mentoring junior developers. You will work closely with cross-functional teams to deliver high-quality, scalable, and maintainable solutions. The ideal candidate has strong technical skills in web application development, exposure to big data technologies, and a good understanding of data architecture and ETL processes.

Roles & Responsibilities:

• Possesses strong rapid prototyping skills and can quickly translate concepts into working code
• Provide technical guidance and mentorship to junior developers.
• Take ownership of complex software projects from conception to deployment. Manage software delivery scope, risk, and timeline.
• Contribute to both front-end and back-end development using cloud technology.
• Define and implement robust software architectures on the cloud, AWS preferred
• Conduct code reviews to ensure code quality and adherence to best practices.
• Create and maintain documentation on software architecture, design, deployment, disaster recovery, and operations.
• Identify and resolve technical challenges effectively.
• Stay updated with the latest trends and advancements
• Demonstrate the ability to make informed technological choices after due diligence and impact assessment.
• Understand whole product, its modules and the interrelationship between them while being an expert in the assigned component or module.
• Collaborate with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast paced business needs across geographic regions.
• Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
• Identify and resolve complex data-related challenges.
• Work closely with product team, business team, and other stakeholders.

Basic Qualifications and Experience:

• Master’s or Bachelor's degree with 8-12 years of experience in Computer Science, IT or related field

Technical Skills: Must-Have Skills:

• Proficient in JavaScript, TypeScript, React framework, HTML5, CSS, and NPM.
• Hands on experience with various cloud services, understand pros and cons of various cloud services in well architected cloud design principles
• Hands-on experience with Full Stack software development including REST APIs and data pipelines.
• Proficient in programming language Python(preferred) and SQL/NoSQL with exposure to multi source integration involving various platforms.
• Experience in microservices architecture and containerization technologies such as Docker, Kubernetes, Azure, AWS, or other cloud platforms.
• Committed to delivering top-tier quality in product development and support.

Good-to-Have Skills:

• Experience with ETL tools such as Apache Spark, and various Python packages related to data processing, machine learning model development
• Strong understanding of data modeling, data warehousing, and data integration concepts
• Knowledge of Python/R, Databricks, SageMaker, cloud data platforms.
• Experience implementing automated orchestration and monitoring of data pipelines using Databricks Jobs, Apache Airflow, or similar workflow tools.
• Exposure to Agentic AI and models.

Professional Certifications (Preferred):

• AWS Developer certification (preferred)
• Any SAFe Agile certification (preferred)

Soft Skills:

• Excellent critical-thinking and problem-solving skills
• Strong communication and collaboration skills
• Demonstrated awareness of how to function in a team setting
• Demonstrated presentation skills

.