Confluent - Staff Software Engineer - Stream Processing & Analytics

About the Role:

The Flink Platform team is at the forefront of building a robust control plane for the Flink product, leveraging advanced database storage to ensure high reliability and efficiency. With a vision centered on innovation and excellence, this team is critical to advancing Confluent's Data in Motion initiative and is committed to supplying the industry with solutions that cater to evolving stream processing demands.

What You Will Do:

Developing the control plane services that orchestrate Flink job lifecycles (submission, scaling, recovery). Building Kubernetes operators and orchestrators for serverless resource management. Designing APIs for job management, multi-tenancy, and isolation.

Following a holistic development approach you will be responsible for the code quality, test coverage, documentation and maintainability of the components you and your team work on.

Designing Components: You will not only implement aspects of Flink Control Plane but also draft designs, discuss them and curate and moderate a decision with involved stakeholders.

Team: As part of the team you will help to follow and maintain processes, by being an active part of the team, leading meetings and taking initiatives where feasible and participating in on-call rotations.

Mentoring: You will mentor other engineers with less experience in Control plane architecture to get started in the community and more junior developers to get into the area of serverless Apache Flink.