Senior Software Engineer - Confluent Kafka

Introduction
At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world. With Confluent, data doesn’t sit still. We put information in motion, streaming in near real time so organizations can react faster, build smarter, and deliver experiences as dynamic as the world around them.
Your role and responsibilities

About Product & Team:

A software engineer on this team primarily contributes by implementing and deploying the business logic inside some KORA components that run in production. Their code defines how the system behaves, how features are delivered, and how the platform responds under real customer workloads.
KORA is the cloud native kafka engine. More about KORA https://www.confluent.io/blog/cloud-native-kafka-kora-vldb-award/

About the Role:

We are a team of passionate engineers who love solving complex distributed systems and infrastructure problems. We are building Kora from the ground up to be a true managed service for clients who demand high levels of availability and performance at the lowest cost of ownership. In this role, you will be working on building highly available, reliable, secure, scalable, and multi-tenant Kora's compute layer. You will be instrumental in driving the technical solutions end-to-end, working closely with the team and key stakeholders to design, architect, and develop top-notch solutions. Here are examples of some of the challenges we've taken on in recent years:
Kora: A Cloud-Native Event Streaming Platform For Kafka
Apache Kafka's Next-Gen Rebalance Protocol: Towards More Stable and Scalable Consumer Groups
From On-Prem to Cloud-Native: Multi-Tenancy in Confluent Cloud
Speed, Scale, Storage: Our Journey from Apache Kafka to Performance in Confluent Cloud

Benchmarking Confluent Cloud:

What You’ll Do:

As an L3 Senior Software Engineer, you are a mostly self-sufficient team member who owns and drives well-scoped to moderately complex problems end-to-end in your product area and helps other engineers with specific tasks when needed. In this role you will:
Design, implement, and maintain services that power catalog, publishing, distribution, and lifecycle management for connectors and other Kafka/Flink artifacts, within a well-defined portion of the Marketplace & Hub domain.
Deliver large features independently and with high quality, including tests, logging, and error handling, contributing to bigger initiatives owned by the team.
Build a solid understanding of the design and architecture of your product area (e.g., specific Marketplace/Hub services, data models, and APIs) and use that to make sound design and implementation choices.
Participate actively in technical processes for your team: design/one-pager reviews, RFC/KIP discussions where relevant, and PR reviews, providing constructive feedback to peers.
Improve performance, scalability, reliability, and security of Marketplace & Hub services through incremental changes: refactors, dependency upgrades, schema evolution, and automation of existing manual workflows.
Take shared ownership of operational excellence by handling on-call responsibilities, following runbooks, performing production operations safely, and contributing to better monitoring, alerting, and incident remediation.
Collaborate with engineers across teams (Kafka Connect, Partner Engineering, Security, Billing, UX) on well-scoped cross-team efforts, unblocking yourself and others as needed.
Help maintain a high engineering bar on the team through good coding practices, thoughtful reviews, and reliable delivery on commitments.

What You Will Do:

Driven and excited about challenges of delivering complex projects in production with a focus on quality
Customer focused - making customers more successful by taking on their most challenging problems motivates you
Have a strong sense of teamwork and able to make decisions which benefit the team and company
Identify root causes, and get beyond treating symptoms - motivated to dig deep and solve hard problems
Required education
Bachelor's Degree
Preferred education
Master's Degree
Required technical and professional expertise
BS, MS, or PhD in computer science or a related field, or equivalent work experience
4+ years of relevant cloud infrastructure/cloud networking experience
Strong fundamentals in distributed systems design and development
Experience building and operating large-scale systems in the Cloud
Solid understanding of basic systems operations (disk, network, operating systems, etc)
A self starter with the ability to work effectively in teams
Proficiency in Java, Scala, Go or other statically typed languages
Preferred technical and professional experience
In-depth familiarity with the JVM
A strong background in distributed storage systems or databases
Experience in the areas of resource management and QoS
Experience/knowledge with public clouds (AWS, Azure or GCP)
Interest in evangelism (giving talks at tech conferences, writing blog posts evangelizing Kafka)
Experience working on databases or data storage

Years of Experience:

4 - 7

ABOUT BUSINESS UNIT:

IBM Software infuses core business operations with intelligence—from machine learning to generative AI—to help make organizations more responsive, productive, and resilient. IBM Software helps clients put AI into action now to create real value with trust, speed, and confidence across digital labor, IT automation, application modernization, security, and sustainability. Critical to this is the ability to make use of all data, because AI is only as good as the data that fuels it. In most organizations data is spread across multiple clouds, on premises, in private datacenters, and at the edge. IBM’s AI and data platform scales and accelerates the impact of AI with trusted data, and provides leading capabilities to train, tune and deploy AI across business. IBM’s hybrid cloud platform is one of the most comprehensive and consistent approach to development, security, and operations across hybrid environments—a flexible foundation for leveraging data, wherever it resides, to extend AI deep into a business.
YOUR LIFE @ IBM
In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.
Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.
Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.
Are you ready to be an IBMer?
ABOUT IBM
IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.
Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.
At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.
IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS:

When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience. For additional information about location requirements, please discuss with the recruiter following submission of your application.
Job Title

Senior Software Developer:

Job ID
124616
City / Township / Village
Bangalore
State / Province
Karnataka
Country
India
Work arrangement
Remote
Area of work
Software Engineering
Employment type
Regular
Position type
Professional
Travel required
Some travel may be required based on business demand
Company
(0063) IBM India Private Limited
Shift
General (daytime)
Is this role a commissionable/sales incentive based position?
No
Application Info
Be aware: Recruitment Scams
Privacy statement
Learn more about IBM
English
English
Español
Français
Français Canadien
Português
Slovenščina
日本語
Contact IBM
Privacy
Terms of use
Accessibility
About cookies on this site
Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For these purposes, IBM may share the personal information collected through cookies with IBM subsidiaries and third parties globally.
For more information, please review yourcookie preferences options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement.
To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Accept all
Required only