Confluent - Software Engineer
Job description
Introduction
At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale.Working in Software means joining a team fueled by curiosity and collaboration. You'll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM's product and technology landscape.
Here, you'l have the tools and opportunities to advance your career while creating software that changes the world.
Your Role And Responsibilities
About the Role
Our team is responsible for managing the metadata that makes Kafka a reliable, fault-tolerant, and high-performance distributed streaming platform. This includes coordinating the election of leaders, monitoring broker availability, persisting and distributing metadata, coordinating cluster-wide actions, and more. We are building a highly available, reliable, secure, scalable, and multi-tenant metadata layer.In this role, you will contribute to the design and delivery of this layer, working closely with senior engineers and key stakeholders. You will own well-scoped pieces of larger projects, learn the architecture of our product area, and grow your technical depth while helping the team deliver high-quality solutions.
Here are examples of some of the challenges we've taken on in recent years:
- Kora: A Cloud-Native Event Streaming Platform For Kafka
- KRaft: Apache Kafka Without ZooKeeper
- Why ZooKeeper Was Replaced with KRaft – The Log of All Logs
- KIP-866: ZooKeeper to KRaft Migration
- KIP-853: KRaft Controller Membership Changes
- Collaborate with senior engineers on the design and implementation of new features and improvements.
- Independently deliver well-scoped parts of larger projects, with high quality and on time.
- Dig into problems to find root causes and solve them thoroughly, not just treat symptoms.
- Bring a strong sense of teamwork: collaborate closely with teammates and engineers on other teams, help others with specific problems, and make decisions that benefit the team.
- Stay customer focused, motivated by helping customers succeed.
Preferred Education
Master's Degree
Required Technical And Professional Expertise- BS, MS, or PhD in computer science or a related field, or equivalent work experience.
- 3+ years of progressive experience in designing, building, and operating large-scale, mission-critical distributed systems (or equivalent expertise).
- Experience building and operating large-scale systems in the Cloud.
- Solid understanding of basic systems operations (disk, network, operating systems, etc.).
- Proficiency in Java, Scala, C/C++, Go or other statically typed languages.
- Expert-level proficiency in Java and the JVM ecosystem, including threading, performance tuning, and diagnostics.
- Hands-on experience with consensus algorithms (Raft, Paxos, etc.), or experience operating large-scale coordination services (ZooKeeper, etcd, Consul).
- A strong background in distributed storage systems or databases.
- Experience/knowledge with public clouds (AWS, Azure or GCP).
Interested in this role?