N

NetApp

Optimizes cloud infrastructure costs on AWS

Senior Open Source Software Engineer - Kafka

Software EngineeringUpdated on Nov 14
Full-timeRemote in USA

About the Job

Requirements

  • A minimum of 12 years of applicable professional software engineering experience is required.
  • Current Apache Kafka committer status with a sustained, publicly verifiable upstream track record across patches, reviews, KIPs, and community standing in Kafka core or a closely related area such as Streams, Connect, clients, or release engineering.
  • Expert Java engineering capability in performance-sensitive, concurrent, production-grade distributed systems, including the ability to write, review, and reason about complex Kafka internals at depth.
  • Deep mastery of Apache Kafka internals in at least one major domain: broker storage and log replication, KRaft and metadata management, consumer group coordination and rebalancing, protocol and client compatibility, Kafka Streams, Kafka Connect, observability, performance, or release management and CI.
  • Demonstrated ability to lead complex technical work through the Apache open source governance model, including KIP authoring or co-sponsorship, design consensus, mailing-list engagement, and Jira-driven delivery from proposal through merge.
  • Strong written communication for asynchronous, global, public technical collaboration across mailing lists, design documents, code reviews, and Jira threads.
  • Proven senior-level technical judgment to resolve most blockers independently, determine approaches to novel or ambiguous assignments, surface systemic risks proactively, and produce work consistent with project and team objectives.
  • Bachelor's degree in engineering or a technical-related field of study, or equivalent additional experience.

Responsibilities

  • Lead end-to-end upstream initiatives in Apache Kafka, from KIP authoring and design consensus through implementation, review, and release, in domains such as broker internals, storage and log management, replication, KRaft metadata quorum, consumer group coordination, Kafka Streams, Kafka Connect, observability, and release quality.
  • Provide binding committer reviews on upstream patches and community contributions, applying technical rigor and authority to move high-quality work through the Apache Kafka review process.
  • Contribute to Apache Kafka release management as part of the committer community, including release planning, blocker triage, test stabilization, release candidate validation, documentation readiness, and post-release follow-through.
  • Translate enterprise customer and operator needs into credible upstream proposals, KIP-level designs, and sustained technical engagement; advise product and field teams on complex Kafka trade-offs.
  • Shape community direction through evidence-based participation in relevant Kafka community channels, influencing decisions on architecture, compatibility, protocol evolution, release policy, contribution standards, and the long-term roadmap.
  • Mentor engineers toward committer standing and raise contribution quality through rigorous review practices, test discipline, and clear engineering guidance.
  • Improve upstream infrastructure, including CI reliability, test coverage, contributor tooling, benchmarking, release automation, and compatibility validation, to reduce project-wide maintenance burden.

Desired Qualifications

  • PMC membership in Apache Kafka or a related Apache project.
  • Track record of work in current Kafka feature and maintenance areas such as KRaft maturity, controller and metadata reliability, consumer rebalance protocol improvements, exactly-once semantics, tiered storage, Kafka Connect security and operability, Streams APIs, client metrics, or release stabilization.
  • Experience connecting upstream technical leadership to enterprise customer and operator outcomes by translating production pain points into accepted community improvements.
  • History of mentoring contributors toward reviewer or committer standing in an open governance project.
  • Familiarity with the Kafka ecosystem, including Kafka Streams, Kafka Connect, MirrorMaker 2, Kafka clients, schema and serialization patterns, Kubernetes-based Kafka operations, or adjacent open source projects such as Strimzi.

About the Company

NetApp

Optimizes cloud infrastructure costs on AWS

Spot.io, part of NetApp, helps businesses manage cloud costs and infrastructure on AWS. It uses software that analyzes cloud usage and automates management to lower compute expenses, especially through AWS EC2 spot instances, which offer spare capacity at reduced prices. The product provides deep visibility into cloud spending, an AWS cost optimization calculator for estimating potential savings, and a free action plan tailored to each customer. Revenue comes from selling software licenses and consulting services. Target customers include enterprises using containers and orchestration tools like Kubernetes, EKS, ECS, KOPS, Docker Swarm, and OpenShift. The company aims to reduce cloud compute costs for customers while simplifying cloud operations and improving efficiency.

Company size
51-200
Company stage
Acquired
Total funding
$53.2M
Headquarters
Tel Aviv-Yafo, Israel
Founded
2015

Recently Posted Jobs

Explore more opportunities at NetApp

See more jobs