Senior Kafka Engineer


New Relic


Senior Software Engineer - Kafka

Role Location

  • Remote


501+ people


188 Spear St Ste 1200
San Francisco, CA, 94105, US

Tech Stack

  • Ruby
  • Ruby on Rails
  • Java
  • JavaScript
  • React
  • Go!
  • Kubernetes
  • Kotlin
  • C
  • JVM languages

Role Description

Senior Kafka Engineer Engineering Portland, Oregon

Apply Description Opportunity to work from a remote office may be available depending on applicant location.

Your Opportunity The Kafka Platform team is seeking an experienced DevOps-focused senior software engineer to join a team that is responsible for maintaining, growing, scaling, and automating New Relic’s Kafka and Zookeeper infrastructure. The ideal candidate will be comfortable and experienced in working with large distributed data systems and have a particular interest in effective patterns and practices for automating their care and maintenance activities. This diverse team is currently comprised of a mix of both Software Engineers and Site Reliability Engineers, so if you’re interested in contributing and growing at that intersection, this would be a great role for you! We are also migrating to the cloud, starting with AWS/MSK and eventually supporting a multi-cloud environment. Any experience in cloud operations or development with systems at scale would be a bonus.

New Relic's engineering culture emphasizes team autonomy, which means that each team chooses how they do their work and has a say in which projects they work on. It also means that our teams are responsible for their own operational tooling and on-call rotation. We strive to reduce dependencies between teams so that we can work at an efficient velocity without blocking others.

What You’ll Do Use your experience with ops automation and informed opinions about what works and what doesn’t for a given situation to define the path forward for major projects. Engage with architects, team leads, and team members to introduce new patterns for using our shared Kafka infrastructure in ways that increase the efficiency and reliability of our shared platform. Use your DevOps savvy to operate a large scale Kafka cluster that is the foundation of New Relic's data pipeline. Maintain and improve the internal Kafka client libraries used by multiple teams at New Relic to add better monitoring and resiliency features. Contribute to our automation framework that provision repeatable infrastructure and clusters, helping us scale to handle rapid growth and expand into the public cloud. Your Qualifications Must-have:

5+years of hands-on experience and proficiency in one or more of these languages: Java, Python, Go, or C. Experience with streaming in general (e.g. spark streaming) and Kafka in particular. Development and support of Kafka integrations, including topics, producers, consumers, and streaming applications (Bonus). Experience with a cloud computing platform such as AWS, Google Cloud, or Microsoft Azure. Experience with and passion for the operational automation of distributed systems, such as Apache Kafka or Apache ZooKeeper. Experience writing distributed applications with high availability. Proven communication skills, both written and oral. Experience working in Linux systems. Nice-to-have:

Experience writing software in Java or Go. Experience writing a Kubernetes operator. Experience with Configuration and fine-tuning of Kafka for optimal production performance. Familiarity with AWS MSK. Familiarity with the Linux shell and a scripting language such as Python or Ruby. Familiarity with Container Linux, AWS (EC2, S3, etc), and the tools and patterns used to handle repeatable infrastructure at scale (Kubernetes, Terraform, Ansible). Please note that visa sponsorship is available for this position.

Our Office Our office is in the center of downtown Portland, situated in a thriving tech community in the Pacific Northwest. We enjoy easy commute access and a plethora of good eats and great coffee. We provide competitive compensation including equity and big-company benefits (medical, dental, etc.)—all while maintaining the energy, agility and fun of a start-up.

About Us New Relic (NYSE: NEWR) is the industry’s largest and most comprehensive cloud-based instrumentation platform built to create more perfect software. The world’s best software and DevOps teams rely on New Relic to move faster, make better decisions and create best-in-class digital experiences. If you run software, you need to run New Relic. We’re proudly trusted by more than 50% of the Fortune 100.

Founded in 2008, we’re a global company focused on building a culture where all employees feel a deep sense of belonging, where every ‘Relic’ can bring their whole self to work and feel supported and empowered to thrive. We’re consistently recognized as a distinguished employer and are committed to building world-class products and an award winning culture. For more information, visit

Our Hiring Process In compliance with applicable law, all persons hired will be required to verify identity and eligibility to work and to complete employment eligibility verification. Note: Our stewardship of the data of thousands of customers’ means that a criminal background check is required to join New Relic.

We will consider qualified applicants with arrest and conviction records based on individual circumstances and in accordance with applicable law including, but not limited to, the San Francisco Fair Chance Ordinance.

Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. New Relic does not accept unsolicited headhunter and agency resumes, and will not pay fees to any third-party agency or company that does not have a signed agreement with New Relic.

New Relic is an equal opportunity employer. We eagerly seek applicants of diverse background and hire without regard to race, color, gender identity, religion, national origin, ancestry, citizenship, physical abilities (or disability), age, sexual orientation, veteran status, or any other characteristic protected by law.

Interested in the details of our privacy policy? Read more here:\


About New Relic

New Relic is the industry’s largest and most comprehensive cloud-based observability platform built to create more perfect software. The world’s best software and DevOps teams rely on New Relic to move faster, make better decisions and create best-in-class digital experiences. If you run software, you need to run New Relic.

Company Culture

We are passionate about the craft of building and managing great software. We take pride in what we do and hold ourselves to the highest standards. We are a team of data nerds building products for other data nerds. Named One of the Best Technology Workplaces by Fortune “People bring their authentic selves to work, and it shows in the interactions you have with close colleagues and individuals you meet. Our leadership is genuine and sincere, and those qualities are reflected in every department.”

Interested in this role?
Skip straight to final-round interviews by applying through Triplebyte.