Senior Software Engineer - Event Capture & Processing (Kafka)

India, USA

Full Time

At Atlan, we are both proud and humbled by the fact that we are building products that power data teams in more than 50 countries around the world, ranging from small startups to Fortune 500 giants. Our products form the very backbone of our users, have become a part of their daily workflows and directly impact their success.

In the past decade, products like Github helped companies build great engineering cultures. At Atlan, we are on a quest to help build winning data teams of the future.

Every line of code we write, every feature we add, every pixel we create—everything we do—is to help data teams around the world do their lives’ best work.

Let’s show the world how it’s done!

founders sign

(Co-founders of Atlan)

What will you do?

  • Ensure Reliability, Availability & Scalability of Kafka Clusters
  • Collaborate with the team to ensure Kafka clusters meet reliability, availability, and scalability requirements.
  • Optimize Kafka configurations and settings to enhance performance and stability.
  • Design and implement effective clustering, partitioning, and topical strategies for efficient Kafka message processing.
  • Develop and implement monitoring and observability solutions to gain insights into Kafka cluster performance and consumer behaviour.
  • Develop robust consumers over Atlan's event processing engine (Numaflow) to ensure fault tolerance and reliability.

What makes you a match?

  • Demonstrated expertise in deploying and managing applications using Kubernetes.
  • Experience working with Custom Resource Definitions (CRD) to define and manage custom resources.
  • Proven track record of working with Kafka and utilizing its features to build efficient and scalable solutions.
  • Familiarity with Atlan's event processing engine (Numaflow) is a significant advantage.
  • Demonstrated experience in scaling Kafka clusters and consumers to handle increased load and demand.
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.
  • Proven ability to work effectively in a team-oriented, collaborative environment.

Can't wait to join us?
Get started on your application.

Apply Now

Do your life's best work with Atlan

Shape the future of our products

As part of the Business Team, you play a pivotal role. You are the voice of our users and inform all the important decisions we make. You will work closely with our users and prospects to understand their pain points and feed this information into our product roadmap.

Ownership and autonomy from day one

At Atlan, business is all about putting the user first and addressing their needs. So the way your set your goals will be informed by the unique challenges that you need to solve. That’s why you have complete ownership of your projects—you set the priorities, decide on the experiments, and the best way to reach your goals.

Apply for Senior Software Engineer - Event Capture & Processing (Kafka)

[Website env: production]