altText

Senior Software Engineer - Event Capture & Processing (Kafka)

India, USA

Full Time

At Atlan, one of our core values is putting the problem first and solution second. That’s why our folks in the Business Team come to work every morning with the intent of helping as many people as they can. Even if this means telling them that we’re not the right fit for them.

As part of our Business Team, you’ll be our eyes and ears on the ground—working to understand our users’ biggest challenges and wins—so we can integrate this information into our vision for our products. Every line of code we write and every pixel we create will be shaped by what you see and hear on a daily basis.

Let’s lead from the front and show the world how it’s done.

founders sign

(Co-founders of Atlan)

What will you do?

  • Ensure Reliability, Availability & Scalability of Kafka Clusters
  • Collaborate with the team to ensure Kafka clusters meet reliability, availability, and scalability requirements.
  • Optimize Kafka configurations and settings to enhance performance and stability.
  • Design and implement effective clustering, partitioning, and topical strategies for efficient Kafka message processing.
  • Develop and implement monitoring and observability solutions to gain insights into Kafka cluster performance and consumer behaviour.
  • Develop robust consumers over Atlan's event processing engine (Numaflow) to ensure fault tolerance and reliability.

What makes you a match?

  • Demonstrated expertise in deploying and managing applications using Kubernetes.
  • Experience working with Custom Resource Definitions (CRD) to define and manage custom resources.
  • Proven track record of working with Kafka and utilizing its features to build efficient and scalable solutions.
  • Familiarity with Atlan's event processing engine (Numaflow) is a significant advantage.
  • Demonstrated experience in scaling Kafka clusters and consumers to handle increased load and demand.
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.
  • Proven ability to work effectively in a team-oriented, collaborative environment.

Can't wait to join us?
Get started on your application.

Apply Now

Do your life's best work with Atlan

Shape the future of our products

As part of the Business Team, you play a pivotal role. You are the voice of our users and inform all the important decisions we make. You will work closely with our users and prospects to understand their pain points and feed this information into our product roadmap.

Ownership and autonomy from day one

At Atlan, business is all about putting the user first and addressing their needs. So the way your set your goals will be informed by the unique challenges that you need to solve. That’s why you have complete ownership of your projects—you set the priorities, decide on the experiments, and the best way to reach your goals.

Apply for Senior Software Engineer - Event Capture & Processing (Kafka)

[Website env: production]