Principal Streaming Engineer

We are seeking a Principal Streaming Engineer to manage and deploy Kafka and NATS clusters worldwide, build and monitor written code in CI, and interact with microservice developers.

As a global company we are spanning all continents. It's a big challenge to deliver data between our data centers in AWS for dozens of microservices. The streaming unit is part of a data management platform that is developing a streaming direction.

We are currently building Kafka as code with ssl client authentication (zero trust) and offloading to third party systems.

Tasks and duties are to:

• Maintain and deploy dozens of Kafka clusters worldwide (over 10 regions) under high load and on top of kubernetes
• Maintain and deploy dozens of NATS clusters at high load and on top of Kubernetes
• Develop Kubernetes operators
• Develop Kafka plugins
• Develop automation in Python
• Interact with microservice developers
• Automation: acl/ssl certificates/topics/export data
• Build written code in CI and write helm charts for Argo CD to implement the concept of Kafka as code
• Monitoring (define golden signals/response scripts for duty operators, export data for monitoring)
• On-call duty

You will be a good fit for our team if you:

• Experience with Kubernetes
• Experience writing Helm charts
• Excellent understanding of how Kafka and everything around it works (MM2, Kafka Connect, Operators, Cruise Control)
• Development in one of the programming languages at an advanced level: Kotlin/Java, Golang
• Experience in Python
• Experience in developing microservices for orchestration systems (preferably kubernetes)
• Good understanding of Linux
• Understanding of the principles of CI/CD-systems
• Experience with AWS
  

Nice to have:

• Experience in developing Java plugins for Kafka connect
• Knowledge of NoSQL
• Knowledge of NATS
• Experience with other streaming technologies
• Experience working independently on large projects (with a cycle of up to several months). From idea to result.

What do we offer:

• A flexible work schedule, official employment compliant with the Labor Code. After one year of employment, workers are eligible for the Office Without Borders program, which allows them to move temporarily to and work from any location in the world;
• Relocation to Cyprus or Kazakhstan at the company's expense, relocation package, reimbursement for hotel expenses until you find a place to rent, subsidized housing, assistance with arrangements for placing kids in schools and daycare centers, life insurance and voluntary health insurance;
• Regular external and internal training. Employees have the opportunity to attend professional conferences as participants or speakers;
• Partially or fully paid supplementary training courses;
• The Sinet Challenge personal growth and development program, in which we set goals and work to reach them together: The Sinet Run is intended to foster a culture of running, and the Sinet Challenge is a partial compensation for outdoor activities during the vacation season;
• Monthly “Fun Day” activities — corporate events in various formats, ranging from standup nights to hikes in the mountains;
• Something nice on important dates —company gifts to mark weddings, the birth of a child, and birthdays.