Kafka Architect Full Time NEW

About the Company:

Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engineering, Data Science, Machine Learning, Artificial Intelligence and much more. Our unique 24/7 support center ensures reliability and sustenance of the Rakuten Ecosystem. With dedicated centres of excellence for Mobile Application Development, Data Analytics, Engineering, DevOps and Information Security, we ensure the success of multiple units of Rakuten Group, Inc. With 1700+ employees and growing, Rakuten India is housed in Crimson House Bangalore in the heart of the city.

The Role

We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.

Key Responsibilities:

• Design, deploy, and manage Kafka clusters in a production environment, ensuring high availability, scalability, and reliability.
• Collaborate with engineering teams to understand data processing requirements and design Kafka solutions that meet their needs.
• Optimize Kafka configurations and performance to ensure efficient utilization of resources and low latency data processing.
• Develop and maintain Kafka-related tools, utilities, and automation scripts to streamline deployment, monitoring, and management tasks.
• Provide guidance and best practices to engineering teams on Kafka usage, data modelling, and integration patterns.
• Work closely with operations teams to monitor Kafka clusters, troubleshoot issues, and perform capacity planning.
• Stay updated with the latest Kafka features, enhancements, and best practices, and evaluate their applicability to our environment.

Technical skill you should have:

• In-depth understanding of Kafka architecture, including brokers, topics, partitions, producers, consumers, and replication.
• Knowledge of Kafka distributed nature, fault tolerance, scalability and high availability
• Experience with streaming data processing frameworks like Apache Flink, Apache Spark Streaming, or Kafka Streams.
• Knowledge of Kafka integration pattern and best practises for integration with various data source
• Knowledge of containerization and orchestration technologies such as Docker and Kubernetes.
• Experience with cloud platforms like AWS, Azure, or Google Cloud Platform.
• Relevant certifications such as Confluent Certified Developer or Confluent Certified Administrator.
• Knowledge of containerization and orchestration technologies such as Docker and Kubernetes.
• Very good knowledge in database technology for both NoSQL DB and SQL DB. Working experience with in-memory DB such as Couchbase would be an advantage.
• Establish scalable implementation of data management framework, platform and tools stack.
• Good knowledge to develop, implement and managing BAU operational process for data quality functionality and capability such as Data Quality Statistics, Data Quality Scorecards, Data Quality Analysis and Workflows Design

“Rakuten is committed to cultivating and preserving a culture of inclusion and connectedness. We are able to grow and learn better together with a diverse team and inclusive workforce. The collective sum of the individual differences, life experiences, knowledge, innovation, self-expression, and talent that our employees invest in their work represents not only part of our culture, but our reputation and Rakuten’s achievement as well. In recruiting for our team, we welcome the unique contributions that you can bring in terms of their education, opinions, culture, ethnicity, race, sex, gender identity and expression, nation of origin, age, languages spoken, veteran’s status, color, religion, disability, sexual orientation and beliefs”