
Senior Kafka Platform Engineer
- Kraków, małopolskie
- Stała
- Pełny etat
- Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control Centre.
- Provide expertise and hands-on experience working on Kafka connect using schema registry at a very high volume.
- Provide administration and operations of the Kafka platform - provisioning, access lists, Kerberos and SSL configurations. Provide expertise and hands-on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connectors, JMS source connectors, Tasks, Workers, converters, Transforms.
- Provide expertise and hands-on experience on custom connectors using the Kafka core concepts and API.
- Create topics, set up redundancy clusters, deploy monitoring tools, configure appropriate alerts and create stubs for producers, consumers, and consumer groups to help onboard applications from different languages/platforms.
- As a Kafka SRE, you will conduct root cause analysis of production incidents, document for reference and put into place proactive measures to enhance system reliability.
- Automate routine tasks using scripts or automation tools and perform data-related benchmarking, performance analysis and tuning.
- Conduct root cause analysis of production incidents, documenting for reference and initiating proactive measures to enhance system reliability.
- Strong problem-solving and analytical skills
- Thorough understanding of Kafka's Architecture
- Familiar with cluster maintenance processes and implementing changes and recommended fixes to Kafka clusters and topics to protect production.
- Experience operating in an infrastructure as a code and automation first principles environment
- Messaging technologies – Apache Kafka, Confluent Kafka
- DevOps toolsets – GitHub, JIRA, Confluence, Jenkins
- Automation – Ansible, Puppet or similar
- Monitoring –Observability tools such as DataDog, NewRelic, Prometheus, Grafana