Senior Kafka Platform Engineer
L.M. Group
- Warszawa, mazowieckie
- Stała
- Pełny etat
- Hadoop Deployment and Troubleshooting Knowledge above 10PB or 100 servers.
- Linux (Centos)
- Hadoop Scale troubleshooting
- Person will be responsible to Perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, HBase and Spark clusters
- Work on Performance Tuning and Increase Operational efficiency on a continuous basis
- Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements
- Working closely with development, engineering, and operation teams, jointly work on key deliverables ensuring production scalability and stability
- Develop and enhance platform best practices
- Ensure the Hadoop platform can effectively meet performance & SLA requirements
- Responsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, HBase etc.
- Perform optimization, debugging and capacity planning of a Big Data cluster
- Perform security remediation, automation and selfheal as per the requirement
- 3-6 years of experience on the similar position
- Hands on Experience in Hadoop Admin, Hive, Spark, Kafka,
- experience in maintaining, optimization, issue resolution of Big Data large scale clusters,
- supporting Business users and Batch process.
- Strong flexible benefits package that you can tailor to your own needs and choose Multisport card, shop vouchers and many others - MyBenefit cafeteria
- Premium insurance for medical services for employee and family members- Luxmed
- Life & Disability Insurance for employees and family members- Generali
- Profitable Voluntary Pension Fund
- Social Funds benefits: holiday bonuses, allowance for kindergartens, etc.
- Integration and cultural events for employees
- Reward and recognition program for high performers
- Employee Referral bonuses
- Relocation assistance - Accommodation, travel and other expenses covered
InfoPraca