
GSC: Scala Big Data Engineer
- Polska
- Stała
- Pełny etat
The Global Social Network Analytics (GSNA) platform uses Big Data technology together with AI and Google Cloud Platform (GCP) to identify potential financial crime risks that enable a global network of Investigators, Intelligence Analysts and Data Scientists to conduct effective intelligence-based investigations. We are currently looking for Scala Big Data Engineer. This role is based at our Global Technology Centre in Krakow. The team is made up of 10 scrum teams based across China, India, Poland and the UK. We run Agile Scrum with 2-week sprints, and releases every 6 weeks. Our Technology stack is a mix of Scala, Spark, ElasticSearch, Hadoop, with a move to GCP Kubernetes, Terraform, Ansible, Jenkins CICD DevOps.What you'll do
- Work in Google Cloud Platform (GCP) and building data pipelines using Spark Shell.
- Analyse large datasets in one of the world's biggest Datalakes.
- Utilize AirFlow to validate test scripts.
- Collaborate with data scientists and analysts to develop data solutions.
- Monitor and troubleshoot data workflows to ensure reliability and efficiency.
- Use clear and concise communication to explain technical concepts, discuss project requirements, and present findings and recommendations.
- Knowledge of Scala Spark.
- Ability to manage branches and resolve merge conflicts.
- Fluent English.
- Experience with Jira and Confluence (nice to have).
- GCP, and Apache Airflow (nice to have).
- JUnit, TDD, BDD (nice to have).
- Jenkins, Clean code, SOLID, KISS, DRY, design patterns (nice to have).
- Commercial experience is a plus, but not mandatory.
- Competitive salary
- Annual performance-based bonus
- Additional bonuses for recognition awards
- Multisport card
- Private medical care
- Life insurance
- One-time reimbursement of home office set-up (up to 800 PLN).
- Corporate parties & events
- CSR initiatives
- Nursery discounts
- Financial support with trainings and education
- Social fund
- Flexible working hours
- Free parking
- Online behavioural test (for external candidates only)
- Telephone screen (for external candidates only)
- Job Interviews with the hiring manager