Senior Data Engineer (Databricks) @ RemoDevs

Polska
Stała
Pełny etat

12 dni temu

Proven experience with Azure Databricks and Azure Data Factory (ADF).
Strong skills in SQL and Python for data engineering.
Experience in building pipelines and data models.
Good English (minimum B2) to communicate in an international team.
Experience with Agile methods and Azure DevOps.

We are looking for skilled Data Engineers to join a team working on an important project for our client - a big company in the Danish financial sector (insurance and pensions).The goal of the project is to move all existing data warehouse systems from on-premises to a modern cloud platform using Azure Databricks. You will join a small expert team (5–8 engineers) and work closely with the client’s specialists to change and improve their data environment.Your Tasks:

Build and design ETL/ELT processes with the Medallion architecture (Bronze, Silver, Gold layers).
Transform and model data to create data products used for insurance pricing, AI, and analytics.
Use Data Contracts to keep data quality and consistency.
Work on data domains such as Agreements, Claims, Policies, and Customers.
Create tests (including automated ones) for pipelines and data products.
Work with analysts and business people to turn their needs into technical solutions.
Help set and follow best practices in SQL, Python, and Azure Data Factory (ADF).
Plan and track tasks using Azure DevOps.

Requirements:

Proven experience with Azure Databricks and Azure Data Factory (ADF).
Strong skills in SQL and Python for data engineering.
Experience in building pipelines and data models.
Good English (minimum B2) to communicate in an international team.
Experience with Agile methods and Azure DevOps.

Nice to Have:

Knowledge of Azure Purview.
Experience with data validation tools (e.g., Great Expectations).
Certificates like Databricks Data Engineer Associate or Microsoft DP-900.
Past work in financial, insurance, or pension projects.

What We Offer:

Attractive rate up to 180 PLN/h (+VAT) with a B2B contract.
Long-term stable project (minimum 18 months).
100% remote work and flexible approach.
A chance to work on a large international cloud migration project.
Cooperation with a strong, skilled engineering team from both us and the client.

,[Build and design ETL/ELT processes with the Medallion architecture (Bronze, Silver, Gold layers)., Transform and model data to create data products used for insurance pricing, AI, and analytics., Use Data Contracts to keep data quality and consistency., Work on data domains such as Agreements, Claims, Policies, and Customers., Create tests (including automated ones) for pipelines and data products., Work with analysts and business people to turn their needs into technical solutions., Help set and follow best practices in SQL, Python, and Azure Data Factory (ADF)., Plan and track tasks using Azure DevOps.] Requirements: Azure Databricks, Azure Data Factory, SQL, Python, Azure DevOps, Spark

No Fluff Jobs

Aplikuj