Data Integration Engineer, Databricks, Python, SQL

This is a fully remote position, open to applicants in Poland, +5 more countries.

📋 Description

• Catalog and map all internal and external data sources.

• Establish data contracts and standardized data structures for client, screening, evidence, audit, and reporting data.

• Create connectors to external screening providers, public registries, and local data sources.

• Integrate Databricks with SQL Server, legacy databases, and key enterprise systems.

• Facilitate API, database-link, batch, file, and SFTP-based integrations.

• Design and uphold data models that support evidence, audit trails, and reporting.

• Execute data quality checks, contract tests, and retention policies.

• Validate both incoming and outgoing data flows across production services.

• Assist with integration troubleshooting and ensure production readiness.

• Play a vital role in a business-critical platform where data accuracy and reliability are paramount.

⛳️ Requirements

• Extensive hands-on experience with Databricks, particularly Delta Lake and Unity Catalog.

• Proficient in Python / PySpark.

• Advanced SQL proficiency.

• Experience with SQL Server and legacy databases integration.

• Strong background in REST APIs, DB links, batch processing, file handling, and SFTP integrations.

• Expertise in data modeling and the design of data contracts.

• Experience in implementing data quality validation and integration testing.

• Fluent in English and capable of working remotely within the EU.

🏝️ Benefits

• Competitive salary.

• Flexible work hours.

• Opportunities for professional development and training.

• Collaborative and inclusive work environment.