Data Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Create batch and real-time data pipelines on our GCP platform.

• Develop APIs for data sharing with other teams and establish CI/CD pipelines for automated deployments.

• Implement Terraform Infrastructure as Code (IAC) for core infrastructure deployment and utilize Datastream for CDC data ingestion.

• Leverage Dataform and dbt to design a medallion data architecture while enhancing BigQuery and ClickHouse models.

• Construct Airflow Directed Acyclic Graph (DAG) pipelines for data imports and exports, incorporating monitoring and alerting to ensure data integrity.

• Ensure compliance with GDPR/CCPA and uphold data governance standards across all platforms.

⛳️ Requirements

• Strong expertise in Bash, Git, SQL, and Python (essential skills).

• Practical experience with Terraform IAC, Docker, and Kubernetes.

• Solid knowledge of GCP, including BigQuery, Dataform, Airflow, and Datastream.

• Experience in real-time processing using Kafka, PySpark, or Flink.

• Demonstrated skills in ETL/CI-CD development and API creation.

• Bachelor's degree in Computer Science, Data Science, Information Systems, or equivalent experience.

🏝️ Benefits

• Flexible remote work options.

• Opportunities for professional development.

• A culture that values diverse ideas and innovative thinking.