Mid Data Platform Engineer

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Provide assistance to users of the data platform, resolving and rectifying issues.

• Support data pipelines and ETL/ELT processes to ensure dependable and scalable data flows.

• Collaborate with platform architects to guarantee that the data platform is optimized, secure, and highly available.

• Enhance data processes, monitoring, performance, and overall platform efficiency.

• Aid in establishing data quality frameworks and monitoring to maintain the accuracy, consistency, and completeness of data pipelines.

• Assist with data lakes, data warehouses, and data streaming solutions.

• Work alongside data scientists, analysts, and business users to address data platform challenges.

• Automate repetitive tasks and improve processes related to data ingestion, transformation, and delivery.

• Troubleshoot and optimize data workflows and SQL queries for enhanced performance and cost efficiency.

• Document modifications, processes, and best practices related to the data platform.

• Review, evaluate, and authorize data product releases to production.

⛳️ Requirements

• Proficient in both written and spoken Portuguese and English.

• A notice period of 30 days for termination.

• Capability to work remotely from any region within Portugal.

• Experience with data pipelines in a production setting.

• Strong practical knowledge of SQL.

• Familiarity with distributed data processing, such as Apache Spark.

• Expertise in troubleshooting dbt, Apache Kafka, Apache Ignite, Apache NiFi, and Apache AirFlow.

• Proficient in a programming language like Python or Scala for data engineering tasks.

• Experience with cloud data services, particularly AWS.

• Knowledge of Grafana tools.

• Understanding of data governance, security, and compliance within a cloud environment.

• Experience in implementing CI/CD and testing frameworks for data workflows.

• Strong problem-solving abilities, effective communication skills, and a passion for teamwork.

🏝️ Benefits

• 100% Remote work opportunities.

• Opportunities for international career and professional development.

• Health and Life Insurance coverage.

• Tech Visa support for candidates from outside the European Union.

• A professional, dynamic, and collaborative team environment.