Senior Data Engineer, Data Platform team

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design, construct, and manage scalable data ingestion and processing pipelines across various source systems.

• Take the lead on platform architectural decisions and draft adoption proposals.

• Enhance platform reliability, observability, and cost effectiveness.

• Collaborate with Platform engineers to develop infrastructure.

• Work in partnership with analytics engineers, analysts, developers, platform engineers, and product managers.

• Refine data contracts, tools, and self-service capabilities for data consumers.

• Provide mentorship to data engineers through code reviews, collaborative programming, and design feedback.

• Propel automation and AI-supported operations.

• Assume ownership of architectural decisions from proposal to production.

• Deliver and manage data platform solutions while influencing the platform roadmap.

⛳️ Requirements

• Several years of experience in building and managing production data platforms.

• Proficient in data warehousing, data lakes, orchestration, ingestion, and event streaming.

• Strong skills in Python and SQL.

• Solid understanding of software engineering practices, including testing, CI/CD, and code reviews.

• Extensive experience with an orchestrator like Airflow, including its operation, scaling, and debugging.

• Strong background in AWS and cloud data warehouses.

• Familiarity with Docker and Kubernetes, including deployment, inspection, and debugging of workloads.

• Experience in designing for failure, encompassing idempotency, backfills, data quality checks, and monitoring.

• Excellent written and verbal communication skills in English.

• A proactive and pragmatic approach to problem-solving.

• Must reside in Poland.

• Experience with Kubernetes operations, Terraform, Docker optimization, and CI/CD is advantageous.

• Experience with ingestion, dbt modeling, and data serving is beneficial.

• Familiarity with streaming and message-driven architectures; experience with RabbitMQ is highly desirable, and Kafka or similar is also relevant.

• Knowledge of Spark or experience in operationalizing ML models is a plus.

🏝️ Benefits

• 100% remote-friendly work environment.

• Option for remote or hybrid work with a hub located in Warsaw.

• Fully flexible working hours.

• 20/26 days of paid time off, depending on your contract.

• An additional paid day off for your birthday or work anniversary.

• Private healthcare plan with Signal Iduna for employees, along with subsidized family coverage.

• Co-financing for a Multisport card.

• Access to iFeel for online psychological support and counseling.

• Complimentary English and Spanish language classes.

• Remote-first, adaptable work environment.

• Collaborative cross-functional team environment.

• Opportunities for professional growth through mentoring, ownership of architecture, and involvement in the platform roadmap.