
Data Infrastructure Engineer
Posted 13 hours ago

Posted 13 hours ago
This is a fully remote position, open to applicants in Spain.
• Design, develop, and maintain scalable infrastructure for data ingestion, transformation, storage, and serving.
• Manage streaming workflows utilizing Kafka and Avro.
• Orchestrate batch processing workflows using Airflow.
• Ensure Redshift remains performant, well-structured, and cost-efficient.
• Oversee secure and reproducible cloud environments for development, testing, and production while implementing effective cost controls.
• Take ownership of SLOs, runbooks, and alerts for essential data systems.
• Safeguard sensitive information through access controls, encryption, secrets management, and retention policies.
• Conduct investigations into incidents, lead root-cause analyses, and implement preventative measures.
• Enhance data discoverability via cataloging, lineage tracking, ownership assignment, and quality testing.
• Create documentation, tools, and self-service workflows for analytics and engineering teams.
• Collaborate with SRE, product, engineering, analytics, and security teams.
• Minimum of 2 years of experience in data platform engineering or scalable software systems.
• Proficiency with Kafka and Avro, including schema design, serialization, and evolution.
• Experience with Redshift and production Airflow, focusing on data modeling and performance optimization.
• Background in cloud technologies and DevOps, including CI/CD, infrastructure as code, and Kubernetes.
• Familiarity with data lakes and open table formats.
• Experience in reliability and security, including observability, incident response, and debugging of pipeline failures.
• Security-conscious mindset regarding data access, privacy, and secrets management.
• Ability to communicate clearly with both technical and non-technical stakeholders.
• Experience with dbt is a plus.
• Must reside in Spain and possess the right to work there.
• Visa sponsorship and relocation assistance are not available.
• Access to the best AI and agentic tools.
• A culture of trust that promotes autonomy and respects employees' time.
• Equal employment opportunities for all individuals.
• A diverse and inclusive work environment.
Capco
Reach plc
Get handpicked remote jobs straight to your inbox weekly.