Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop, maintain, and enhance data ingestion, transformation, and delivery pipelines utilizing Python, SQL, and Apache Airflow.

• Design and optimize tables and data models to meet analytical and operational requirements.

• Engage with Data Lake technologies, including Amazon S3, Apache Iceberg, and Trino.

• Integrate data from various sources such as relational databases, APIs, files, and both internal and external systems.

• Ensure the quality, consistency, traceability, security, and availability of data.

• Develop validations, alerts, metrics, and mechanisms for pipeline monitoring.

• Investigate data and performance issues, addressing root causes to prevent future occurrences.

• Assist analysts, data scientists, and business teams in defining requirements and developing solutions.

• Contribute to the advancement of data architecture, governance, and access control methodologies.

• Create and maintain comprehensive technical documentation for pipelines, tables, business rules, and architectural decisions.

• Write clear, testable, and maintainable code; participate in code reviews and share insights.

• Identify opportunities for automation, simplification, and enhancement of efficiency.

• Monitor production solutions and take responsibility for the reliability of data products.

⛳️ Requirements

• Extensive experience with Python, SQL, and Apache Airflow, specifically in constructing and maintaining data pipelines.

• Practical experience with Data Lakes and architectures for distributed storage and processing.

• Familiarity with Amazon S3, Apache Iceberg, Trino, or similar technologies.

• Strong foundation in Data Engineering principles, independent of the tools employed.

• Senior-level, hands-on experience in building, operating, and supporting pipelines on a daily basis.

• Ability to autonomously investigate issues, make technical decisions, and lead solutions from inception to production.

• Consistent professional history, with the ability to articulate career choices and transitions.

• Experience with PostgreSQL, Superset, and Docker (preferred).

• Familiarity with CI/CD practices (preferred).

• Experience in monitoring and supporting pipelines in a production environment (preferred).

• Background in fintechs, startups, or agile, low-bureaucracy settings (preferred).

• A keen interest in architecture, automation, and the ongoing evolution of data infrastructure (preferred).

🏝️ Benefits

• Market-competitive salary.

• Annual bonus.

• SuperSim Flex with Meal/Food Allowance.

• Transportation or Mobility Allowance.

• Health Insurance.

• Dental Insurance.

• Life Insurance.

• Education Allowance.

• Totalpass.

• Private Pension Plan.

• Stock purchase program for eligible positions.

• Company-subsidized training.

• Day off on your birthday.

• Weekly soccer and volleyball activities.

• Celebratory events and happy hours.

• Employment under Brazil’s CLT labor regime.