Senior Data Engineer – AWS

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and enhance the data ecosystem within a credit fintech.

• Act as the technical reference for the team, collaborating closely with BI, automation, and business units.

• Design, implement, and sustain scalable data pipelines, ensuring their reliability, performance, and traceability.

• Manage pipeline orchestration using Apache Airflow, overseeing dependencies, retries, alerts, and failures.

• Build and advance the analytics environment using a layered architecture (bronze, silver, and gold) on AWS.

• Utilize Python and SQL for data transformation, validation, and analysis.

• Maintain data quality, integrity, and governance at every step of the pipeline.

• Integrate data from transactional databases, CRM systems, workflow management tools, and NoSQL databases for BI and business team utilization.

• Leverage AI throughout the data lifecycle, including code generation and review, documentation, and testing.

• Conduct code reviews and advocate for data engineering best practices.

⛳️ Requirements

• Over 5 years of substantial experience in data engineering, focusing on building and maintaining production pipelines.

• Advanced expertise in Python and SQL.

• Experience in data architecture and modeling.

• Proven experience in orchestrating data pipelines with Apache Airflow.

• Familiarity with cloud platform services, particularly AWS (e.g., S3, RDS).

• Background with transactional databases, APIs, and business tools (e.g., CRM and workflow management platforms).

• Proficient in utilizing AI as a work tool, including the creation and use of agents, skills, and Spec-Driven Development (SDD).

• Demonstrated experience with data quality, governance, and reliability.

• Previous involvement with financial products or fintech environments.

• Knowledge of Docker and Kubernetes.

• Experience with continuous integration and continuous delivery (CI/CD) practices.

• Familiarity with Agile methodologies.

• Awareness of BI tools used for data consumption (e.g., Metabase).

• A proactive and ownership-oriented approach to structuring and advancing the data function.

• Ability to independently identify issues, propose solutions, and implement them.

• Strong communication skills to translate data insights into business decisions for non-technical teams.

• Adaptability in tailoring technical solutions to address real business needs.

• Comfort in navigating ambiguity and limited structure, typical for developing teams and functions.

• Hands-on proficiency in Python, advanced SQL, Apache Airflow, AWS, and the application of AI as a work tool (agents, skills, and SDD) is crucial.

🏝️ Benefits

• Porto Seguro health insurance, with the option to add a spouse and children.

• Porto Seguro dental insurance for employees and their dependents.

• Profit-Sharing and Results Program (PLR).

• Childcare assistance.

• Alelo food and meal vouchers.

• Home-office allowance.

• Partnerships with educational institutions, providing discounts and incentives for courses and degree programs.

• Certification incentives, including cloud certifications (GCP, Azure, AWS, and others).

• Livelo points.

• TotalPass, offering discounted gym plans for employees and their family members.

• Mindself, providing incentives for meditation and mindfulness practices.

• Ongoing professional development opportunities.