Senior Data Engineer – AI Data Platform

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Revise current schemas and tables to eliminate redundancy and enhance consistency within the Medallion Architecture.

• Enhance and restructure Airflow pipelines for improved reliability and performance.

• Develop, maintain, and optimize dbt models that drive downstream analytics and product features.

• Apply aggregation and pre-computation techniques to enhance dashboard responsiveness and chat reply times.

• Analyze and optimize Snowflake query performance to facilitate a responsive, production-level platform.

• Boost overall warehouse efficiency, scalability, and cost-effectiveness.

• Establish data quality testing and validation processes to identify issues prior to reaching production.

• Diagnose and resolve production data challenges, taking ownership of solutions until resolution.

• Assume full responsibility for solutions from implementation to production stability.

⛳️ Requirements

• A Bachelor's Degree in Computer Science, Software Engineering, Information Systems, or a related discipline is preferred, or equivalent professional experience.

• Over 5 years of experience as a Data Engineer working with production-level data platforms.

• Demonstrated experience in refactoring live schemas and conducting safe, production-grade data migrations.

• Practical experience in consolidating and deduplicating data within a Medallion Architecture (Bronze, Silver, Gold).

• Strong expertise in Snowflake, including query profiling, performance tuning, warehouse sizing, clustering, and cost optimization.

• Substantial dbt experience, covering model design, incremental models, materializations, and testing.

• Experience in developing and refactoring Airflow DAGs and managing pipelines in a production environment.

• Advanced SQL skills with a track record of diagnosing and addressing production performance challenges.

• Working knowledge of Python for data engineering tasks.

• Familiarity with Git and CI/CD practices in a production context.

• Capability to work with undocumented or evolving pipelines and schemas.

• Strong communication abilities for articulating technical decisions and trade-offs.

• Upper-Intermediate to Advanced English proficiency (B2+/C1) for technical discussions.

• Snowflake SnowPro certification is a plus.

• dbt Analytics Engineering certification is a plus.

• Familiarity with data lineage tools such as Monte Carlo, OpenLineage, or dbt Docs is a plus.

• Exposure to BI or semantic layer tools is a plus.

• Experience with CDC or streaming data pipelines is a plus.

• Experience supporting data platforms for AI, LLM, or conversational products is a plus.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work options.

• Opportunities for professional development and further education.

• Health and wellness benefits, including medical, dental, and vision insurance.

• Engaging company culture with team-building activities and events.