Senior Data Engineer – LATAM

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and expand high-throughput streaming pipelines

• Design, implement, and manage pipelines that handle over 400M monthly MLS updates across more than 350 integrations utilizing Airflow, Spark Streaming, Kafka, and Iceberg

• Create and deliver high-quality, production-ready real estate datasets

• Build and sustain datasets that enhance core product functionalities

• Improve data quality and observability

• Establish and refine data quality checks, monitoring, and alert systems

• Utilize AI to enhance data operations

• Participate in the development of AI-driven tools that assist in triaging, debugging, and resolving data quality challenges

⛳️ Requirements

• Over 6 years of experience in professional data engineering or software engineering

• Extensive experience with distributed data processing and streaming frameworks (Spark / PySpark, Kafka)

• Proficient in Python (preferably Pydantic) with familiarity in Node/TypeScript considered an advantage

• Experience in building and maintaining data pipelines on AWS using tools such as Airflow, Spark Streaming, and Iceberg

• Strong understanding of data modeling and handling large-scale datasets

• Familiarity with event-driven systems and ingestion methods (Kafka, SQS)

• Proven experience in implementing data quality checks, monitoring, and troubleshooting data issues

• Interest in leveraging AI/ML or automation to enhance data workflows is a plus

• Demonstrated success in leading high-impact projects from concept to production within a SaaS context

• Deep understanding of software design principles and experience with multi-tenant platform architectures

🏝️ Benefits

• Equal Opportunity Employer

• Agile and resilient team culture

• Innovative products and solutions

• AI-enhanced tools for increased efficiency

• Recognized as a Best Place to Work since 2020

• Awarded as a Tech Trendsetter along with various other accolades