Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, construct, and sustain scalable data lakes and lakehouses utilizing Apache Iceberg and AWS-native services.

• Create both streaming and batch data pipelines for extensive, high-velocity data sourced from various origins.

• Develop the real-time ingestion layer employing Kafka or comparable technologies.

• Optimize and uphold AWS-based infrastructure, including Redshift and its associated services.

• Establish and execute best practices for data quality, governance, monitoring, and reliability.

• Collaborate with engineering, analytics, and business teams to provide scalable data solutions for AI/ML, fraud detection, and regulatory reporting.

• Assume ownership of projects, operate independently, and influence the direction of the data platform.

• Define how data is ingested, stored, processed, and utilized throughout the organization.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.

• Demonstrated experience as a Senior Data Engineer, with a proven history of developing large-scale data platforms.

• Practical experience in building data lakes/lakehouses using frameworks like Apache Iceberg.

• Proficient in SQL, Python, and Git.

• Extensive experience with AWS cloud services, including S3, Glue, Redshift, and Athena.

• Familiarity with streaming technologies such as Kafka, RisingWave, or Flink.

• Knowledge of data orchestration tools like dbt, Mage.ai, Airflow, or Dagster.

• Advanced English communication abilities.

• Capability to work autonomously, adapt swiftly, and deliver outcomes in a dynamic environment.

• Experience with Terraform for infrastructure as code is a plus.

• Experience working with Kubernetes is advantageous.

🏝️ Benefits

• Opportunity to earn Klar stock options.

• 26 days of paid vacation annually.

• Computer equipment provided.

• Sponsored coaching and therapy sessions through Mantra Care.

• International work environment with exceptional and highly skilled professionals.

• A world-class team that aids in the development of your skills in areas of interest.

• Safe, welcoming, diverse, and inclusive workplace.