Data Engineer – On-Site, Engenheiro de Dados

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create, develop, and uphold scalable ETL/ELT pipelines utilizing Python, SQL, and AWS services.

• Design and advance layered Data Lake architectures in accordance with the Medallion Architecture pattern.

• Construct solutions for the ingestion, processing, and integration of structured, semi-structured, and unstructured data.

• Leverage Artificial Intelligence, Machine Learning, or Large Language Models (LLMs) to classify, standardize, validate, and enhance data.

• Work collaboratively with software engineers, data analysts, business stakeholders, and clients to convert business requirements into scalable technical solutions.

⛳️ Requirements

• Extensive experience with AWS services, such as Amazon S3, AWS Lambda, AWS Step Functions, AWS Glue, Amazon Athena, and Amazon DynamoDB.

• Proficient experience in Python for data engineering, encompassing ETL/ELT and batch processing.

• Advanced SQL capabilities, including data modeling, incremental processing, and query optimization.

• Proven experience in designing and implementing layered Data Lake architectures.

• Familiarity with columnar storage formats, particularly Parquet.

• Experience with Git, source code version control, and best practices in software engineering.

🏝️ Benefits

• Health insurance

• Flexible work arrangements

• Opportunities for professional development