Senior Data Engineer – AWS

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Organize, gather, and process extensive amounts of data utilizing ETL tools.

• Convert the client's business goals into an information management and business intelligence strategy.

• Maintain data pipelines and ensure secure access to information.

• Develop and present metrics and dashboards based on the collected data, ensuring quality and integrity of information.

• Participate in data platform modernization efforts, emphasizing Lakehouse architecture, governance, quality, and preparing data for analytical and AI uses.

• Design dimensional models for use by business teams, dashboards, and reports.

• Engage across the entire data lifecycle: ingestion, processing, storage, transformation, consumption, and governance.

⛳️ Requirements

• Senior-level professional with expertise in Data and AWS.

• Proficient in collecting, transforming, and loading data using ETL tools, Python, and PySpark.

• Familiarity with AWS Cloud services: Glue, EMR, Athena, SNS, Lambda, Step Functions, S3, Lake Formation, IAM, and CloudWatch.

• Understanding of NoSQL modeling and databases, including MongoDB, DynamoDB, and Hadoop.

• Knowledge of Lakehouse architecture with Apache Iceberg, encompassing analytical table management, versioning, schema evolution, partitioning, and performance enhancement.

• Experience with query engines for large datasets, such as Athena, Trino, Presto, or Spark SQL, with the capability to optimize queries and work with columnar formats like Parquet and ORC.

• Understanding of dimensional modeling, including facts and dimensions, granularity, keys, hierarchies, metrics, and indicators.

• Experience with structured, semi-structured, and unstructured data.

• Experience conducting unit and performance tests.

• Knowledge of security best practices, access control, and cloud monitoring.

• AWS Practitioner and AWS Data Engineer certifications are advantageous.

• Experience in data quality and observability is beneficial.

• Familiarity with infrastructure-as-code tools such as Terraform and CloudWatch is a plus.

• Understanding of Data Mesh is a plus.

• Knowledge of AI applications in data is a plus.

• Strong problem-solving abilities.

• Capability to work independently and manage your own schedule.

🏝️ Benefits

• Flexible benefits card – choose how and where to utilize it.

• Tuition assistance for undergraduate, graduate, MBA, and language courses.

• Certification incentive programs.

• Flexible working hours.

• Competitive salaries.

• Annual performance review with a structured career development plan.

• International career opportunities.

• Wellhub and TotalPass.

• Private pension plan.

• Childcare assistance.

• Health insurance.

• Dental insurance.

• Life insurance.