Data Analyst II

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Organize, gather, and manage extensive amounts of data utilizing ETL tools.

• Convert clients’ business goals into strategies for information management and business intelligence.

• Build and sustain data pipelines, guaranteeing secure access to information.

• Generate and present metrics and dashboards derived from collected data, maintaining information quality and integrity.

• Play a role in modernizing the data platform, emphasizing Lakehouse architecture, governance, quality, and preparing data for analytics and AI usage.

• Design dimensional models for utilization by business teams, dashboards, and reports.

• Engage throughout the entire data lifecycle, encompassing ingestion, processing, storage, transformation, consumption, and governance.

• Create and enhance pipelines using Python, PySpark, and AWS services.

• Collaborate with Apache Iceberg, aiding in analytical table management, versioning, schema evolution, partitioning, and performance enhancement.

• Utilize query engines for large data volumes, such as Athena, Trino, Presto, or Spark SQL, working with columnar formats like Parquet and ORC.

• Execute unit and performance testing, along with implementing security best practices, access controls, and cloud monitoring.

• Support the quality, traceability, integrity, and efficiency of data processes.

⛳️ Requirements

• Proven experience in collecting, transforming, and loading data using ETL tools.

• Proficiency in Python and PySpark.

• Familiarity with AWS services, including Glue, EMR, Athena, SNS, Lambda, Step Functions, S3, Lake Formation, IAM, and CloudWatch.

• Understanding of NoSQL databases, such as MongoDB and DynamoDB, along with related Hadoop technologies.

• Experience with Lakehouse architecture and Apache Iceberg, including analytical table management, versioning, schema evolution, partitioning, and performance optimization.

• Familiarity with query engines for large data volumes, such as Athena, Trino, Presto, or Spark SQL.

• Knowledge of columnar formats, including Parquet and ORC.

• Experience in dimensional modeling, covering facts, dimensions, granularity, keys, hierarchies, metrics, and indicators.

• Proficient in processing structured, semi-structured, and unstructured data.

• Knowledge of unit and performance testing.

• Experience with security best practices, access controls, and monitoring in cloud environments.

• AWS Practitioner and AWS Data Engineer certifications are advantageous.

• Familiarity with Data Quality and Data Observability is a plus.

• Understanding of infrastructure as code, such as Terraform, and monitoring tools like CloudWatch is beneficial.

• Knowledge of Data Mesh is a plus.

• Understanding the application of Artificial Intelligence to data is an advantage.

• Strong problem-solving skills.

• Ability and comfort in working independently and managing your own schedule.

🏝️ Benefits

• Multi-benefit card – select how and where to utilize it.

• Education grants for undergraduate, graduate, MBA, and language courses.

• Certification incentive programs.

• Flexible working hours.

• Competitive salaries.

• Annual performance evaluations with a structured career development plan.

• International career opportunities.

• Wellhub and TotalPass.

• Private pension plan.

• Childcare support.

• Medical insurance.

• Dental coverage.

• Life insurance.