Senior Platform Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Modify or create cloud resources in AWS and Azure.

• Modify or create new resources within Databricks.

• Modify or create new application resources in Kubernetes.

• Suggest and implement architectural enhancements.

• Enforce LGPD-related controls in the data lake.

• Develop Databricks metadata dashboards and analyses for compliance and control.

• Collaborate with the governance team to conduct audits, ensuring alignment of the data lake with the company's security policies.

• Monitor and evaluate costs to pinpoint bottlenecks and identify opportunities for cost reduction.

• Partner with data analytics and AI teams to optimize job performance and resource utilization.

• Collaborate with other platform engineers to foster skill development.

• Act as a technical resource for platform-related inquiries from data, business, and product stakeholders.

⛳️ Requirements

• Bachelor's degree or higher.

• Strong understanding of relational and non-relational databases, including patterns, modeling, and use cases.

• Proficiency in programming languages for maintaining data pipelines, such as Python and shell/bash, along with file manipulation formats like JSON, Parquet, and CSV.

• Experience in consuming APIs and executing data cleaning, processing, deduplication, enrichment, and normalization.

• Familiarity with messaging infrastructure utilizing Kafka and Debezium.

• Experience with Kubernetes cluster infrastructures, including EKS and AKS.

• Robust SQL skills complemented by a basic understanding of DBT.

• Involvement in cloud computing projects, primarily within AWS and/or Azure.

• Experience with Gitflow and version control systems.

• Proficiency in Infrastructure as Code, particularly with Terraform.

• Experience with distributed processing frameworks, such as Databricks and Spark.

• Familiarity with Docker.

• Experience using orchestration tools like Apache Airflow and Databricks Workflows.

• Strong knowledge of data architecture.

• Experience in building CI/CD pipelines.

• Familiarity with observability tools such as Grafana and CloudWatch.

🏝️ Benefits

• Meal allowance or meal card.

• Flexible working hours and remote work options (for remote positions).

• Commuter allowance or transportation voucher (for hybrid or on-site positions).

• Profit sharing (PLR).

• Flexible benefits through Flash Card (Multibenefits).

• Access to Gympass or Wellhub.

• Psicologia Viva (online platform for therapy and nutrition consultations).

• Health and dental insurance.

• Life insurance.

• Extended parental leave (up to 6 months for mothers and 20 days for fathers).

• Rede D'Ór: support and important information for maternal and newborn health with a network of accredited nurses.

• Partnership with your regional SESC, offering diverse programs in education, health, culture, leisure, and social assistance.

• Birthday Day Off (one paid day off on or during your birthday month).

• Online learning platform featuring a variety of courses to enhance skills (UCA).

• Language academy (AIA).

• Leadership development program.

• Mentoring program for Afya Women (MMA).

• Discounts on undergraduate and graduate courses at Afya's educational institutions.