DataOps Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, and sustain a scalable data platform infrastructure utilizing AWS, Kubernetes, EMR, Redshift, Glue, and other technologies.

• Data Modeling & Transformation: Create, enhance, and manage modular and scalable data models (leveraging dbt and SQL) within our Redshift data warehouse to convert raw data into analytics-ready formats.

• Oversee and advance client-facing tools and frameworks for data processing, such as QuickSight, Redshift Editor, Athena IDE, and Metabase.

• Establish and uphold secure, automated CI/CD pipelines for data components and infrastructure-as-code.

• Collaborate with DevOps and Security teams to guarantee compliance, reliability, and scalability of the data platform.

• Provide development environments, standardized workflows, and tools (including Sagemaker Studio, Athena IDE, Redshift Editor, etc.) to enhance the developer experience.

• Facilitate version control, release workflows, and automation for data transformation, jobs, data workloads, and integrations utilized by data producers and consumers.

• Ensure the high availability and performance of data tools through observability and alerting integrations.

• Implement data quality and validation checks, such as dbt tests and unit tests.

• Assist in maintaining data catalogs and documentation for lineage and governance.

• Investigate and address issues in data pipelines, workloads, and integrations, ensuring adherence to SLAs.

• Document data flows, architectural setups, and data models.

⛳️ Requirements

• Bachelor’s or Master’s degree in IT, Mathematics, Computer Science, Engineering, or a related technical field.

• Proven track record in building big data pipelines and orchestrating data workloads.

• Proficient in AWS cloud services (EKS, EC2, EMR, RDS) and big data tools (Spark, Redshift).

• Experience with relational databases (preferably Postgres), strong SQL proficiency, data modeling, and data warehousing.

• Familiarity with Infrastructure as Code (IaC) tools, such as Terraform.

• Experience with Kubernetes and Docker.

• Proficient in using CI/CD tools.

• Knowledge of automation and workflow management tools (e.g., Airflow, Sagemaker).

• Proficiency in Python programming.

• Professional working proficiency in English for daily collaboration within a distributed global team.

🏝️ Benefits

• Bradesco health and dental insurance for you and your dependents, with no co-payment required;

• Life insurance with comprehensive coverage;

• Meal and supermarket vouchers;

• Home Office Allowance;

• Wellhub - A platform providing access to venues for physical activities and online classes;

• Trustly Club - Discounts at educational institutions and partner stores;

• English Program - Online group classes with a private instructor;

• Extended maternity and paternity leave;

• Birthday Off;

• Flexible hours/Home Office - our culture embraces remote-first work! You can work from any city in Brazil;

• Welcome Kit - We provide Apple equipment (Macbook Pro, iPhone) along with additional treats! Spoiler alert: You can purchase equipment according to internal guidelines!

• Referral Program - If you recommend a candidate who gets hired, you will receive a reward!