This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop, migrate, and enhance Data Engineering solutions within Databricks environments.

• Create and sustain scalable, dependable, and high-performing data pipelines.

• Execute data ingestion, transformation, and delivery methods utilizing Spark and PySpark.

• Collaborate with Data Lake and Data Lakehouse architectures, applying the Medallion model (Bronze, Silver, and Gold).

• Analyze business rules and convert them into data processes and solutions.

• Engage in data platform migration and modernization initiatives.

• Guarantee the quality, performance, monitoring, and reliability of pipelines.

⛳️ Requirements

• Expertise in PySpark, Apache Spark, and SQL.

• Background in Delta Lake, Delta Tables, Unity Catalog, and Lakeflow Declarative Pipelines.

• Familiarity with Lakeflow Connect for data ingestion.

• Experience with Jobs, Workflows, pipeline orchestration, and monitoring.

• Proficient in Lakehouse architecture and the Medallion model (Bronze, Silver, and Gold).

• Background in migrating platforms or executing projects in Databricks.

• Knowledge of Git, CI/CD, and best practices in development and deployment.

• Familiarity with Airflow, Kafka, dbt, AWS Glue, and BigQuery.

• Experience with SQL/NoSQL databases such as PostgreSQL, MongoDB, or Cassandra.

• Preferred: experience with accounting and financial projects.

• Preferred: Databricks Certified Data Engineer Associate certification.

🏝️ Benefits

• Remote work.

• This position is also available to candidates with disabilities.