Senior Solution Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Responsibility for data management and governance within the Databricks environment

• Optimization of data processing logic

• Development and management of data architecture

• Ingestion and transformation of external marketing data

• Oversight of data storage operations in Amazon Redshift

• Scheduling and management of data analysis workflows

⛳️ Requirements

• Advanced level of English

• Familiarity with the Databricks ecosystem

• Comprehensive management of the Databricks environment

• Implementation of data governance using Unity Catalog

• Management of structured storage with Delta Lake tables

• Writing and optimizing data processing logic with Python, SQL, and PySpark

• Managing the code lifecycle and collaborative development using Git

• Overseeing data architecture, performance, and integrations within Snowflake

• Handling Adobe Data Flows and Adobe Analytics

• Ensuring proper ingestion and transformation of external marketing data

• Monitoring data storage operations in Amazon Redshift

• Utilizing Airflow to schedule, monitor, and manage data analysis workflows

• Maintaining data availability and basic operations in Google Cloud Platform's BigQuery

• Managing serverless queries with Athena

• Overseeing metadata management with AWS Glue

• Owning the maintenance of end-to-end data pipelines

• Ensuring reliability from data ingestion to final delivery across multiple cloud platforms.

🏝️ Benefits

• Not specified