Senior Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Take full responsibility for managing the Databricks environment, which includes configuration and workspace administration.

• Implement data governance measures utilizing Unity Catalog and oversee structured storage through Delta Lake tables.

• Develop and enhance data processing logic using Python, SQL, and PySpark.

• Manage data architecture and optimize performance within Snowflake.

• Handle Adobe Data Feeds and Adobe Analytics, ensuring accurate ingestion and transformation of marketing data.

• Supervise data warehousing operations in Amazon Redshift.

• Schedule and monitor intricate data workflows using Airflow.

• Maintain end-to-end reliability of data pipelines, ensuring dependable ingestion to delivery across various cloud platforms.

• Oversee the code lifecycle and facilitate collaborative development using Git.

⛳️ Requirements

• Advanced expertise in the Databricks Ecosystem (including Workspace administration, Delta Lake, and Unity Catalog).

• Specialized knowledge in Data Warehousing & Integration, particularly with Snowflake.

• Strong programming skills in Python, SQL, and PySpark.

• Practical experience with Adobe Data Ingestion (Data Feeds/Analytics).

• Solid background in version control utilizing Git.

• Experience with Amazon Redshift for conducting data warehousing operations.

• Proficient in orchestration tools, specifically Airflow.

• Familiarity with Google Cloud Platform (specifically BigQuery) operations.

• Knowledge of AWS Data Services such as Athena and AWS Glue.

• Advanced proficiency in spoken English.

• Advanced proficiency in Spanish.

🏝️ Benefits

• Global career opportunities and exposure to impactful projects within an international network of expertise.

• Workplace recognized as one of the most sustainable corporations globally.

• Opportunity to engage in end-to-end digital transformation projects for global leaders.