Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Design, develop, and maintain data replication and integration solutions utilizing HVR.

• Create, construct, and manage scalable data pipelines using Databricks (Spark, Delta Lake).

• Develop and enhance ETL/ELT processes for both structured and unstructured data.

• Work with extensive datasets to guarantee data quality, integrity, and performance enhancement.

• Implement data models and transformations tailored for analytics and reporting.

• Collaborate with data scientists and analysts to facilitate advanced analytics and machine learning workloads.

• Integrate data from various sources, including databases, APIs, and streaming systems.

• Optimize Spark jobs for improved performance and cost efficiency.

• Enforce data governance, security, and access controls.

• Monitor and resolve issues in data pipelines and production environments.

• Support CI/CD pipelines and adhere to DevOps best practices for data engineering workflows.

• Assist with data migration and modernization projects.

• Produce operational documentation, runbooks, and support procedures.

• Engage in production support, issue resolution, and performance tuning activities.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field.

• Practical experience in data engineering or big data development.

• Strong proficiency in SQL / Oracle / SQL Server.

• Knowledge of Java / JavaScript (preferred).

• Familiarity with web-based applications and APIs (REST/SOAP).

• Extensive experience with the Databricks Platform.

• Proficient in Apache Spark (PySpark/Scala).

• Skilled in SQL & Python.

• Experience with Delta Lake and data lake architecture.

• Hands-on experience with cloud platforms such as Azure, AWS, or GCP.

• Familiarity with data orchestration tools like Azure Data Factory, Airflow, etc.

• Understanding of data warehousing concepts (Star schema, Snowflake schema).

• Experience with version control systems (Git) and CI/CD pipelines.

• Strong grasp of data pipeline optimization and performance tuning.

🏝️ Benefits

• Flexible work arrangements.

• Professional development opportunities.