Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Design, construct, and sustain scalable data pipelines tailored for AI/ML workflows, encompassing feature engineering and datasets for model training.

• Create and execute data pipelines, data lakes, and data warehousing solutions.

• Collaborate with data scientists and analysts to implement machine learning models and analytics solutions on Databricks.

• Optimize Databricks cluster performance for cost efficiency and effective resource utilization.

• Apply Databricks security features, uphold data governance, and ensure compliance with industry regulations.

• Work alongside data scientists to securely deploy and operationalize machine learning models in a production environment.

• Contribute to the technical direction and establish best practices for data engineering initiatives.

• Keep abreast of Databricks innovations, best practices, and industry trends, sharing insights with the team.

⛳️ Requirements

• 1-4 years of experience in data engineering or related disciplines.

• Strong background in Databricks, with a focus on platform engineering, data engineering, and analytics.

• Proficient in Python, Scala, or Java.

• Extensive experience with Databricks APIs, Apache Spark, and Delta Lake.

• Solid experience in data warehousing, ETL processes, and data governance frameworks.

• Practical experience in supporting AI/ML lifecycles, with knowledge of ML frameworks such as TensorFlow or PyTorch, or MLOps practices.

• Proven capability to work independently, take initiative on projects, and collaborate effectively within a team.

• Excellent communication and interpersonal skills for productive collaboration with stakeholders.

• Hands-on experience with AWS, Azure, or GCP is a plus.

• Databricks Certified Professional or equivalent certification is preferred.

• Familiarity with ML concepts and libraries such as TensorFlow, PyTorch, and Scikit-learn is advantageous.

🏝️ Benefits

• Exceptional learning and growth opportunities within the industry.

• Comprehensive health and wellness benefits, including medical coverage for yourself and your family.

• Employee rewards program.

• Paid parental leave.

• Flexible working hours.

• Benefits for remote work.