Azure Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Develop data pipelines to collect data from databases, APIs, and streaming platforms.

• Integrate and transform data to ensure compatibility with target data models or formats.

• Design and enhance data storage architectures, including data lakes, data warehouses, and distributed file systems.

• Implement partitioning, compression, and indexing strategies to optimize data storage and retrieval.

• Identify and address performance bottlenecks, fine-tune queries, and apply caching techniques.

• Design and establish data models that facilitate efficient storage, retrieval, and analysis.

• Collaborate with data scientists, analysts, and business stakeholders to capture requirements and deliver technical solutions.

• Clearly communicate complex technical concepts to non-technical stakeholders.

• Design and develop data processing systems on the Azure platform.

• Write efficient and scalable code for processing, transforming, and cleaning large datasets, both structured and unstructured.

• Work autonomously and take ownership of solution delivery.

• Operate within Agile and Scrum methodologies.

• Provide training and mentorship to junior data engineers.

⛳️ Requirements

• 4–6 years of professional experience in a related role.

• Strong communication skills, with the ability to convey information clearly and specifically to colleagues and business stakeholders.

• Experience working with agile methodologies and supporting tools (JIRA, Azure DevOps).

• Familiarity with other cloud technologies, data warehouses, data governance, and business analysis is advantageous.

• Demonstrated independence and accountability in delivering solutions.

• Ability to operate effectively within agile methodologies.

• Practical experience in designing and optimizing data storage solutions, including data lakes, data warehouses, and distributed file systems.

• Proficiency in Databricks (4/5).

• Proficiency in Apache Spark (4/5).

• Data programming proficiency (4/5).

• Software development for data engineering proficiency (4/5).

• Proficiency in Azure Services (3/5).

• Technical leadership proficiency (3/5).

• Proficiency in data processing architecture (3/5).

• Proficiency in GenAI for data engineering (3/5).

• CI/CD automation proficiency (3/5).

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Opportunities for professional growth and development.

• Flexible working hours and remote work options.

• Comprehensive health and wellness benefits.

• Engaging and inclusive company culture.