Senior Data Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Prepare, structure, and facilitate the Snowflake data necessary for the Dataiku PO agent proof of concept.

• Design, develop, and uphold data pipelines to ingest, transform, normalize, and prepare data from various sources.

• Create and implement scalable, reliable, and maintainable data ingestion workflows within Snowflake.

• Develop and maintain data models that support analytical use cases and requirements for proof-of-concept.

• Execute data quality checks and validation rules to ensure accuracy, consistency, completeness, and reliability.

• Utilize SQL and Python to efficiently process, transform, and validate large datasets.

• Identify and rectify data inconsistencies, anomalies, and structural challenges that impact downstream consumption.

• Assist in ETL processes and file-handling workflows for both structured and semi-structured data.

• Collaborate with business and technical stakeholders to convert data requirements into dependable data solutions.

• Contribute to the creation of technical documentation and work on the continuous improvement of data processes, standards, and validation practices.

⛳️ Requirements

• Over 5 years of experience in Data Engineering or Data Analytics roles with a strong emphasis on engineering.

• Significant hands-on experience with Snowflake (essential).

• Proficient SQL skills, encompassing data transformation, querying, and validation.

• Experience in data modeling and preparing datasets for analytical and downstream applications.

• Demonstrated experience in data quality validation, including the implementation of checks to ensure accuracy, consistency, and completeness.

• Experience in constructing and maintaining ETL pipelines and data ingestion workflows.

• Practical experience with Python for data processing and transformation.

• Strong attention to detail with a commitment to data reliability and quality.

• Capability to collaborate effectively with both technical and business stakeholders.

• Experience in integrating or connecting Snowflake with Dataiku (preferable).

• Familiarity with AI-driven or agent-based proof-of-concept initiatives (preferable).

🏝️ Benefits

• Certifications in AWS (we are AWS Partners), Databricks, and Snowflake.

• Access to AI learning paths to keep abreast of the latest technologies.

• Study plans, courses, and additional certifications tailored to your role.

• Access to Udemy Business, featuring thousands of courses to enhance your technical and soft skills.

• English lessons to support your professional communication.

• Travel opportunities to participate in industry conferences and meet clients.

• Career development plans and mentorship programs.

• Special day rewards to celebrate birthdays, work anniversaries, and other personal milestones.

• Company-provided equipment.

• Flexible working options to help you achieve the right work-life balance.

• Other benefits may vary depending on your location in LATAM.