Senior Data Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Create, develop, and sustain scalable data pipelines that facilitate the ingestion, transformation, and distribution into centralized feature stores, model-training workflows, and real-time inference services.

• Construct and enhance workflows for the extraction, storage, and retrieval of semantic representations from unstructured data.

• Design and implement streamlined analytics and dashboard solutions that provide natural language query experiences and AI-driven insights.

• Define and carry out prompt engineering, orchestration, and model fine-tuning processes for conversational interfaces.

• Manage vector data stores and devise efficient indexing strategies for retrieval-augmented generation (RAG) workflows.

• Collaborate with data stakeholders to gather requirements for language-model projects and convert them into scalable solutions.

• Develop and maintain documentation for data processes, workflows, and model deployment procedures.

• Keep abreast of and explore emerging methodologies in data engineering, MLOps, and LLM operations.

⛳️ Requirements

• Over 8 years of experience as a Data Engineer.

• Proven experience in utilizing Python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing.

• Practical experience with Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion.

• Experience in designing complex data pipelines that extract data from RDBMS, JSON, API, and flat file sources.

• Proficient in SQL and PL/SQL programming.

• Advanced understanding of Business Intelligence and data warehouse methodologies.

• Hands-on experience with relational database systems and cloud-based database services such as Snowflake/Redshift.

• Knowledge of software engineering principles.

• Experience working with Unix/Linux/Windows operating systems.

• Familiarity with Agile methodologies.

• Proficient in version control systems, including managing code repositories, branching, merging, and collaborating within a distributed development environment.

• Interest in business operations and an understanding of how effective BI systems contribute to corporate profitability.

• Strong oral and written communication skills in English.

• Please attach CV in English.

• The interview process will be conducted in English.

• Applicants must be from LATAM.

• In-person verification will be conducted.

🏝️ Benefits

• Opportunity for remote work.

• B2B Employment ($, gross).

• Stable position with long-term growth prospects surrounded by talented individuals.

• Access to high-quality hardware.

• Excellent learning and growth opportunities.

• Compensation for professional training, seminars, and conferences.

• Referral program – receive rewards for helping us expand the team with skilled individuals.

• Company-supported English classes to foster your professional development.