This is a fully remote position, open to applicants in Colombia.

📋 Description

• Construct and maintain non-interactive (batch, distributed) and real-time, highly available data pipelines.

• Develop fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines.

• Offer consultation and spearhead the implementation of complex programs.

• Create and uphold documentation for designated systems and projects.

• Optimize queries executing over billions of rows within a distributed query engine.

• Conduct root cause analysis to determine permanent solutions to software or business process challenges.

⛳️ Requirements

• Solid foundation in data engineering, particularly with Databricks and Azure.

• Expertise in SQL and Python.

• Proficient in Spark, data management, cloud services, and automation tools.

• Familiarity with Agentic AI and Snowflake.

• Experience with SQL Server (T-SQL, query-heavy, not ORM).

• Knowledge of PostgreSQL (read-only, for the Cargotel replica).

• Skills in Python and FastAPI.

• Experience with scikit-learn (percentiles, outlier detection).

• Understanding of acceptance/likelihood models (carrier-accept-probability logic).

• Familiarity with Kafka (consuming, not building).

• Capability to read C# well enough to extract logic, though not to write it.

• Basic understanding of AWS: S3, RDS, Secrets Manager, CloudWatch.

• Proficient in Terraform (read fluency).

• Demonstrated industry experience in executing data engineering, analytics, and/or data science projects, or possess a Bachelor's/Master's degree in quantitative studies such as Engineering, Mathematics, Statistics, Computer Science, or computation-intensive Sciences and Humanities.