Data Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Take ownership of and enhance the primary data ingestion and transformation platform.

• Architect, implement, and oversee mission-critical data pipelines ensuring high availability and stringent SLO/SLI performance.

• Spearhead the transition to a unified ingestion framework featuring standardized CDC patterns, schema evolution, and automated data quality checks across Bronze, Silver, and Gold layers.

• Develop monitoring dashboards, alerting systems, and runbooks to facilitate self-service incident diagnosis and resolution.

• Uphold enterprise-wide data governance, RBAC, and data classification to ensure security, auditability, and compliance.

• Construct standard pipeline templates, CI/CD automated checks, and local testing tools to enhance developer productivity.

• Work in collaboration with Product, Analytics, Finance, and Operations teams to transform business requirements into robust and accessible datasets.

• Enhance pipeline efficiency, automate manual processes, and implement data engineering best practices.

• Facilitate reliable real-time financial decision-making for Risk, Lending, and Finance departments.

⛳️ Requirements

• Minimum of 4 years of experience in Data Engineering.

• A demonstrated history of constructing and managing production-grade data pipelines, preferably in a high-growth startup or fintech setting.

• Bachelor’s degree in Computer Science, Software Engineering, Mathematics, or a related technical discipline.

• Capability to design pragmatic systems with well-defined trade-offs, documented through Architectural Decision Records (ADRs).

• Experience in taking pipelines from conception and design through to deployment, live monitoring, and post-production iterations.

• Strong practical experience with Databricks, PySpark, and Delta Lake in both batch and streaming architectures.

• Familiarity with Airflow or other workflow orchestration tools.

• Understanding of Medallion architectures and incremental processing techniques such as CDC and merge patterns.

• Proficiency in clean coding practices, testing, CI/CD pipelines, performance tuning, and Git workflows, including PRs and code reviews.

• Expertise in implementing data quality checks, data contracts, and anomaly detection.

• Ability to create monitoring dashboards, alerting frameworks, and runbooks; improving MTTR and on-call response times.

• Experience with fine-grained access control mechanisms such as Unity Catalog, PII classification, DLP, and auditability.

• Capability to translate infrastructure decisions into business impacts for stakeholders in Risk, Finance, Product, and Operations.

🏝️ Benefits

• Competitive salary.

• Equity in the company.

• Benefits that extend beyond the basics to foster your growth.

• Chance to influence company technology, strategy, culture, and values.

• High-impact growth opportunity.

• Collaborate with a world-class team.

• Fast, transparent, and engaging hiring process.

• Feedback provided regardless of hiring outcome.