Senior Data & Platform Engineer – Veterinary Technology

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Assume full ownership of the reliability of the data platform, which includes pipelines, warehousing, transformations, and observability.

• Design, construct, and uphold resilient data pipelines using Apache Airflow, orchestrating intricate workflows that span batch and near-real-time processes.

• Oversee and enhance the main Snowflake data warehouse, focusing on schema design, clustering keys, materialized views, access permissions, and stringent cost management.

• Develop and sustain the dbt transformation layer, which encompasses model design, incremental strategies, dependency oversight, and thorough documentation.

• Deploy and manage data platform services on Kubernetes (EKS), autonomously handling workloads, troubleshooting pod issues, and optimizing resource requests.

• Provision and oversee data platform infrastructure, including Snowflake resources and Airflow, utilizing Terraform for management.

• Write high-quality SQL and Python for ETL tooling, pipeline logic, and the delivery of data products.

• Manage PostgreSQL as the source-of-truth operational database, concentrating on query optimization, indexing, replication, and migrations.

• Lead the transition to change data capture (CDC) for data ingestion, leveraging tools such as Debezium to stream database modifications.

• Implement extensive observability, SLA tracking, and alerting throughout the data platform using Datadog.

• Maintain CI/CD pipelines for DAG deployments, dbt executions, schema migrations, and container image builds.

• Collaborate with analytics, product, and full-stack development teams to create clean, well-documented data products.

• Navigate AWS environments, including RDS and S3, to manage data-adjacent services, review logs, and adjust scaling parameters.

⛳️ Requirements

• 5+ years of experience in data engineering or a combined data and infrastructure role, demonstrating a solid history of building production-grade data platforms from scratch.

• In-depth expertise in Snowflake, covering schema design, performance optimization, access management, and advanced cost efficiency.

• Strong, practical experience with dbt (modeling patterns, incremental strategies, testing) and Airflow (writing DAGs, managing dependencies, debugging).

• Advanced SQL proficiency along with solid programming capabilities in Python for ETL processes and automation.

• Practical knowledge of Kubernetes, with the ability to deploy workloads, analyze pod logs, and independently manage Helm charts.

• Extensive experience utilizing Terraform for provisioning infrastructure, specifically for managing data platform components.

• Hands-on experience with Datadog for monitoring, observability, and SLA visibility.

• Familiarity with AWS data-adjacent services such as RDS and S3.

• Proficiency in using AI-based development assistants to efficiently write, review, and debug code.

• Previous experience with Amazon Redshift is advantageous.

• Familiarity with streaming infrastructure (Kafka, Flink) or open table formats (Iceberg, Delta Lake) is highly preferred.

• Experience with Elixir or Erlang is a plus.

• Knowledge of data quality, cataloging, or lineage tools (e.g., Great Expectations, Soda, Monte Carlo, DataHub, OpenMetadata) is a significant advantage.

• Hands-on experience with Debezium or similar CDC tools, especially in production environments, is a strong asset.

• Experience managing EKS Spot instances at scale is beneficial.

• A background in healthcare, veterinary medicine, or similarly regulated fields that demand strict data accuracy and auditability is preferred.

🏝️ Benefits

• 100% Remote Work: Enjoy the flexibility to work from wherever you thrive, requiring just a laptop and a dependable internet connection.

• Highly Competitive USD Pay: Receive an outstanding, market-leading compensation in USD that exceeds typical market standards.

• Paid Time Off: We prioritize your well-being. Our paid time off policies ensure you can relax and recharge when necessary.

• Work with Autonomy: Experience the freedom to manage your schedule as long as the work is completed. Focus on outcomes, not the clock.

• Work with Top American Companies: Enhance your expertise by working on innovative, impactful projects with industry-leading U.S. companies.