Senior Data & Platform Engineer – Veterinary Technology

This is a fully remote position, open to applicants in Dominican Republic.

📋 Description

• Assume complete responsibility for the reliability of the data platform, which includes managing pipelines, warehousing, transformations, and observability.

• Design, develop, and sustain resilient data pipelines utilizing Apache Airflow, orchestrating intricate workflows for both batch and near-real-time operations.

• Oversee and enhance the primary Snowflake data warehouse, focusing on schema design, clustering keys, materialized views, access controls, and strict cost management.

• Create and manage the dbt transformation layer, covering model design, incremental strategies, dependency management, and comprehensive documentation.

• Deploy and administer data platform services on Kubernetes (EKS), managing workloads, troubleshooting pod issues, and optimizing resource requests independently.

• Provision and oversee data platform infrastructure, including Snowflake resources and Airflow, using Terraform for efficiency.

• Write high-quality SQL and Python for ETL tools, pipeline logic, and data product delivery.

• Manage PostgreSQL as the authoritative operational database, emphasizing query optimization, indexing, replication, and migrations.

• Lead the shift toward change data capture (CDC) for data ingestion, employing tools like Debezium to stream changes from databases.

• Implement thorough observability, SLA tracking, and alerting across the data platform using Datadog.

• Maintain CI/CD pipelines for DAG deployments, dbt operations, schema migrations, and container image builds.

• Collaborate with analytics, product, and full-stack development teams to develop clean and well-documented data products.

• Navigate AWS environments (including RDS and S3) to manage data-related services, review logs, and modify scaling parameters.

⛳️ Requirements

• Over 5 years of experience in data engineering or a combined data and infrastructure role, demonstrating a successful track record in building production-grade data platforms from scratch.

• Profound expertise in Snowflake, including schema design, performance optimization, access control, and advanced cost management.

• Strong practical experience with dbt (modeling approaches, incremental strategies, testing) and Airflow (writing DAGs, managing dependencies, debugging).

• Advanced skills in SQL and solid programming abilities in Python for ETL processes and automation.

• Familiarity with Kubernetes, with the capability to deploy workloads, read pod logs, and manage Helm charts autonomously.

• Extensive experience using Terraform for infrastructure provisioning, particularly for managing components of the data platform.

• Practical experience with Datadog for observability, monitoring, and SLA visibility.

• Knowledge of AWS data-related services such as RDS and S3.

• Proficiency in using AI-based development tools to write, review, and debug code efficiently.

• Previous experience with Amazon Redshift is an advantage.

• Familiarity with streaming infrastructure (Kafka, Flink) or open table formats (Iceberg, Delta Lake) is highly preferred.

• Experience with Elixir or Erlang is beneficial.

• Understanding of data quality, cataloging, or lineage tools (e.g., Great Expectations, Soda, Monte Carlo, DataHub, OpenMetadata) is a significant plus.

• Hands-on experience with Debezium or similar CDC tools, especially in production environments, is a strong bonus.

• Experience managing EKS Spot instances at scale is a plus.

• A background in healthcare, veterinary medicine, or similarly regulated fields that demand strict data accuracy and auditability is preferred.

🏝️ Benefits

• 100% Remote Work: Enjoy the flexibility to work from a location that suits you best. All you need is a laptop and a reliable internet connection.

• Highly Competitive USD Pay: Receive a top-tier, market-leading salary in USD that exceeds standard market offerings.

• Paid Time Off: We prioritize your well-being. Our paid time off policies ensure you have opportunities to relax and recharge when necessary.

• Work with Autonomy: Enjoy the freedom to manage your own schedule as long as your work is completed. Focus on results rather than clock-watching.

• Work with Top American Companies: Enhance your skills while working on innovative, high-impact projects with leading U.S. companies.