Software Development Engineer II – Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Transition analytics from the production PostgreSQL database.

• Develop extraction pipelines to transfer data from the production PostgreSQL to the analytical warehouse using incremental loads.

• Create and sustain layered dbt models, which include dimensions, reusable metric building blocks, and serving tables.

• Establish shared metrics within the semantic layer.

• Implement tests, freshness checks, and alerts for the pipelines.

• Execute safe backfills when data corrections are necessary.

• Apply access-control and tenant-separation strategies to models and pipelines.

• Preserve lineage from metrics to source records and drone images.

• Collaborate with the integration team to verify incoming WMS data against agreed-upon contracts.

• Document models and register them in the data catalog.

• Deliver results through CI/CD and leverage AI-assisted development.

• Participate in on-call support for owned pipelines.

• Begin with the Drone product and assist in onboarding MHE Vision and 3D case counting products.

• Work together with Full Stack, ML, Product, Security, Customer Success, senior engineers, and the integration team.

⛳️ Requirements

• 2–5 years of experience in building and managing production data pipelines.

• A degree in Computer Science or equivalent practical experience.

• Proficient in SQL, including joins, window functions, and CTEs.

• A solid understanding of dimensional modeling (facts, dimensions, grain).

• PostgreSQL experience is preferred.

• Practical experience in building tested models using dbt, Snowflake Dynamic Tables, Databricks Lakeflow Declarative Pipelines, or similar tools.

• Experience with production Python pipeline code that includes tests and code reviews.

• Familiarity with running pipelines in Airflow, Dagster, Databricks Lakeflow Jobs, Snowflake Tasks, or similar, including managing failures, re-runs, and backfills.

• Experience in loading data from an operational database into a warehouse or lakehouse such as Snowflake or Databricks.

• Production experience on Azure or another major cloud platform.

• Knowledge of object storage, Git, CI/CD, and Docker/Kubernetes.

• Writes tests alongside code and emphasizes data accuracy.

• Hands-on and inquisitive; investigates issues beyond personal code, shares ideas, and welcomes feedback on reviews.

• Excellent written and verbal English communication skills.

• Ability to craft effective pull requests and documentation, and to identify blockers early within a distributed team.

🏝️ Benefits

• Fully remote role.

• Emphasis on clear written communication, initiative, and the capability to make independent progress in a distributed team.