Master DataOps

Posted 2 days ago

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Take charge of the complete environment provisioning and platform readiness for the entire data stack, from SQL Server CDC sources to the Snowflake landing, raw, and curated layers.

• Set up and manage Snowflake DEV, QA, UAT, and Prod environments, ensuring appropriate warehouse sizing, auto-suspend features, resource monitoring, and cost attribution.

• Oversee the provisioning of Azure infrastructure, including Virtual Networks, NSGs, Private Endpoints, Azure Key Vault, self-hosted Azure DevOps agents, and VM infrastructure for the CDC replication tool.

• Administer Snowflake RBAC provisioning and conduct both positive and negative access tests.

• Manage the lifecycle of vendor and service account access, including credential storage, rotation, and documentation of revocation procedures.

• Develop and maintain CI/CD pipelines for data artifacts utilizing Azure DevOps Pipelines with YAML-based, version-controlled configurations.

• Implement promotion paths from DEV to QA to UAT to Prod, enforcing branch policies, required reviewers, build validation, and written approval gates.

• Integrate automated tests for regression, schema validation, row-count checks, data quality assertions, code scanning, dependency scanning, and Infrastructure as Code (IaC) scanning.

• Design, document, and practice rollback procedures, including mock cutover and rollback rehearsals.

• Establish end-to-end monitoring through Azure Monitor and Log Analytics, tracking replication health, CDC lag, warehouse freshness, schema drift, and semantic definition changes.

• Configure Azure Monitor alerts and escalation pathways directed to the client's ITSM tool.

• Maintain diagnostic settings, centralized Log Analytics, retention policies, access control, and audit trails for Azure resources.

• Implement Snowflake resource monitors and Azure Cost Management budget alerts; generate FinOps attribution reports.

• Take ownership of platform cost attribution, consumption monitoring, cost modeling, right-sizing reviews, and structured FinOps assessments.

• Manage Azure infrastructure as code utilizing Terraform or Bicep, alongside Snowflake objects through the Snowflake Terraform provider.

• Enforce Azure Policy guardrails and standards for production configurations.

• Maintain Architecture Decision Records (ADRs) and ongoing delivery artifacts that encompass networking, environment, CI/CD, and security designs.

• Create and validate operational runbooks for failures, recovery, deployments, rollbacks, access management, cost anomalies, and incident routing.

• Promote progressive knowledge transfer through paired working sessions, shadowed deployments, and runbook exercises.

• Act as the designated point of contact across delivery and client DataOps, Cloud Architecture, Infrastructure/Network, and Information Security teams.

• Monitor infrastructure dependencies, need-by dates, and schedule impacts, proactively escalating readiness risks.


⛳️ Requirements

• Strong hands-on experience in DataOps or platform engineering roles that support a production cloud data platform end-to-end.

• Proficient in CI/CD practices for data pipelines using Azure DevOps Pipelines (YAML), Git-based workflows, branch policies, approval gates, automated testing, regression checks, and multi-environment promotion pathways.

• Familiarity with Azure infrastructure components: Virtual Networks, NSGs, Private Link and Private Endpoints, Azure Key Vault, Microsoft Entra ID, Azure Monitor, Log Analytics, and Azure Cost Management.

• Practical experience with Terraform, including remote state management on Azure Blob Storage, the Snowflake Terraform provider, and IaC security scanning integrated into CI pipelines.

• Experience with the Snowflake platform, including RBAC design, warehouse sizing and segregation, resource monitors, row-access policies, and dynamic data masking.

• Background in monitoring and alerting for a CDC-based replication pipeline in production, encompassing lag monitoring, restart and recovery procedures, and schema-drift detection.

• Experience managing pipeline credentials through Azure Key Vault, ensuring no plaintext credentials are stored in repositories or pipeline definitions, along with documented rotation processes.

• Experience integrating code scanning, dependency scanning, and IaC scanning into CI pipelines.

• Knowledge of least-privilege access design and audit logging requirements in regulated or sensitive-data environments.

• Experience overseeing FinOps attribution, budget alerts, and right-sizing reviews.

• Proficiency in English (B2+).

• Familiarity with Qlik Replicate (preferred).

• Knowledge of Azure SQL Server / SQL Server on Azure VM (preferred).

• Operational experience with Microsoft Fabric / OneLake (preferred).

• Experience with Azure ExpressRoute and hybrid networking (preferred).

• Familiarity with Microsoft Entra ID Privileged Identity Management (preferred).

• Knowledge of Microsoft Dynamics 365 Business Central / SQL Server source systems (preferred).

• Experience with Power BI semantic model operations (preferred).

• Background in producing production runbooks and facilitating knowledge transfer (preferred).

• Experience in mortgage, lending, or financial services environments (preferred).

• Familiarity with dbt or dbt-style versioned SQL transformation frameworks (preferred).


🏝️ Benefits

• Premium Healthcare

• Meal voucher

• Maternity and Parental leaves

• Mobile services subsidy

• Sick pay and Life insurance

• CI&T University

• Colombian Holidays

• Paid Vacations

• And many others

• Diverse, inclusive, and safe work environment

People also viewed

Highmark Health2 days ago

Data Engineer

US flagUnited States OnlyFull-timeData Engineer$86.4k – $138.6k/year
ApplyView job
Prompt Therapy Solutions Inc2 days ago

Clinical Technical Support, Data Migration Specialist – B2B SaaS

US flagUnited States OnlyFull-timeData Engineer$65k – $75k/year
ApplyView job
Jones Lang LaSalle Americas, Inc.2 days ago

Principal Data Engineer

US flagIllinois OnlyFull-timeData Engineer$196k – $235k/year
ApplyView job
Allshore Talent2 days ago

Data Architect – Adobe Analytics, Customer Journey Analytics

EuropeFreelanceData Engineer
ApplyView job
Airbnb2 days ago

Senior Data Engineer, Tech Foundations

US flagUnited States OnlyFull-timeData Engineer$196k – $230k/year
ApplyView job
Alight Solutions2 days ago

Senior Director, Data Engineering & Analytics

US flagUnited States OnlyFull-timeData Engineer$170k – $250k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers