
Master DataOps
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Colombia.
• Take charge of the complete environment provisioning and platform readiness for the entire data stack, from SQL Server CDC sources to the Snowflake landing, raw, and curated layers.
• Set up and manage Snowflake DEV, QA, UAT, and Prod environments, ensuring appropriate warehouse sizing, auto-suspend features, resource monitoring, and cost attribution.
• Oversee the provisioning of Azure infrastructure, including Virtual Networks, NSGs, Private Endpoints, Azure Key Vault, self-hosted Azure DevOps agents, and VM infrastructure for the CDC replication tool.
• Administer Snowflake RBAC provisioning and conduct both positive and negative access tests.
• Manage the lifecycle of vendor and service account access, including credential storage, rotation, and documentation of revocation procedures.
• Develop and maintain CI/CD pipelines for data artifacts utilizing Azure DevOps Pipelines with YAML-based, version-controlled configurations.
• Implement promotion paths from DEV to QA to UAT to Prod, enforcing branch policies, required reviewers, build validation, and written approval gates.
• Integrate automated tests for regression, schema validation, row-count checks, data quality assertions, code scanning, dependency scanning, and Infrastructure as Code (IaC) scanning.
• Design, document, and practice rollback procedures, including mock cutover and rollback rehearsals.
• Establish end-to-end monitoring through Azure Monitor and Log Analytics, tracking replication health, CDC lag, warehouse freshness, schema drift, and semantic definition changes.
• Configure Azure Monitor alerts and escalation pathways directed to the client's ITSM tool.
• Maintain diagnostic settings, centralized Log Analytics, retention policies, access control, and audit trails for Azure resources.
• Implement Snowflake resource monitors and Azure Cost Management budget alerts; generate FinOps attribution reports.
• Take ownership of platform cost attribution, consumption monitoring, cost modeling, right-sizing reviews, and structured FinOps assessments.
• Manage Azure infrastructure as code utilizing Terraform or Bicep, alongside Snowflake objects through the Snowflake Terraform provider.
• Enforce Azure Policy guardrails and standards for production configurations.
• Maintain Architecture Decision Records (ADRs) and ongoing delivery artifacts that encompass networking, environment, CI/CD, and security designs.
• Create and validate operational runbooks for failures, recovery, deployments, rollbacks, access management, cost anomalies, and incident routing.
• Promote progressive knowledge transfer through paired working sessions, shadowed deployments, and runbook exercises.
• Act as the designated point of contact across delivery and client DataOps, Cloud Architecture, Infrastructure/Network, and Information Security teams.
• Monitor infrastructure dependencies, need-by dates, and schedule impacts, proactively escalating readiness risks.
• Strong hands-on experience in DataOps or platform engineering roles that support a production cloud data platform end-to-end.
• Proficient in CI/CD practices for data pipelines using Azure DevOps Pipelines (YAML), Git-based workflows, branch policies, approval gates, automated testing, regression checks, and multi-environment promotion pathways.
• Familiarity with Azure infrastructure components: Virtual Networks, NSGs, Private Link and Private Endpoints, Azure Key Vault, Microsoft Entra ID, Azure Monitor, Log Analytics, and Azure Cost Management.
• Practical experience with Terraform, including remote state management on Azure Blob Storage, the Snowflake Terraform provider, and IaC security scanning integrated into CI pipelines.
• Experience with the Snowflake platform, including RBAC design, warehouse sizing and segregation, resource monitors, row-access policies, and dynamic data masking.
• Background in monitoring and alerting for a CDC-based replication pipeline in production, encompassing lag monitoring, restart and recovery procedures, and schema-drift detection.
• Experience managing pipeline credentials through Azure Key Vault, ensuring no plaintext credentials are stored in repositories or pipeline definitions, along with documented rotation processes.
• Experience integrating code scanning, dependency scanning, and IaC scanning into CI pipelines.
• Knowledge of least-privilege access design and audit logging requirements in regulated or sensitive-data environments.
• Experience overseeing FinOps attribution, budget alerts, and right-sizing reviews.
• Proficiency in English (B2+).
• Familiarity with Qlik Replicate (preferred).
• Knowledge of Azure SQL Server / SQL Server on Azure VM (preferred).
• Operational experience with Microsoft Fabric / OneLake (preferred).
• Experience with Azure ExpressRoute and hybrid networking (preferred).
• Familiarity with Microsoft Entra ID Privileged Identity Management (preferred).
• Knowledge of Microsoft Dynamics 365 Business Central / SQL Server source systems (preferred).
• Experience with Power BI semantic model operations (preferred).
• Background in producing production runbooks and facilitating knowledge transfer (preferred).
• Experience in mortgage, lending, or financial services environments (preferred).
• Familiarity with dbt or dbt-style versioned SQL transformation frameworks (preferred).
• Premium Healthcare
• Meal voucher
• Maternity and Parental leaves
• Mobile services subsidy
• Sick pay and Life insurance
• CI&T University
• Colombian Holidays
• Paid Vacations
• And many others
• Diverse, inclusive, and safe work environment
Highmark Health
Prompt Therapy Solutions Inc
Jones Lang LaSalle Americas, Inc.
Allshore Talent
Get handpicked remote jobs straight to your inbox weekly.