Senior Data Engineer

This is a fully remote position, open to applicants in Oregon, +2 more states.

📋 Description

• Design, construct, and manage batch and streaming data pipelines on contemporary cloud data platforms.

• Create resilient ETL/ELT processes utilizing SQL, Python, and PySpark, incorporating error handling, monitoring, and cost management.

• Execute layered/medallion data architectures and analytics-ready data models tailored for BI and AI applications.

• Collaborate with analysts and data scientists to provide reliable, production-quality data assets.

• Enhance and support data governance initiatives using Microsoft Purview or similar platforms.

• Contribute to governance standards for data products, analytical solutions, AI/ML functionalities, and agent-based workflows.

• Integrate governance into platform workflows and data engineering methodologies.

• Assist in developing AI-powered tools and automation for metadata enrichment, data quality assessments, anomaly detection, and governance workflows.

• Ensure AI-driven tools function solely on sanctioned, governed data sources with necessary logging and audit trails.

• Build expertise in AI governance frameworks, agent lifecycle management, and input/output traceability.

• Establish and uphold CI/CD pipelines for data and AI resources.

• Advocate for infrastructure-as-code methodologies utilizing Terraform, Bicep, or similar tools.

• Outline development, testing, and production environment promotion pathways, ensuring governance and policy compliance.

⛳️ Requirements

• Bachelor’s degree coupled with 5+ years of experience in data engineering or data platform engineering within a production setting.

• Proficiency in SQL along with practical experience in Python and PySpark.

• Familiarity with data engineering on at least one prominent cloud or data platform (Azure, AWS, Databricks, or equivalent).

• Transferable skills across various modern cloud and data platforms.

• Experience with Git-based development and CI/CD methodologies.

• Understanding of data governance principles, including cataloging, lineage, data quality, and access control.

• Proven engineering judgment with the capability to balance delivery speed, reliability, safety, and governance factors.

• Direct application submission by the candidate.

• Capacity to adhere to the company's restrictions on AI tools during interviews unless an accommodation is arranged.

🏝️ Benefits

• Equal opportunity employer.

• Reasonable accommodations for disabled veterans, individuals with disabilities, and those with sincerely held religious beliefs.

• Confidential support for accommodations during the application and employment processes.

• Benefits offerings referenced under the Transparency in (Benefits) Coverage Act.