Intermediate Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Develop, enhance, and support ELT pipelines originating from enterprise applications, internal systems, and GitLab's SaaS platform.

• Integrate data using APIs and event sources such as Snowplow.

• Oversee and sustain both SaaS and self-managed data platform infrastructure, including Snowflake, Fivetran, Monte Carlo, Airflow, and Kubernetes.

• Compose maintainable, well-tested, efficient Python and SQL code, and evaluate merge requests.

• Diagnose and resolve failed pipelines, infrastructure challenges, and requests from team members.

• Utilize monitoring, SLAs, data contracts, query and warehouse optimization, and data quality assessments to ensure reliability and cost-effectiveness.

• Collaborate with Analytics Engineers, Data Analysts, Data Scientists, Data Governance personnel, and business stakeholders.

• Employ AI coding agents for development, debugging, testing, and documentation purposes.

• Implement RBAC and masking policies for secure access to governed AI data.

• Manage SOX-controlled data, MNPI, and personal data with care.

• Independently deliver medium-sized features through iterative merge requests.

• Document architecture and runbooks within the handbook.

• Report to the Director of Data Platform.

⛳️ Requirements

• Proven experience in deploying production data pipelines using Python.

• Strong, practical SQL skills and familiarity with a cloud data warehouse, preferably Snowflake.

• Hands-on experience with large-scale ELT or ETL pipelines, including incremental loads, schema migrations, backfills, and API ingestion.

• Experience with orchestration tools like Airflow.

• Knowledge of dbt.

• Solid understanding of data modeling principles, including Kimball dimensional modeling.

• Experience in managing and troubleshooting data infrastructure.

• Proficiency in utilizing Git-based workflows, CI/CD practices, and code review processes.

• Practical experience with AI coding tools in daily operations.

• Strong written communication skills.

• Ability to use GitLab effectively.

• Comfort with asynchronous work in a fully remote environment.

• Preferred but not mandatory: experience with Snowflake; Docker, Kubernetes, GCP, or Terraform; APIs of SaaS applications such as Salesforce, Zuora, or Zendesk; data observability tools; or Snowflake administration.

🏝️ Benefits

• Comprehensive benefits to support your health, financial stability, and overall well-being.

• Flexible Paid Time Off for work-life balance.

• Team Member Resource Groups to foster community and support.

• Equity Compensation and an Employee Stock Purchase Plan.

• Growth and Development Fund for personal and professional advancement.

• Parental Leave to support family needs.