Senior Data Integration Engineer

This is a fully remote position, open to applicants in Minnesota.

📋 Description

• Spearhead the design, development, and execution of scalable data solutions, encompassing a Customer Data Platform (CDP) and related API frameworks.

• Create and sustain scalable data pipelines and workflows utilizing Python and contemporary data tools.

• Construct and uphold production-grade data integrations across both internal and third-party systems.

• Write, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes and automation.

• Design and establish a scalable CDP to centralize and unify customer data from CRM, ERP, web, mobile, and other sources.

• Develop and manage APIs and data pipelines that facilitate real-time and batch integration between the CDP and internal/external systems.

• Enhance data environments, focusing on data modeling, security practices, and Lakehouse performance.

• Monitor and refine data flows and API performance to ensure high availability and low latency.

• Identify and resolve data-related issues to maintain system reliability and efficiency.

• Collaborate with marketing, product, engineering, and business stakeholders to establish data requirements and integration strategies.

• Convert technical concepts into actionable insights.

• Implement data governance and privacy practices to comply with GDPR, CCPA, and other regulatory requirements.

• Ensure data quality, governance, and adherence to internal policies and external regulations.

• Utilize Git version control and CI/CD pipelines for deploying and managing data workflows.

• Assess and recommend tools, platforms, and technologies that support the CDP and integration framework.

• Document architecture, data flows, and integration patterns.

• Perform additional duties as required or requested.

⛳️ Requirements

• Bachelor’s or Master’s degree in computer science, engineering, or a related field.

• Over 10 years of experience with RESTful APIs.

• More than 10 years of experience with SQL, Python, or PowerShell.

• At least 5 years of experience with cloud platforms such as Azure, AWS, GCP, etc.

• Minimum of 5 years of experience with cloud-native tools like ADF, Glue, Cloud Data Fusion, dbt, or Airflow.

• Proven experience in building or integrating with Customer Data Platforms such as Segment, Salesforce CDP, Adobe Experience Platform, or custom-built solutions.

• Experience with data integration tools such as Apache NiFi, Talend, or Informatica.

• Preferred experience with identity resolution, customer segmentation, and real-time personalization use cases.

• Strong expertise in ETL/ELT pipelines and data modeling.

• Familiarity with event-driven architectures, message queues like Kafka, and microservices.

• Comprehensive understanding of data privacy and security best practices.

• Familiar with CI/CD pipelines and Infrastructure as Code (IaC) tools, including Bicep, Terraform, Pulumi, or CloudFormation.

• Preferred knowledge of data warehousing and analytics platforms such as Snowflake, BigQuery, or Databricks.

🏝️ Benefits

• Potential for an annual discretionary bonus.

• Medical benefits.

• Health Savings Account (HSA).

• Dental insurance.

• Vision insurance.

• Life insurance.

• Paid Vacation (PTO).

• 401(k) with employer match.

• Flexible Spending Account (FSA).

• Employee Assistance Program (EAP).