Lead Data Platform Engineer – Manager, Architect

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Establish the technical vision for a small team of platform engineers.

• Convert requirements and architectural guidance into precisely defined, sequential tasks.

• Guide engineers through collaborative pairing, code reviews, and feedback on design.

• Oversee the delivery process among contributors while identifying risks and dependencies.

• Engage directly in complex integration and platform-related tasks.

• Review analytics applications, technology selections, data flows, and integration points.

• Design and develop APIs, event streams, and shared data contracts.

• Create and sustain shared platform services for authentication, observability, configuration management, and logging.

• Comprehend existing data pipelines, sources, transformation logic, and their interdependencies.

• Collaborate with domain teams as an integration architect and partner.

• Deploy and manage platform services within cloud infrastructure.

• Contribute to infrastructure-as-code methodologies utilizing Terraform or CDK.

• Work alongside IT platform teams to enhance deployment pipelines and reliability standards.

• Develop business cases for adopting cloud features based on business value, risk mitigation, and compliance factors.

⛳️ Requirements

• Over 7 years of experience in software engineering.

• Minimum of 3 years concentrating on data engineering, integration, platform, or infrastructure roles.

• At least 2 years in a technical leadership position.

• Expertise in Python programming.

• Solid SQL capabilities, including experience with large or intricate datasets.

• Practical experience with AWS, covering compute, storage, and at least one managed data service.

• Familiarity with AI-assisted development tools or coding agents in a professional environment.

• Quick adaptability to unfamiliar systems.

• Excellent written communication skills.

• Preferred: experience with dbt and Snowflake.

• Preferred: experience with Apache Iceberg.

• Preferred: additional programming language skills, particularly in Spark or Java.

• Preferred: experience leading or coordinating engineering efforts across distributed or multi-location teams.

• Preferred: experience with ETL/ELT data pipelines, schema management, or data quality monitoring.

• Preferred: exposure to both structured and semi-structured data at scale.

• Preferred: familiarity with Airflow, MLflow, or equivalent SaaS solutions.

🏝️ Benefits

• Annual incentive compensation program.

• Medical coverage.

• Dental coverage.

• Vision coverage.

• Wellness programs.