Director of Data Engineering

This is a fully remote position, open to applicants in Kansas.

📋 Description

• Establish and uphold the architecture for the organization’s data lake and data warehouse.

• Lead the technical direction and standards for data ingestion, transformation, and storage processes.

• Guarantee data quality, reliability, security, and governance throughout the data platform.

• Supervise, mentor, and nurture a team of data analysts and data engineers.

• Define technical expectations, development standards, and operational practices.

• Evaluate designs, implementations, and analytics deliverables.

• Collaborate with an external partner to design and implement the foundational data infrastructure.

• Manage knowledge transfer and transition to internal ownership.

• Work in conjunction with application engineering, DevOps, and business teams to align data solutions with the needs of the organization.

• Design and oversee data pipelines that collect data from various internal and external sources in different formats.

• Integrate and utilize data from external platforms, including those based on Databricks.

• Facilitate analytics and reporting use cases through curated datasets and data models.

• Empower self-service analytics and reporting via Amazon QuickSight.

• Construct and manage data infrastructure on AWS, utilizing S3, Glue, Athena, and Redshift or PostgreSQL.

• Implement and sustain infrastructure as code with AWS CloudFormation.

• Ensure that deployments, monitoring, and operational processes are automated and repeatable.

• Assist AI and machine learning initiatives through data preparation and feature engineering.

• Assess future technologies and platforms, including Databricks, as potential elements of the data ecosystem.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.

• Over 8 years of relevant professional experience.

• At least 3 years of experience in people leadership roles.

• Robust experience in data engineering and the architecture of data warehousing.

• Background in ingesting, transforming, and modeling data from a variety of data sources and formats.

• Practical experience with AWS data services such as S3, Glue, and Athena.

• Familiarity with data warehousing solutions like Amazon Redshift and/or PostgreSQL.

• Experience with infrastructure as code using AWS CloudFormation.

• Strong proficiency in SQL.

• Demonstrated experience in leading technical teams.

• History of integrating with external data platforms or vendor-managed data systems (e.g., Databricks).

• Proficient in Python for data processing, automation, or analytics tasks.

• Understanding of .NET-based application environments.

• Knowledge of AI/ML concepts and workflows for model development.

• Experience with CI/CD pipelines and best practices for cloud security.

🏝️ Benefits

• Comprehensive benefits package that includes health, dental, and vision insurance.

• Options for a 401(k) plan.

• Paid time off, sick leave, and paid holidays.

• A fully remote work setup that offers flexibility and autonomy.

• The chance to advance with a dynamic, innovative team in a startup-like atmosphere.