Lead Data Engineer

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Lead and guide a team of data engineers, offering support, mentorship, and technical knowledge.

• Work in conjunction with business and technical leaders to establish and implement both strategic and tactical plans.

• Keep abreast of new trends and advancements in the field of data engineering.

• Assess and identify new platforms and tools to enhance the technology stack and improve data infrastructure and processes.

• Design, develop, and maintain efficient data pipelines originating from various TMS and other data sources.

• Create and implement new data structures or modify existing ones to accommodate changing business needs.

• Ensure the accuracy, dependability, and completeness of data through effective validation and monitoring practices.

• Develop and sustain our Data Vault, Data Warehouse, and Data Marts to provide key metrics to operational and business stakeholders.

• Collaborate with a diverse range of users, including internal stakeholders, executives, clients, engineers, and external vendors.

• Enhance and solidify processes such as code deployments, data validation, error handling/alerting, data democratization, and modernization of technical debt.

⛳️ Requirements

• Bachelor's Degree required (or equivalent experience); preferred fields include Business Administration, Mathematics, Computer Science, or related disciplines.

• A creative thinker with a curious intellect, passionate about solving problems and committed to continuous learning.

• Over 8 years of technology experience with one or more of the following: Amazon Relational Database Service (Aurora, MySQL), Microsoft SQL Server, Snowflake.

• Outstanding SQL development and performance tuning capabilities.

• Strong proficiency in Python, including libraries, applications, and concepts such as Pandas, Streamlit, and NumPy.

• Familiarity with JSON and CSV Requests.

• Experience with the following is a significant advantage: TMS, WMS, or other enterprise logistics platforms, Data Vault 2.0, Fivetran, Azure Data Factory, REST API.

• Proficient in cloud platforms like AWS, Azure, or Google Cloud.

• Knowledge of Coalesce.io and YAML.

• Experience with git, DevOps, and CI/CD is a significant advantage.

• A self-starter, entrepreneurial, and highly adaptable individual who can take initiative in a fast-paced environment.

• Excellent communication and leadership abilities.

🏝️ Benefits

• Access to experts and resources for your Learning & Development journey.

• Opportunity for internal mobility.

• Employee referral bonus program.

• Employee Resource Groups (ERGs).

• Annual fundraising and volunteer events to give back to communities.

• Paid time off, floating holidays, time off to volunteer, and rollover options.

• Paid parental leave.

• Medical, dental, vision, and 401k plans (with match).

• Flexible spending account, mass transit, and dependent care plans available.

• Health savings account with an annual company contribution for plan participants.

• Short-term and long-term disability; life insurance policies subsidized by the company.

• Additional benefits including pet insurance, accident care, access to legal advice, and more.