Lead Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead and mentor a team of data engineers, offering guidance, support, and technical expertise.

• Oversee backlog grooming, sprint planning, and prioritization for data engineering projects.

• Partner with business and technical leaders to establish and implement strategic and tactical initiatives.

• Keep abreast of emerging trends and technologies within the realm of data engineering.

• Assess and evaluate new platforms and tools to enhance the technology stack and improve data infrastructure and processes.

• Design, develop, and maintain robust data pipelines sourced from various TMS and other data sources.

• Create and implement new data structures or modify existing ones to accommodate evolving business needs.

• Ensure data accuracy, reliability, and completeness through validation and monitoring processes.

• Develop and maintain the Data Vault, Data Warehouse, and Data Marts to provide essential metrics.

• Collaborate with internal stakeholders, executives, clients, engineers, and external vendors.

• Enhance and secure code deployments, data validation, error handling, alerting, data democratization, and modernization of technical debt.

⛳️ Requirements

• Bachelor’s Degree required (or equivalent experience), ideally in Business Administration, Mathematics, Computer Science, or a related field.

• Over 8 years of technology experience.

• Proficient in Amazon Relational Database Service (Aurora, MySQL), Microsoft SQL Server, or Snowflake.

• Exceptional skills in SQL development and performance tuning.

• Strong experience with Python, including libraries such as Pandas, Streamlit, and NumPy.

• Familiarity with JSON and CSV data formats.

• Experience with Requests library.

• Proficiency in cloud platforms like AWS, Azure, or Google Cloud.

• A creative thinker who is intellectually curious, passionate about solving problems, and committed to continuous learning.

• Experience with TMS, WMS, or other enterprise logistics platforms is highly advantageous.

• Familiarity with Data Vault 2.0 is a significant plus.

• Experience with Fivetran is a strong advantage.

• Knowledge of Azure Data Factory is a strong plus.

• Familiarity with REST API is a strong plus.

• Experience with Coalesce.io is a strong plus.

• Knowledge of YAML is a strong plus.

• Experience with Git, DevOps, and CI/CD practices is a strong plus.

• A self-starter with an entrepreneurial mindset, highly adaptable, and capable of taking initiative in a fast-paced environment.

• Excellent communication and leadership skills.

🏝️ Benefits

• Access to experts and resources for your Learning & Development journey.

• Opportunities for internal mobility.

• Employee referral bonus program.

• Employee Resource Groups (ERGs).

• Annual fundraising and volunteer events to contribute to communities.

• Paid time off, floating holidays, volunteer time off, and rollover benefits.

• Paid parental leave.

• Medical, dental, vision, and 401k plans (with matching contributions).

• Flexible spending accounts, mass transit, and dependent care plans available.

• Health savings account with an annual company contribution for plan participants.

• Short-term and long-term disability coverage.

• Life insurance policies subsidized by the company.

• Pet insurance options.

• Accident care benefits.

• Access to legal advice.

• Annual incentives based on individual and company performance.