Managing Engineer, Data Engineering

This is a fully remote position, open to applicants in United States.

📋 Description

• Guide, mentor, and coach Data Engineers while fostering their technical and professional growth.

• Set engineering standards and advocate for best practices, collaboration, accountability, knowledge sharing, and ongoing improvement.

• Spearhead the design, development, implementation, and support of scalable batch and streaming data solutions.

• Create reusable patterns for data ingestion, transformation, storage, and access.

• Integrate data from APIs, databases, event streams, third-party platforms, and enterprise systems.

• Engage in architecture discussions, solution design, code reviews, troubleshooting, and complex problem resolution.

• Advocate for version control, automated testing, continuous integration, automated deployment, and infrastructure automation.

• Set benchmarks for data quality, validation, monitoring, lineage, and observability.

• Enhance data pipelines, databases, queries, and storage solutions for optimal performance and cost efficiency.

• Support production operations and lead critical incident responses, root-cause analysis, and preventative enhancements.

• Collaborate with Product Managers, Architects, Engineers, Analysts, and business stakeholders to deliver data solutions.

• Translate business and product requirements into technical roadmaps and specified engineering tasks.

• Lead or contribute to planning, prioritization, estimation, and delivery efforts.

• Manage risks, dependencies, resource requirements, and competing priorities effectively.

• Communicate progress, technical recommendations, risks, and dependencies to stakeholders and leadership.

• Promote data governance, metadata management, data lineage, classification, and data quality practices.

• Ensure adherence to security, privacy, governance, and regulatory standards.

• Assist in cloud modernization, data platform transformation, innovation, automation, and the responsible use of generative and agent-based AI tools.

• Depending on the position level, assist or lead recruitment, onboarding, performance feedback, career development, and workforce planning.

• This position includes supervisory responsibilities.

⛳️ Requirements

• Minimum of 5 years of experience in designing, developing, and supporting data solutions, data pipelines, or enterprise software systems (5+ years opportunity).

• At least 1 year of experience in providing technical leadership, mentorship, coaching, or project leadership (5+ years opportunity).

• A minimum of 7 years of experience in designing, developing, and supporting data solutions, data pipelines, or enterprise software systems (7+ years opportunity).

• At least 3 years of experience in leading, mentoring, or managing technical professionals (7+ years opportunity).

• Proven experience in guiding engineers through technical mentorship and knowledge sharing.

• Experience with coaching, performance management, career development, recruitment, and team development.

• Strong hands-on experience in developing data pipelines using Python, Java, Scala, or a similar programming language.

• Experience in designing and supporting batch or streaming data solutions.

• Familiarity with Apache Spark, Apache Kafka, Apache Flink, dbt, or similar technologies.

• Strong understanding of SQL, NoSQL databases, data modeling, and data storage or architecture concepts.

• Experience in integrating data from APIs, databases, event streams, third-party platforms, and enterprise systems.

• Knowledge of automated testing, continuous integration and delivery, deployment automation, observability, and DevOps practices.

• Experience with Docker and Kubernetes.

• Excellent communication, collaboration, decision-making, and stakeholder management abilities.

• Capable of influencing technical outcomes while balancing hands-on engineering, people leadership, and delivery accountability.

• Background investigation required.

• Reliable internet with minimum speeds of 50 MB download and 5 MB upload.

• A dedicated, private home workspace with suitable desk and seating.

• Allstate typically does not sponsor individuals for employment-based visas for this role.

🏝️ Benefits

• Comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse.

• Monthly connectivity reimbursement for employees eligible for remote work.

• Flexible remote work arrangement.