Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of the technical design, implementation, rollout, and operational support for significant greenfield data-platform components utilizing Python, Kubernetes, and AWS.

• Spearhead complex platform initiatives from initial discovery and architecture to incremental delivery and production integration.

• Convert vague business and technical goals into concrete designs, implementation strategies, and production-ready systems.

• Create, develop, and sustain scalable, fault-tolerant ETL/ELT pipelines that handle both structured and unstructured data.

• Develop reusable platform functionalities for configuration, execution, logging, metrics, error management, testing, deployment, and operational support.

• Engineer workflows that ensure idempotency, replayability, backfills, schema evolution, partial-failure recovery, and safe deployment in production.

• Review legacy data processes and guide gradual modernization efforts while maintaining production continuity and minimizing operational risk.

• Establish engineering patterns and standards, conduct technical design reviews, and challenge unnecessary complexities.

• Troubleshoot production, performance, and data quality issues, implementing sustainable corrective measures.

• Enhance platform scalability, reliability, observability, maintainability, security, and cost-effectiveness.

• Collaborate with application engineering, data science, QA, product, analytics, and client-facing teams.

• Assess and integrate AI-assisted or agentic workflows.

• Offer technical mentorship through architectural guidance, code reviews, reusable patterns, documentation, and engineering feedback.

• Act as the primary technical subject matter expert in internal, cross-functional, and client-facing discussions.

⛳️ Requirements

• A Bachelor’s degree in a STEM discipline or equivalent professional experience.

• Over 8 years of professional experience in building and operating production data systems.

• Demonstrated independent ownership of major data systems, platform components, architectural decisions, or complex modernization projects.

• Advanced proficiency in Python software engineering, including modular architecture, type annotations, automated testing, packaging, dependency management, API design, and reusable library or framework development.

• Strong SQL and data modeling capabilities across both operational and analytical workloads.

• Experience in architecting fault-tolerant ETL/ELT systems that support replay, backfills, schema evolution, and failure recovery.

• Extensive experience designing and managing cloud-based production architectures, preferably with AWS.

• Hands-on experience with Docker, Kubernetes, and Airflow or similar orchestration frameworks.

• Practical knowledge of CI/CD, infrastructure as code, automated testing, and production observability.

• Proven ownership of a legacy modernization or platform migration project, including dependency analysis, migration sequencing, validation, cutover, and operational transition.

• Significant experience in diagnosing production incidents, complex data failures, and performance bottlenecks.

• Ability to assess and convey architectural trade-offs related to scalability, reliability, maintainability, security, cost, delivery speed, and team capabilities.

• Capable of transforming incomplete or ambiguous requirements into technical guidance and actionable delivery plans.

• Technical influence through design reviews, engineering standards, mentorship, or collaborative platform development.

• Candidates must reside in the U.S. and be willing to work in the Central Time Zone.

• Must have authorization to work in the U.S.; employment visa sponsorship is not available.

🏝️ Benefits

• Unlimited Paid Time Off.

• Fully remote work environment.

• Summer Half-Day Fridays.

• Freed Up Fridays during Spring, Fall, and Winter months.

• Medical, dental, and vision plan offerings.

• 401(k).

• Employer-paid Short-Term Disability.

• Employer-paid Long-Term Disability.

• Employer-paid Life Insurance.

• Additional Life Insurance.

• Spouse Life Insurance.

• Accident Insurance.

• Diverse and inclusive environment.

• Opportunities for professional growth.

• An empowered culture that encourages creativity and professional development.

• The satisfaction of contributing to solutions that make a real-world impact.