Principal Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Responsible for the organization-wide data architecture, establishing standards, patterns, and designs for implementation by our teams. Addresses complex data challenges, irrespective of ambiguity or clarity.

• Assesses data-related designs and implementations across teams to ensure architectural consistency, performance, and scalability.

• Creates reference implementations, proofs of concept, and provides hands-on support when teams face intricate data engineering issues.

• Designs and develops data pipelines, integrations, and platform features with a focus on performance and scalability.

• Constructs and manages data APIs and ingestion systems capable of efficiently processing complex, high-volume data.

• Takes charge of the quality of data systems throughout the organization, including testing strategies and standards for data integrity.

• Directs the data architecture strategy across the platform, encompassing database design patterns, data API standards, and data flow architecture.

• Collaborates with product managers to define, scope, and plan new data features and capabilities.

• Works alongside the CTO and engineering leadership on strategic data initiatives and long-term architectural vision.

• Collaborates with teams to establish data quality standards, automated data validation strategies, and testing protocols for data pipelines.

• Partners with engineering and product teams to design and support data infrastructure for AI/ML initiatives, including model training pipelines, feature stores, and inference data flows.

• Architects the IoT data ingestion and distribution framework to accommodate data from an expanding fleet of devices, featuring replayability, aggregation, and real-time distribution patterns.

• Tests, assesses, and recommends technologies to enhance our overall data infrastructure.

• Produces high-quality documentation.

⛳️ Requirements

• Over 12 years of professional experience in data engineering or software development; self-motivated and committed to delivering impactful data products.

• More than 2 years of experience providing architectural guidance and design oversight to engineering teams, rather than just individual mentorship. Excellent communication skills are essential.

• Proven experience in establishing data architecture standards and providing technical oversight across multiple engineering teams.

• Bachelor’s degree in Computer Science, Data Engineering, or a related field; deeply familiar with the fundamentals of computer science, data architecture, and distributed systems.

• Extensive experience with SQL; familiarity with NoSQL is an advantage.

• Proficient in Python for data engineering workflows; knowledge of Node.js is a plus.

• Experience with distributed data processing frameworks such as Apache Spark or Apache Flink is beneficial.

• Familiarity with data orchestration tools like Apache Airflow or similar is an advantage.

• Experience with containerized application deployments, particularly using Docker, is highly preferred.

• Significant experience with large-scale data systems and data warehousing solutions; possesses thorough knowledge of the open source data ecosystem and how to integrate it into scalable solutions.

• Familiarity with message queueing architectures, especially RabbitMQ, is preferred.

• Experience with Amazon Web Services, particularly S3, RDS, DMS, and VPC; knowledge of Redshift or EMR is a plus.

• Experience working with AI/ML systems, including building data infrastructure to support model training, inference pipelines, or AI-driven features, is advantageous.

• Experience in designing data architectures for IoT or high-frequency telemetry systems is highly preferred.

🏝️ Benefits

• Full-time opportunity.

• Location: Remote - nationwide.

• Travel is required, approximately 8 - 10%.

• Opportunities for growth and personal development within a dynamic team environment.

• Comprehensive, low-cost benefit packages available.

• Benefit coverage commences on the first day of employment.

• Paid Time Off and Volunteer Time Off are provided.

• 401k matching available.

• Dependent Care benefits offered.

• Employee referral bonuses available.