Data Engineer

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Develop, construct, and sustain robust, scalable batch and streaming data processing, storage, and integration pipelines.

• Analyze requirements and design specifications, taking full responsibility for building features from inception to completion.

• Produce clean, well-documented, scalable, extensible, and testable code to maintain application quality and sustainability.

• Collaborate with data scientists and engineers to create semantic data models that represent intricate vehicular systems, ensuring seamless integration across other Shift5 components.

• Develop scalable data products for data scientists, transportation engineers, and executives to facilitate insights and informed decision-making.

• Design efficient, reliable, cost-effective, dynamically scalable, and observable solutions utilizing AWS cloud services.

• Examine complex data sets to construct data ontologies, verify data quality/integrity, and guarantee data accuracy throughout the pipelines.

• Assist in the design process and occasionally travel to customer locations (estimated a few times annually) to work with Field Engineers on data integration and deployment.

⛳️ Requirements

• Over 2 years of software/data engineering experience with a comprehensive understanding of software engineering practices and principles.

• At least 2 years of experience with a major programming language (GoLang, Java, or Python).

• More than 2 years of relational database experience (PostgreSQL, MySQL, Oracle, etc.) along with 2+ years of experience in Big Data (Hadoop, Spark) and Data Modeling.

• A minimum of 2 years of experience with containerization and cloud services (Docker, Kubernetes) and cloud monitoring tools.

• Proficiency in batch and streaming data pipelines using technologies such as Apache Airflow or Benthos.

• Familiarity with modern data stack components, including data ingestion, transformation, and orchestration.

• U.S. citizenship is required, along with the ability to obtain a security clearance.

• Experience and knowledge of data lakes/warehouses (e.g., Snowflake, Databricks, Redshift).

• Skilled in CI/CD, source control, design reviews, and integrating observable practices.

• Willingness to travel occasionally to customer and partner sites to assist with field integration and deployment initiatives.

🏝️ Benefits

• Bonus program and equity in a rapidly growing startup.

• Competitive salary and stock options in a fast-evolving startup.

• Employer-covered medical, dental, and vision insurance.

• Health Savings Account with annual employer contributions.

• Life Insurance coverage.

• Unrestricted paid time off policy.

• Flexible working arrangements and remote work options.

• Tax-deferred public transit benefits with Metro SmartBenefits (DC/MD/VA).