This is a fully remote position, open to applicants in United States.

• Design, construct, and uphold data pipelines (ETL/ELT) that extract, transform, and load data from source systems into target repositories.

• Collaborate with Product Management and downstream teams to establish data requirements and expectations for data quality.

• Partner with Engineering to outline pipeline architecture for both batch and real-time data processing.

• Write and enhance SQL queries and scripts (Python or similar) to facilitate data transformation and validation.

• Oversee pipeline health, resolve failures, and ensure data availability and reliability.

• Aid in the integration of data sources into cloud data warehouses or data lakes.

• Assist in defining future data architecture to accommodate increased volume, new data sources, and analytics use cases.

• Document data flows, schemas, and pipeline logic for team and stakeholder reference.

• Associate's degree or equivalent professional experience.

• Over 2 years of IT technical experience, including exposure to data pipeline development, SQL, or scripting.

• Capability to obtain and maintain a U.S. Government Public Trust or Security Clearance.

• Experience with data pipeline orchestration tools like Airflow, dbt, or similar.

• Familiarity with distributed data processing frameworks, including Spark or Kafka.

• Experience with cloud data warehouses or lakes, such as Snowflake, BigQuery, Redshift, or S3-based architectures.

• Proficiency in Python for data engineering tasks.

• Understanding of data modeling and best practices for data quality.

• Equal opportunity employer

Data Engineer

People also viewed