Data Engineer

This is a fully remote position, open to applicants in Maryland, +1 more state.

📋 Description

• Develop secure and dependable data capabilities for a mission-oriented platform that integrates authoritative sources, operational data, and analytical services.

• Design, create, and manage batch and streaming ETL/ELT pipelines from structured and semi-structured data into secure cloud data platforms.

• Integrate data sources by establishing schemas, mappings, interfaces, validation rules, ownership, and operational support procedures.

• Create automated data-quality checks complete with monitoring and alerting mechanisms.

• Construct data transformations and processing workflows for operational applications, analytics, machine learning, and retrieval or inference workflows.

• Maintain data lineage, provenance, version history, audit trails, and metadata handling.

• Enforce secure data practices, including least-privilege access, encryption, secrets management, privacy safeguards, and controls for sensitive or classified data.

• Develop and sustain data models, curated datasets, and service interfaces for authoritative information.

• Automate deployments and pipeline operations using Infrastructure as Code, CI/CD, workflow orchestration, and environment-specific configurations.

• Enhance pipelines for scalability, resiliency, performance, and cost-effectiveness across cloud platforms.

• Diagnose failures across distributed data systems by utilizing logs, metrics, lineage, and operational signals; relay root causes and recovery strategies.

• Collaborate with software engineers, cloud engineers, data scientists, security teams, architects, and customer stakeholders to translate mission requirements into actionable data products.

• Generate data contracts, architecture documentation, runbooks, test plans, and operational guidance.

• Provide technical expertise for solution planning and proposal initiatives related to secure data platforms and AI-enabled mission capabilities.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Statistics, or a related technical discipline.

• Over 5 years of professional experience in data engineering, including the development and operation of production pipelines.

• Strong SQL skills, encompassing query optimization, data modeling, joins, window functions, and analysis of large datasets.

• Proficiency in Python, Java, R, or another programming language relevant to data engineering.

• Familiarity with Apache Airflow, AWS Glue, Spark, or similar data integration and workflow management tools.

• Experience utilizing Jupyter Notebook or similar tools for data analysis.

• Proficient in Python libraries such as numpy and pandas.

• Practical experience with at least one major cloud provider; AWS experience is highly preferred.

• Background in implementing data-quality frameworks, validation processes, monitoring, and alerting for production pipelines.

• Understanding of data security, access controls, encryption, auditability, and governance in regulated or compliance-focused environments.

• Experience working with APIs and structured data formats like JSON, XML, CSV, and Parquet.

• Capability to document technical decisions and collaborate effectively with multidisciplinary teams and customer stakeholders.

• Must be a U.S. Citizen in accordance with contract stipulations.

• Must be eligible to obtain and maintain a Public Trust Clearance as per contract requirements.

• Preferred: experience in building preprocessing, chunking, filtering, metadata enrichment, or evaluation pipelines for LLM and other AI/ML workflows.

• Preferred: experience in operating data platforms with segmented networks, limited connectivity, strict change control, or formal authorization requirements.

• Additional consideration will be given to candidates with C3.ai experience.

• Active Public Trust Clearance is preferred.

• AWS Data Engineer Certification, Databricks, cloud data engineering, or other relevant professional certifications are preferred.

• Preference will be given to candidates located in the Washington, DC metro area.

🏝️ Benefits

• Comprehensive medical, dental, and vision coverage.

• Flexible Spending Account.

• 4% 401K Match with immediate vesting.

• Paid Time Off.

• Tuition reimbursement, certification programs, and opportunities for professional development.

• Flexible work schedule.

• On-site gym and childcare options available.