Data Engineer

📋 Description

• Design, implement, and maintain data pipelines and ETL processes that facilitate the ingestion, transformation, and validation of mission data.

• Develop and enhance data models and schemas across both relational and non-relational databases to support system integrations and analytics.

• Collaborate with system architects, integration developers, and data analysts to ensure data consistency, security, and integrity within cloud environments.

• Implement data migration and synchronization between legacy systems, applications, and modern cloud platforms.

• Utilize AWS services (Glue, Lambda, S3, RDS, Redshift, Kinesis) to create and sustain scalable, fault-tolerant data infrastructure.

• Support data validation and reconciliation by performing quality checks and generating reports to ensure accuracy.

• Integrate data from APIs, streaming sources, and file-based systems into centralized repositories or data lakes.

• Automate data workflows using infrastructure-as-code and CI/CD principles to guarantee repeatability and efficiency.

• Monitor and troubleshoot data pipeline performance, ensuring compliance with SLAs and operational reliability.

• Implement data encryption, masking, and access controls in accordance with DoD cybersecurity policies and RMF requirements.

• Assist in the development of dashboards and analytics products, providing data-driven insights for mission stakeholders.

• Maintain documentation and metadata repositories, including data dictionaries, lineage, and technical specifications.

• Engage in Agile sprints, contributing to backlog refinement, testing, and cross-functional collaboration.

⛳️ Requirements

• Proficiency in Python, SQL, and ETL frameworks (e.g., Apache NiFi, Talend, or AWS Glue).

• Experience with cloud data services, preferably AWS GovCloud (RDS, S3, Lambda, Glue, Redshift).

• Knowledge of database management systems such as PostgreSQL, SQL Server, DynamoDB, and MongoDB.

• Familiarity with RESTful API integration and data exchange standards (JSON, XML, CSV).

• Understanding of DoD data security and compliance standards, including encryption, RMF, and STIG adherence.

• Experience in developing and maintaining data validation, profiling, and transformation scripts.

• Exposure to data visualization and analytics tools (Power BI, Tableau, QuickSight).

• Familiarity with Agile software development and DevSecOps delivery frameworks.

• Strong analytical and problem-solving abilities for data integration and performance optimization.

• Excellent communication and collaboration skills across technical and functional teams.

• Attention to detail, emphasizing data accuracy and consistency.

• Ability to balance data governance, security, and performance objectives.

• Commitment to continuous improvement and mission impact through data-driven decision-making.

• Preferred certifications include: AWS Certified Data Engineer – Associate, AWS Certified Developer, CompTIA Security+ CE (DoD 8570), Certified Data Management Professional (CDMP), or equivalent.

🏝️ Benefits

• Health insurance

• 401(k) matching

• Flexible work hours

• Paid time off

• Remote work options