Senior Data Engineer

📋 Description

• Design, implement, and manage data pipelines and ETL processes that facilitate the ingestion, transformation, and validation of mission-critical data.

• Develop and enhance data models and schemas across both relational and non-relational databases to support system integrations and analytics initiatives.

• Collaborate with system architects, integration developers, and data analysts to guarantee data consistency, security, and integrity throughout cloud environments.

• Execute data migration and synchronization tasks between legacy systems, applications, and contemporary cloud platforms.

• Leverage AWS services (Glue, Lambda, S3, RDS, Redshift, Kinesis) to create and maintain scalable and resilient data infrastructure.

• Assist in data validation and reconciliation by performing quality checks and generating reports to ensure data accuracy.

• Integrate data from APIs, streaming sources, and file-based systems into centralized repositories or data lakes.

• Automate data workflows employing infrastructure-as-code and CI/CD methodologies to achieve repeatability and efficiency.

• Monitor and troubleshoot data pipeline performance to ensure compliance with SLAs and operational reliability.

• Implement data encryption, masking, and access controls in alignment with DoD cybersecurity policies and RMF requirements.

• Assist in the development of dashboards and analytics products, facilitating data-driven insights for mission stakeholders.

• Maintain documentation and metadata repositories, which include data dictionaries, lineage, and technical specifications.

• Engage in Agile sprints, contributing to backlog refinement, testing, and cross-functional collaboration.

⛳️ Requirements

• At least 7 years of experience in data engineering, integration, or enabling analytics.

• Proficient in Python, SQL, and ETL frameworks (such as Apache NiFi, Talend, or AWS Glue).

• Experience with cloud data services, preferably AWS GovCloud (RDS, S3, Lambda, Glue, Redshift).

• Bachelor's degree in Computer Science, Information Systems, or a related technical field.

• Familiarity with Agile software development and DevSecOps delivery methodologies.

• Relevant technical certification is required.

🏝️ Benefits

• N/A