Data Engineer

This is a fully remote position, open to applicants in District of Columbia, +1 more state.

📋 Description

• Evaluate customer data and analytical needs alongside product owners, business analysts, and data stewards.

• Convert customer requirements into defined ingestion and transformation tasks.

• Design, configure, test, and sustain batch or event-driven data pipelines for both new and migrated data sources.

• Create customer-centric transformations, semantic views, and datasets ready for reporting, analytics, and data science applications.

• Conduct source-to-target reconciliation, freshness assessments, data quality validation, and defect resolution.

• Provide documentation to support customer acceptance.

• Enforce approved access, metadata, lineage, and security requirements in collaboration with governance and security teams.

• Oversee the health and performance of data pipelines.

• Diagnose and resolve failed loads and data inconsistencies.

• Assist with production incidents and implement corrective measures.

• Record pipeline configurations, dependencies, runbooks, and handoff procedures.

• Suggest enhancements for reusable templates and automation processes.

• Manage customer onboarding and technical transitions with Summit platform and customer enablement teams.

• Collaborate with VA customers, data owners, analysts, and platform teams to onboard data sources and deliver dependable, analytics-ready data products.

⛳️ Requirements

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical field.

• Over 8 years of relevant experience, showcasing expertise in designing and deploying complex data engineering solutions.

• Practical experience in developing and troubleshooting production data ingestion, ETL/ELT, transformation, and validation pipelines using SQL and Python.

• Familiarity with cloud-based data platforms and services like Microsoft Azure, AWS, or Google Cloud.

• Knowledge of storage, orchestration, and secure data access protocols.

• Experience in data modeling, source-to-target reconciliation, data quality testing, and pipeline monitoring or incident resolution.

• Skilled in documenting technical designs, data flows, dependencies, and operational procedures.

• Ability to collaborate effectively with engineers, analysts, and data owners.

• Proven capability to independently implement data pipelines using established design and deployment methodologies.

• Eligibility to obtain and maintain the required VA Public Trust suitability determination (Tier 2/Moderate Risk).

• Direct, hands-on experience with the VA Summit Data Platform is highly desirable.

• Familiarity with other VA enterprise data and analytics environments is advantageous.

• Practical experience in Microsoft Azure data engineering, including Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Spark, or similar services.

• Understanding of Delta Lake/lakehouse architectures, data catalogs and lineage, and governance tools such as Collibra, Immuta, or Starburst.

• Experience supporting federal IT systems while adhering to security, privacy, and data access standards.

• Experience with Agile delivery and relevant cloud/data engineering certifications is preferred.

• Must be available for collaboration in Eastern Time and provide applicable production coverage.

• Remote work within CONUS is contingent upon meeting VA security and system access requirements.

🏝️ Benefits

• Remote work options available within CONUS.

• Occasional after-hours or weekend support may be necessary for critical outages or scheduled maintenance.