
Data Integration Engineer
Posted 19 hours ago

Posted 19 hours ago
This is a fully remote position, open to applicants in Virginia.
• Design and implement data exchanges between applications, databases, APIs, and supporting cloud services.
• Develop and maintain components for batch processing, event-driven systems, and API-based integrations.
• Convert interface requirements and source-to-target mappings into schemas, transformations, validation rules, and error-handling procedures.
• Create reusable services and pipeline components for secure data ingestion, transformation, distribution, and reconciliation.
• Implement logging, correlation identifiers, retry mechanisms, failure queues, and controls to diagnose and recover from failed transactions.
• Engage in architecture reviews and document interface designs, dependencies, data flows, and deployment requirements.
• Analyze source data to identify issues related to quality, completeness, consistency, and ownership.
• Develop SQL queries and automated checks to verify schemas, record counts, key relationships, field values, and transformation results.
• Assist with data mapping, normalization, deduplication, reference-data management, and reconciliation across systems.
• Generate representative test data and automate integration and data-quality tests in collaboration with quality assurance engineers.
• Support migration rehearsals, cutover planning, rollback procedures, and post-deployment validation activities.
• Build and manage integration workloads utilizing Google Cloud Platform or similar cloud services.
• Create deployment pipelines and configure infrastructure across development, testing, staging, and production environments.
• Monitor pipeline health, throughput, latency, failures, and data-quality metrics while addressing operational issues.
• Manage source code, configuration, and peer reviews utilizing Git or GitHub workflows.
• Document runbooks, support procedures, known limitations, recovery steps, and operational ownership.
• Participate in sprint planning, technical refinements, demonstrations, release planning, and production support.
• Collaborate with federal stakeholders, solution architects, application developers, business analysts, quality assurance engineers, and data owners.
• At least four years of professional experience in data engineering, systems integration, software engineering, or a comparable technical role.
• Experience in designing and implementing REST APIs, data pipelines, system interfaces, or integration services.
• Strong SQL proficiency and experience with relational databases and structured data models.
• Expertise in Python, Java, or another language typically used for data and integration services.
• Experience with schema design, data mapping, transformations, validation, reconciliation, and error management.
• Familiarity with deploying and supporting workloads in a cloud environment.
• Proficient with Git or GitHub, peer reviews, automated builds, testing, and deployment pipelines.
• Ability to troubleshoot issues across applications, APIs, databases, networks, credentials, and cloud services.
• Excellent written and verbal communication skills, with the capability to engage with both technical and non-technical stakeholders.
• A Bachelor's degree in computer science, information systems, data engineering, or a related field, or equivalent practical experience.
• Successful candidates must pass a government background investigation and meet public trust requirements.
• US Citizenship or a US Green Card is required.
• Medical, dental, and vision insurance.
• Employer-paid life insurance.
• Long- and short-term disability coverage.
• Generous 401(k) matching program.
• Paid time off and holidays.
Blue Orange Digital
Kainos
Canadian Solar Inc.
Horizon3.ai
Get handpicked remote jobs straight to your inbox weekly.