Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, enhance, and maintain production data pipelines that ingest, transform, validate, and publish data related to vessels, permits, trips, declarations, landings, and enforcement.

• Establish scalable integration patterns for various workloads including batch, scheduled, event-driven, streaming, and API-based processes.

• Convert business and technical requirements into source-to-target mappings, canonical models, schema strategies, transformation logic, reference-data rules, and data-quality controls.

• Create and optimize intricate SQL and data-processing logic for ingestion, reconciliation, analytics, reporting, and application support.

• Develop methodologies for data lineage, versioning, backward compatibility, and managed schema evolution.

• Conduct technical reviews, set engineering standards, and oversee source-code, configuration, testing, and release practices utilizing Git or GitHub workflows.

• Architect and deploy secure, resilient data workloads leveraging BigQuery and other Google Cloud Platform services.

• Provide guidance on cloud storage, orchestration, service identities, secrets, configuration, networking, and environment-specific deployment settings.

• Enhance continuous integration and delivery pipelines and establish automated deployments across development, testing, staging, and production environments.

• Analyze architectural tradeoffs to boost performance, scalability, cost efficiency, recoverability, and operational visibility.

• Implement federal security standards, least-privilege access, encryption, auditability, and secure service-to-service communication practices.

• Define monitoring and service-level indicators for pipeline health, processing volume, latency, failures, data quality, and downstream impacts.

• Lead the diagnosis and resolution of intricate issues involving source data, database connections, APIs, credentials, transformation logic, schedules, dependencies, and cloud services.

• Set standards for alerting, structured logging, retry handling, failure recovery, reprocessing, reconciliation, and operational readiness.

• Coordinate releases, production validation, incident response, root-cause analysis, corrective actions, and stakeholder communication.

• Own and review architecture diagrams, interface documentation, data dictionaries, decision records, runbooks, deployment procedures, and known-issue records.

• Mentor engineers, facilitate technical design discussions, estimate complex tasks, identify delivery risks, and participate in backlog refinement, sprint planning, demonstrations, and retrospectives.

• Provide technical leadership for data pipelines, interfaces, and cloud services that support federal government vessel and enforcement information systems.

⛳️ Requirements

• Minimum of 9 years of professional experience in data engineering, systems integration, software engineering, or a similar role, with a focus on complex production systems.

• Advanced expertise in designing, building, and maintaining data pipelines in Google Cloud Platform or a similar cloud environment.

• Proficient in SQL and demonstrated experience in crafting solutions with BigQuery, relational databases, or cloud data warehouses.

• Strong skills in Python, Java, or another programming language utilized for production data-processing and integration services.

• Proven experience in designing REST API integrations, data contracts, schema-evolution strategies, mappings, transformations, and reconciliation processes.

• Experience in leading production troubleshooting, incident response, root-cause analysis, and resolving complex data-quality or integration challenges.

• Familiarity with establishing Git or GitHub workflows, code-review standards, automated testing, continuous integration, and deployment pipelines.

• Ability to evaluate existing architecture and codebase, identify technical risks, and take ownership of mission-critical services with minimal oversight.

• Strong skills in technical leadership, documentation, communication, mentoring, and cross-functional collaboration within an Agile environment.

• Bachelor's degree in computer science, information systems, data engineering, or a related field, or equivalent practical experience.

• Candidates must be able to successfully pass a government background investigation and meet public trust requirements.

• US Citizenship or US Green Card is mandatory.

• Preferred: Extensive experience with BigQuery, Cloud Run, Cloud Functions, Pub/Sub, Cloud Storage, Dataflow, Composer, or other related Google Cloud services.

• Preferred: Experience in developing enterprise data architecture, reusable integration frameworks, data governance practices, or platform modernization roadmaps.

• Preferred: Experience in fisheries, vessel monitoring, maritime, geospatial, regulatory, or enforcement data.

• Preferred: Familiarity with Docker, infrastructure as code, automated data-quality testing, orchestration, and cloud observability tools.

• Preferred: Experience in defining operational metrics, service-level objectives, health dashboards, and alerts for business-critical data pipelines.

• Preferred: Experience supporting federal information systems and leading technical initiatives in accordance with federal security, accessibility, change-control, and release-management requirements.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Generous paid time off and holidays.

• Opportunities for professional development and continuing education.

• Flexible work arrangements and remote work options.