Data Engineer, GCP

📋 Description

• Designing and enhancing regulatory data submission systems, including both current on-premise solutions and new cloud-based options utilizing GCP/BigQuery.

• Creating and sustaining automated data pipelines for the ingestion, transformation, and loading of regulatory data.

• Assisting in the migration of legacy SQL Server systems to BigQuery, collaborating closely with senior staff and technical leads on architecture and data modeling.

• Establishing data validation, monitoring, and alerting processes to guarantee the accuracy, consistency, and reliability of regulatory submissions.

• Utilizing AI tools, such as Claude Code, and playing a key role in the team's automation strategies to minimize manual tasks and enhance quality.

• Engaging in code reviews and complying with departmental standards and development protocols.

• Carrying out QA processes to ensure that solutions are precise, efficient, and high-performing.

• Developing and updating pertinent documentation.

• Working collaboratively with other team members to deliver top-notch solutions within established timelines.

⛳️ Requirements

• Proficiency with Google BigQuery.

• SQL development expertise, capable of writing complex queries, stored procedures, and optimizing data-intensive workloads.

• Knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub, or Cloud Composer.

• Experience in developing data pipelines (ETL/ELT) and utilizing orchestration tools.

• Familiarity with Infrastructure as Code tools like Terraform, and CI/CD pipelines such as Git and GitLab.

• Detail-oriented with a methodical approach, able to simplify complex requirements into straightforward solutions.

• Interest in AI-assisted development tools like Claude Code.

• Capacity to meet deadlines in a dynamic, fast-paced environment.

• SQL Server experience to assist with legacy systems during the migration process.

🏝️ Benefits

• Flexible working hours.

• Opportunities for professional development.