Senior Data Engineer

This is a fully remote position, open to applicants in Washington.

📋 Description

• Design and implement scalable ETL/ELT data pipelines utilizing Python and SQL.

• Construct and enhance data warehouse solutions in Google BigQuery, focusing on partitioning, clustering, and query optimization.

• Create automated data ingestion and transformation pipelines that integrate REST APIs and external data sources.

• Develop data models that support analytics, business intelligence, and reporting needs.

• Enhance cloud data workflows for improved performance, reliability, scalability, and cost-effectiveness.

• Build and manage data processing solutions on the Google Cloud Platform.

• Automate scheduled data pipelines, data refreshes, and reporting activities.

• Incorporate GCP services such as BigQuery, Secret Manager, and Google Workspace APIs.

• Implement secure authentication and authorization mechanisms using service accounts and best practices in IAM.

• Create modular, reusable, and maintainable ETL frameworks.

• Collaborate with cross-functional teams to provide dependable and scalable data solutions.

• Utilize Git and GitHub for version control and collaborative software development.

• Employ Terraform and GitHub Actions to facilitate Infrastructure as Code and CI/CD methodologies.

• Utilize Cloud Run, Cloud Scheduler, Cloud Workflows, Pub/Sub, Cloud Tasks, and Cloud Batch to build scalable data architectures.

⛳️ Requirements

• Over 5 years of experience in data engineering, ETL/ELT processes, and cloud data platforms.

• Proficient in Python and SQL.

• Practical experience in developing data pipelines and transformation workflows.

• Extensive knowledge of Google BigQuery, including data warehousing, data modeling, partitioning, clustering, and performance tuning.

• Hands-on experience with GCP and cloud-native data engineering solutions.

• Experience in integrating REST APIs and external data sources within data platforms.

• Familiarity with tools such as Cloud Run, Cloud Scheduler, Cloud Workflows, Pub/Sub, Cloud Tasks, and Cloud Batch.

• Proficient with Terraform, Git, GitHub, and CI/CD practices, preferably using GitHub Actions.

• Understanding of IAM, service accounts, data security, data quality, monitoring, and pipeline reliability.

• Strong analytical, problem-solving, communication, and cross-functional collaboration abilities.

• Proficient in professional English, with a level of B2 or higher.

• A resume and cover letter must be submitted in English.

🏝️ Benefits

• Opportunity for remote work.

• Work schedule from Monday to Friday, 9:00 AM to 6:00 PM Eastern Time.

• Equal opportunity employer.

• Inclusive work environment.

• Commitment to diversity.