
Senior Data Engineer
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in Brazil.
• Design, develop, orchestrate, and enhance batch and streaming data pipelines on Google Cloud.
• Create and maintain scalable, reliable, and efficient data engineering solutions.
• Connect and integrate data from Oracle (OCI), on-premises SQL Server, and AWS S3.
• Ensure data quality, scalability, monitoring, and governance.
• Optimize storage and processing costs.
• Assist Data Science and Data Analytics teams by preparing data for business use.
• Develop Dataflow pipelines to extract data from Oracle and SQL Server, transform it, and load it into BigQuery.
• Structure analytical models in BigQuery across Raw, Bronze, Silver, and Gold layers.
• Implement orchestrations in Cloud Composer with ordered execution, monitoring, and failure handling.
• Document tables, metadata, and data assets using Dataplex and/or Data Catalog.
• Strong experience with Google Cloud Platform (GCP).
• 3–5 years of professional experience.
• Proficiency in Python.
• Advanced SQL skills (BigQuery).
• Version control experience with Git / CI/CD.
• Familiarity with BigQuery, Dataflow, Dataproc, and Pub/Sub.
• Experience in real-time and batch ETL/ELT pipelines.
• Experience integrating Oracle, SQL Server, and MySQL via JDBC or custom solutions.
• Experience with Cloud Storage and Data Lakes.
• Knowledge of partitioning and clustering in BigQuery.
• Understanding of Dataproc (Spark/Hadoop) and NoSQL databases (Bigtable, Firestore).
• Experience with dbt or Dataform.
• Experience with Cloud Composer (Airflow) or Workflows.
• Knowledge of Cloud Functions and Cloud Run.
• Bachelor’s degree preferred.
• Experience with or knowledge of hospital information systems and healthcare is a plus.
• Full-time position.
• Opportunity to work on challenging and innovative projects.
• Highly skilled team.
• Collaborative culture focused on continuous learning.
• Professional growth opportunities.
Stability AI
Parra Consulting Group, Inc.
Parra Consulting Group, Inc.
BambooHR
Get handpicked remote jobs straight to your inbox weekly.