
Data Engineer – GCP
Posted Jul 29

Posted Jul 29
This is a fully remote position, open to applicants in United States.
• Architect, develop, and sustain scalable and dependable data pipelines utilizing Cloud Dataflow, Cloud Pub/Sub, and Cloud Composer.
• Create ETL/ELT procedures for processing and transforming extensive amounts of structured and unstructured data.
• Enhance the performance, scalability, and reliability of data pipelines.
• Ensure monitoring of data processing and ingestion workflows to meet performance SLAs.
• Design and execute data storage frameworks using BigQuery, Cloud Storage, and Firestore.
• Oversee data lifecycle policies and archiving methods.
• Develop data transformation methods using BigQuery, Apache Beam, and Cloud Functions.
• Implement data quality assessments, validation criteria, and monitoring systems.
• Automate data ingestion, transformation, and export processes using tools like Cloud Composer and Cloud Functions.
• Collaborate with data scientists and analysts to grasp data requirements and business objectives.
• A Bachelor’s degree in Computer Science, Data Engineering, or a related discipline; a Master’s degree is advantageous.
• Over 3 years of experience in data engineering, including a minimum of 2 years with Google Cloud Platform.
• Google Professional Data Engineer certification is mandatory.
• Strong expertise in GCP services such as BigQuery, Cloud Dataflow, Cloud Composer, Cloud Pub/Sub, Firestore, and Cloud Functions.
• Practical experience with big data technologies and frameworks like Apache Beam, Hadoop, Spark, or Flink.
• Direct experience with dbt.
• Proficiency in programming languages such as Python, Java, or Scala.
• In-depth knowledge of SQL, data modeling, and query optimization.
• Experience with CI/CD tools and version control systems (e.g., Git, Cloud Build).
• Solid understanding of data governance, security, and compliance standards.
• Capability to manage large-scale data processing and real-time data pipelines.
• Exceptional problem-solving, analytical, and communication abilities.
• Must possess U.S. citizenship or hold a Green Card.
• Competitive salary along with performance-related bonuses.
• Comprehensive health, dental, and vision insurance.
• Opportunities for professional development and training (including GCP certification).
• Flexible working environment with options for remote work.
Agility Robotics
AGGRANDIZE
Get handpicked remote jobs straight to your inbox weekly.