Senior Data Engineer

This is a fully remote position, open to applicants in Argentina.

📋 Description

• Design, construct, and enhance extensive distributed data pipelines utilizing Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.

• Create ETL/ELT workflows on GCP that integrate various structured and unstructured data sources.

• Tackle schema, type conversion, and performance optimization issues when transitioning data warehouses to BigQuery.

• Establish observability, monitoring, logging, and error-handling mechanisms within the pipelines.

• Work alongside Data Analysts to incorporate validation rules, QA checks, and automated testing into the pipeline lifecycle.

• Assist with large-scale data migrations and performance optimization for high-volume workloads.

⛳️ Requirements

• Over 4 years of experience as a Data Engineer in contemporary cloud environments.

• At least 2 years of practical experience in GCP (BigQuery, Dataflow, Dataform, Composer, Dataproc, Pub/Sub).

• Strong background in distributed data processing frameworks (experience in at least one is mandatory).

• Apache Beam / Google Cloud Dataflow

• Apache Spark

• Apache Flink

• Proficient in Python (for pipeline development).

• Skilled in SQL (with Oracle and BigQuery dialects being ideal).

• Familiarity with Apache Airflow (for orchestration).

• Experience handling big data workloads, batch/streaming pipelines, and large-scale data migrations.

• Knowledge of data warehousing (BigQuery, Snowflake, Databricks is an advantage).

🏝️ Benefits

• Competitive compensation.

• Fully remote work environment.

• Commitment to fostering a diverse and inclusive workplace.