Senior Data Engineer

This is a fully remote position, open to applicants in Uruguay, +7 more countries.

📋 Description

• Construct and manage scalable ingestion, ELT/ETL, and orchestration pipelines, encompassing batch and real-time streaming, within Microsoft Fabric and cloud lakehouse settings.

• Design and execute low-latency, real-time data ingestion workflows for live operational analytics and streaming tasks.

• Implement tiered Bronze/Silver/Gold medallion architectures utilizing PySpark and SQL.

• Create idempotent, backfillable, and incrementally loaded jobs.

• Employ deduplication, normalization, schema validation, and lineage tracking techniques.

• Provide feature-ready, curated datasets for business intelligence, analytics, vector search, and AI/ML agentic functions.

• Set up testing, monitoring, and pipeline observability for freshness, volume, and schema drift, with clear alerting mechanisms.

• Utilize Claude Code, Copilot, and Cursor to expedite pipeline development, query optimization, and data transformation scripting.

⛳️ Requirements

• Over 5 years of practical experience in data engineering, constructing and managing production data pipelines at scale.

• Strong command of Python, SQL, and PySpark / Apache Spark.

• Solid foundation in software engineering principles, including Git, CI/CD, and unit/integration testing.

• Practical experience in implementing real-time data ingestion and streaming pipelines.

• Proven track record in end-to-end data modeling, schema design, and layered lakehouse architectures (Medallion architecture).

• Familiarity with cloud-native lakehouse platforms; hands-on experience or knowledge of Microsoft Fabric is highly desirable.

• Strong understanding of data testing frameworks, pipeline monitoring, and enforcing data quality.

• Active experience utilizing AI-assisted development tools such as Cursor, Copilot, and Claude.

• Hands-on experience with Microsoft Fabric, Fabric Lakehouse, Data Factory, or Synapse Analytics is advantageous.

• Experience in extracting data from MongoDB / MongoDB Atlas and Change Streams / CDC is a plus.

• Familiarity with Event Hubs, Kafka, or Spark Structured Streaming is beneficial.

• Exposure to vector embeddings, RAG-ready datasets, or feature stores for AI/ML functions is a plus.

• Experience in the AEC / Construction / MEP domain is advantageous.

🏝️ Benefits

• Fully remote work arrangement.

• Employment opportunity framework under Law 19.691 on the Promotion of Employment for Persons with Disabilities, including individuals registered in the National Registry of Persons with Disabilities of the Ministry of Social Development.