Data Engineer – Web Scraping, LLM Pipelines, Scalable Data Infrastructure

This is a fully remote position, open to applicants in Argentina.

📋 Description

• Create new structured datasets by scraping accelerators, Form D filings, and dynamic web sources.

• Build automated ETL pipelines that parse, clean, and transform content utilizing LLMs.

• Establish and manage database schemas in Supabase or PostgreSQL.

• Develop evaluation frameworks to assess and compare LLM performance across various pipeline components.

• Assist in the design of scalable data architectures using GCP services.

• Enhance reliability, observability, and deployment processes for scraping and data processing systems.

⛳️ Requirements

• Over 4 years of experience in constructing data pipelines, backend services, and automated data processing systems.

• Strong expertise in web scraping using tools such as Scrapy, Playwright, or similar technologies.

• Experience in deploying pipelines on cloud platforms like GCP or AWS.

• Comprehensive understanding of ETL frameworks, workflow orchestration (Airflow), and modern data storage solutions (BigQuery, PostgreSQL).

• Proficient in working with Docker and API frameworks such as FastAPI.

• Excellent and fluent communication skills in English.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work options.

• Opportunities for professional development and career advancement.

• Comprehensive health and wellness benefits.

• Collaborative and innovative work environment.