Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead the development of the agentic connector pipeline by automating source profiling, field mapping, dbt model generation, and validation.

• Design and create AI-assisted data ingestion workflows utilizing LLM APIs and agentic orchestration frameworks.

• Take ownership of the initial 2–3 end-to-end agent-built connectors as proof of concept for the wider team.

• Establish internal AI tooling standards and patterns while mentoring the team on agentic development practices.

• Design, construct, and maintain data pipelines and systems to fulfill business requirements.

• Implement data quality control measures and contribute to observability frameworks.

• Document both new and existing systems, designs, processes, and procedures.

• Participate in on-call support 3–9% of the year, one week at a time, to address production failures and urgent business needs.

• Mentor and collaborate with colleagues through pair/mob programming, design reviews, and Lunch & Learns.

⛳️ Requirements

• A minimum of 5 years of experience in data engineering or a related discipline.

• At least 1–2 years of practical experience working with LLM APIs and agentic frameworks.

• Proficient in Python and SQL.

• Familiarity with Databricks and AWS.

• Strong understanding of data lake architecture, data modeling, and medallion patterns (Bronze/Silver/Gold).

• Experience in building and consuming APIs.

• Knowledge of data quality control and pipeline observability.

• Excellent debugging, problem-solving, and analytical abilities.

• Outstanding written and verbal communication skills.

• Comfortable operating in a fast-paced and ambiguous environment.

🏝️ Benefits

• None specified