Senior Data Engineer – AI Platform

This is a fully remote position, open to applicants in Poland.

📋 Description

• Integrate large language models into production AI agent workflows, creating structured-output pipelines that include grounding, reference resolution, and evidence traceability.

• Design and enhance APIs that provide risk intelligence data to customers and facilitate external integrations.

• Develop and oversee data ingestion pipelines, taking full responsibility from extraction to loading and error management.

• Ensure the reliability of asynchronous task processing systems, including health monitoring, autoscaling, alerting, and incident response.

• Create and maintain shared libraries and internal developer tools that enhance the productivity of the entire engineering team.

• Manage the complete service lifecycle, from launching new services to retiring outdated ones.

⛳️ Requirements

• A minimum of 4 years of experience in Data Engineering or Backend Engineering with a strong emphasis on data.

• Over 4 years of hands-on experience with Python in production environments, demonstrating the ability to write clean, testable, and well-structured code.

• Proficiency in designing and developing APIs (preferably using GraphQL with Apollo Federation).

• Experience in building, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data services in a production setting.

• Solid understanding of data engineering methodologies, including ETL/ELT, batch and streaming processes, Data Warehousing, Data Lakes, and distributed processing.

• Comfortable working with asynchronous Python patterns, such as asyncio, Celery, and task queues.

• Strong knowledge of the Software Development Life Cycle (SDLC) and robust software engineering practices.

• Familiarity with an infrastructure-as-code approach.

• Demonstrated curiosity by asking questions, exploring new technologies, and a continuous desire to learn.

• Excellent problem-solving skills and the ability to effectively communicate ideas.

• A self-starter who is independent and proactive in taking initiative.

• Familiarity with several technologies in our current stack, including: Core: Python, Pandas, Polars, Celery, SQL (PostgreSQL), SQLAlchemy, Airflow, Docker, Kafka; AI/ML: OpenAI, Anthropic, Google Vertex AI, Pydantic (v2), Pydantic AI, MLflow; APIs: GraphQL (Strawberry); AWS: S3, Batch, RDS, DynamoDB, ECS, SQS, DMS, Lambda; Infra & Ops: Terraform, Datadog.

• Experience with or a strong interest in AI-native development workflows (we utilize Claude Code as a fundamental part of our software development process, from creating internal tooling to troubleshooting production issues).

🏝️ Benefits

• Option to work as a **B2B contractor** or **full-time employee**.

• **Competitive salary** at a well-funded, fast-growing startup.

• **PTO days** provided to ensure you can take the necessary time to recharge!

• For full-time employees: 28 PTO days allocated plus paid public holidays.

• For B2B contractors: 15 PTO days allocated plus paid public holidays.

• **100% remote** work available (or hybrid if that suits you better! We have a coworking space in the center of Warsaw).