Senior Software Engineer – Integrations, AI/ML

This is a fully remote position, open to applicants in Spain.

📋 Description

• Take ownership and enhance ClickHouse’s Python connector and SDK ecosystem.

• Develop and oversee integrations with orchestration platforms and transformation tools.

• Lead the integration strategy for AI/LLM in RAG architectures, ML feature pipelines, and LLM-driven data applications.

• Manage the complete lifecycle of essential AI/ML integrations, focusing on architecture, performance, and feature direction.

• Actively participate in the open-source community by addressing issues, supporting contributors, advocating for users, and influencing the roadmap.

• Work collaboratively with Product, Cloud, and engineering teams on platform priorities.

• Incorporate perspectives from Data Engineers and Data Scientists into roadmap decisions.

• Create production-ready connectors for LangChain, LlamaIndex, n8n, embedding pipelines, vector stores, feature stores, and LLM-driven applications.

⛳️ Requirements

• Over 7 years of software development experience, including practical roles as a Data Engineer, Data Scientist, or ML Engineer.

• Extensive, demonstrated experience in designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for at least one major platform.

• Practical experience implementing AI/ML in production data-engineering scenarios, including embedding generation, vector search, feature pipelines, or LLM-powered tools deployed and operated in production.

• Strong proficiency in the Python data ecosystem, including Pandas, NumPy, Pydantic, and other related libraries.

• Solid foundation in database principles: SQL, data modeling, query optimization, and knowledge of OLAP/analytical databases.

• Proficient in concurrent Python programming: threading, multiprocessing, and asynchronous patterns.

• Excellent written and verbal communication skills; comfortable collaborating across engineering disciplines and within open-source communities.

• Familiarity with ClickHouse or comparable high-performance OLAP platforms.

• Understanding of the JVM ecosystem.

• Experience in deploying AI/ML models in production, including inference APIs and vector databases.

• Knowledge of dbt, Airflow, Dagster, or Prefect is a plus.

🏝️ Benefits

• Flexible work environment and remote-friendly work at a globally distributed company.

• Employer contributions towards healthcare.

• Stock options/equity available for every new team member.

• Flexible time off policy in the US.

• Generous time-off entitlements in other countries.

• USD $500 allowance for home office setup for remote employees.

• Opportunities to connect with colleagues at company-wide offsite events.