Senior Software Engineer – Integrations, AI/ML

This is a fully remote position, open to applicants in Germany.

📋 Description

• Take ownership of ClickHouse's Python connector and SDK ecosystem, focusing on enhancing performance, reliability, and API design.

• Lead the integration strategy for AI/LLM within RAG architectures, machine learning feature pipelines, and LLM-enabled data applications.

• Create connectors and design patterns for the AI and LLM ecosystem, incorporating tools like LangChain, LlamaIndex, and n8n.

• Interact with the open-source community by addressing issues, supporting contributors, advocating for users, and influencing the project's roadmap.

• Work closely with Product, Cloud, and other engineering teams to synchronize integration efforts with platform priorities.

• Provide insights from Data Engineer and Data Scientist workflows to inform roadmap and prioritization strategies.

⛳️ Requirements

• A minimum of 7 years of software development experience, including practical experience as a Data Scientist or Machine Learning Engineer.

• Extensive, demonstrated experience in designing, building, and maintaining production-quality Python connectors, SDKs, or integrations for at least one major platform.

• Practical experience in applying AI/ML in production data engineering scenarios, such as embedding generation, vector search, feature pipelines, or LLM-driven tools that have been deployed in production.

• Strong knowledge of the Python data ecosystem, including libraries like Pandas, NumPy, Pydantic, and related technologies.

• Solid grasp of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases.

• Substantial experience with concurrent Python programming, including threading, multiprocessing, and asynchronous patterns.

• Exceptional written and verbal communication skills; adept at collaborating across engineering disciplines and engaging with open-source communities.

• Understanding of ClickHouse or other high-performance OLAP platforms.

• Knowledge of the JVM ecosystem.

• Experience with deploying AI/ML models in production, including the development of inference APIs and vector databases.

• Familiarity with tools such as dbt, Airflow, Dagster, or Prefect is an advantage.

🏝️ Benefits

• Flexible work environment with a remote-friendly work arrangement.

• Employer contributions to healthcare plans.

• Stock options/equity in the company.

• Flexible time off policy in the US.

• Generous time-off allowances in other countries.

• USD$500 home office setup stipend for remote employees.

• Opportunities to connect with colleagues during company-wide offsite events.