Senior Software Engineer – Python, Data Ecosystem

This is a fully remote position, open to applicants in Germany.

📋 Description

• Take ownership and enhance ClickHouse's Python connector and SDK ecosystem, elevating performance, reliability, and API design standards.

• Develop and sustain integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt) to meet enterprise-grade quality benchmarks.

• Lead the AI/LLM integration strategy by designing connectors and methodologies that position ClickHouse as a seamless component in RAG architectures, ML feature pipelines, and LLM-driven data applications.

• Actively participate in the open-source community: manage issues, support contributors, advocate for users, and influence the roadmap with insights from real-world feedback.

• Collaborate with Product, Cloud, and various engineering teams to ensure integration efforts align with broader platform objectives.

• Provide a practitioner's viewpoint in roadmap planning, grounding prioritization in the authentic workflows of Data Engineers and Data Scientists.

⛳️ Requirements

• Over 7 years of software development experience, preferably with hands-on involvement as a Data Engineer, Data Scientist, or ML Engineer.

• Extensive, proven experience in designing, building, and maintaining production-quality Python connectors, SDKs, or integrations for at least one major platform (orchestration, BI, MLOps, or data transformation).

• Strong familiarity with the Python data ecosystem: Pandas, NumPy, Pydantic, and related libraries.

• Previous contributions to or substantial practical experience with popular data orchestration tools (Airflow, Dagster, or Prefect).

• Practical experience with AI/ML in data engineering contexts: embedding generation, vector search, feature pipelines, or LLM-driven tools in production settings, beyond mere experimentation.

• Solid understanding of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases.

• Strong experience with concurrent Python: threading, multiprocessing, and asynchronous patterns.

• Exceptional written and verbal communication skills; adept at collaborating across engineering disciplines and with open-source communities.

🏝️ Benefits

• Flexible work environment - ClickHouse is a globally distributed company and remote-friendly, currently operating in 20 countries.

• Healthcare - Employer contributions towards your healthcare.

• Equity in the company - Every new team member who joins receives stock options.

• Time off - Flexible time off in the US, with generous entitlements in other countries.

• A $500 Home office setup for remote employees.

• Global Gatherings – We value in-person connections and provide opportunities for engagement at company-wide offsites.