Senior Business Intelligence Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, implement, and maintain a scalable business intelligence and reporting platform utilizing ClickHouse as the main analytical database.

• Create efficient Python-based ETL and ELT pipelines to extract, transform, validate, and load data from diverse sources.

• Enhance ClickHouse query performance for dashboards, reports, and high-volume reporting tasks.

• Construct dimensional models, reporting marts, and reusable data assets.

• Work closely with business partners to comprehend reporting needs and deliver actionable dashboards and reports.

• Support the development of frontend reporting interfaces using Next.js, TypeScript, Node.js, Tremor, AG Grid, and open-source charting libraries.

• Create AI-driven reporting features that facilitate natural language queries and business performance insights.

• Maintain comprehensive technical documentation, data dictionaries, pipeline documentation, runbooks, and reporting definitions.

• Construct natural language queries over approved datasets and reports.

• Generate AI-assisted explanations for metrics, trends, anomalies, and report logic.

• Implement metadata-aware report search capabilities and documentation lookup.

• Develop AI-assisted SQL or query generation with validation and guardrails.

• Automate the generation of report commentary and business insights.

• Establish data quality explanations and workflows for anomaly investigations.

• Create internal AI tools for ETL code, tests, documentation, and reporting components.

• Collaborate with business, engineering, and product teams on significant initiatives.

⛳️ Requirements

• Over 5 years of experience in business intelligence engineering, data engineering, or data platform development.

• Extensive experience with ClickHouse in real-time or near real-time environments.

• Strong expertise in Python for ETL, data processing, automation, and production data workflows.

• Advanced SQL capabilities, including analytical queries, joins, aggregations, window functions, and query optimization.

• Experience in aggregating and combining data from Elasticsearch, SQL Server, APIs, and file-based sources.

• Ability to translate business requirements into scalable technical solutions through direct collaboration with business partners.

• Exceptional debugging and problem-solving skills for data pipelines, SQL queries, and reporting logic.

• Preferred: experience with Node.js, Next.js, TypeScript, React, or contemporary frontend development.

• Preferred: experience in creating APIs or backend services for reporting and analytics.

• Preferred: familiarity with Airflow, Prefect, Dagster, or custom Python schedulers.

• Preferred: understanding of Elasticsearch query patterns, indexing concepts, and large-scale search/log analytics data extraction.

• Willingness to learn TypeScript, JavaScript, and current frontend technologies.

• Remote positions are not eligible for U.S. visa sponsorship.

🏝️ Benefits

• Target bonus.

• Restricted stock units (as applicable).

• Medical benefits.

• Financial benefits.

• 401(k) eligibility.

• Paid time off (PTO).

• Parental leave.

• Ongoing education opportunities.

• Remote work arrangement.