Principal Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement lakehouse architecture utilizing open-source technologies.

• Construct and enhance ClickHouse deployments for optimal performance in analytical workloads.

• Create custom data transformations and ETL/ELT pipelines with open-source tools.

• Develop data models that integrate Postgres application databases with the ClickHouse analytics layer.

• Collaborate with product and engineering teams to establish analytical and operational data models.

• Draft specifications that outline contracts, schemas, and expected behaviors prior to coding.

• Utilize AI-assisted coding tools daily to speed up development and minimize manual effort.

• Set up data quality frameworks and ensure pipeline observability.

• Enhance performance, cost-effectiveness, and reliability at scale.

• Duties may be added or modified by the company.

⛳️ Requirements

• Over 5 years of experience in data engineering, analytics engineering, or similar roles.

• In-depth expertise with ClickHouse, covering deployment, optimization, schema design, and materialized views.

• Significant experience with Postgres and the distinctions between transactional and analytical database usage.

• Strong background in lakehouse architecture patterns, including Delta Lake, Apache Iceberg, or Apache Hudi.

• Proficient in building ETL/ELT pipelines utilizing open-source tools like Airflow, Dagster, dbt, or Prefect.

• Practical experience with streaming and batch processing frameworks such as Kafka, Flink, or Spark.

• Strong SQL skills and advanced proficiency in Python.

• Proficiency in TypeScript for application-service integration.

• Familiarity with AI coding assistants like Cursor, Copilot, or Claude.

• Experience employing LLMs for data transformation, validation, or pipeline generation.

• A spec-first mindset with a focus on documentation before implementation.

• Experience in real-time analytics and requirements for sub-second query performance.

• Understanding of data contracts, schema registries, and data mesh principles.

• Contributions to open-source data projects.

• Experience collaborating in cross-functional product teams.

• Must be authorized to work in the United States without sponsorship currently or in the future.

• Must reside within the United States.

🏝️ Benefits

• Remote work eligibility for candidates located in the United States.

• Opportunities for occasional work at additional SERHANT. offices or participation in offsites, as arranged with the manager.

• Commitment to equal employment opportunities and fostering an inclusive workplace.

• No application, processing, or training fees.