Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, construct, and manage scalable batch and streaming data pipelines.

• Lead architectural decisions for data platforms based on Lakehouse architecture.

• Develop and orchestrate workflows utilizing Apache Airflow.

• Create transformations and analytics-ready datasets with DBT.

• Develop and sustain real-time data pipelines using Kafka.

• Utilize Databricks for extensive data processing and advanced analytics.

• Design and enhance storage solutions leveraging Apache Iceberg and Lakehouse architecture.

• Ingest and oversee data from various sources using tools like Fivetran managed data lake.

• Build and maintain a semantic layer for reliable reporting and self-service analytics.

• Implement frameworks for data quality, observability, and automated testing.

• Optimize performance, scalability, and cost across AWS services (such as Athena, EC2, etc.).

• Collaborate with BI, product, and engineering teams to provide actionable data solutions.

• Mentor junior engineers and contribute to best practices and engineering standards.

• Drive enhancements in developer productivity and pipeline reliability.

⛳️ Requirements

• Over 7 years of experience in Data Engineering or a related field.

• Strong skills in Python and SQL.

• Extensive experience with Apache Airflow and workflow orchestration.

• Expertise in DBT for data transformation and modeling.

• Significant hands-on experience with Databricks.

• Proficient in building streaming pipelines (Kafka or similar technologies).

• Strong hands-on experience with data ingestion tools like Fivetran.

• Practical experience in developing automated QA, monitoring, and observability for data lakes/lake houses.

• Solid grasp of Lakehouse architecture and Apache Iceberg.

• Experience in implementing data quality, testing, and observability frameworks.

• Familiarity with the AWS ecosystem (Athena, EC2, S3, etc.).

• Strong foundation in data modeling and semantic layer design.

• Proven capacity to design scalable systems and influence technical direction.

🏝️ Benefits

• Flexibility to work in your preferred environment within your country of employment – whether in-office, remote, or hybrid.

• Ongoing investment in your professional growth and development.

• Day 1 access to a comprehensive health and wellness benefits package, including an annual wellness stipend.

• 401k plan with up to a 4% match and immediate vesting.

• Flexible and generous time-off policies (FTO).

• Employee Stock Purchase Program.