Senior Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Design, construct, and oversee scalable multi-cloud data platforms.

• Create and enhance real-time and batch data pipelines utilizing Kafka and Spark.

• Develop Lakehouse architectures with Apache Iceberg or Delta Lake.

• Enhance BigQuery, data models, queries, and overall warehouse performance.

• Design dependable and scalable distributed data processing systems.

• Automate infrastructure and deployment processes using Terraform and Kubernetes.

• Maintain high standards for data reliability, security, governance, and compliance.

• Lead technical architecture and design review sessions.

• Guide engineers and contribute to the establishment of engineering best practices.

⛳️ Requirements

• Over 8 years of experience in Data Engineering, Data Platforms, or Distributed Systems.

• More than 3 years of experience managing large-scale data platforms in a production environment.

• Extensive hands-on experience with Kafka, Spark, GCP, BigQuery, and Airflow.

• Familiarity with Terraform and Kubernetes.

• Practical knowledge of Lakehouse technologies like Iceberg or Delta Lake.

• Strong comprehension of data modeling, distributed systems, and data warehouse architecture.

• Proven experience leading technical projects and mentoring engineers.

• Nice to have: Experience with Debezium, Redpanda, and dbt.

• Nice to have: Familiarity with Prometheus and Grafana for monitoring and observability.

• Nice to have: Exposure to fintech, financial services, or regulated environments.

• Nice to have: Understanding of data governance, security, and compliance requirements.

🏝️ Benefits

• Engage with challenging, large-scale engineering and data complexities.

• Develop modern platforms utilizing state-of-the-art cloud and data technologies.

• Collaborate closely with seasoned engineering, product, and technology leaders.

• Opportunity to take charge of architecture and key technical decisions.

• A remote-first and collaborative work atmosphere.

• Significant opportunities for learning, leadership, and career advancement.