Engineering Manager – Data Engineering

This is a fully remote position, open to applicants in India.

📋 Description

• - **Design Scalable Pipelines:** Manage the architecture and implementation of extensive distributed data processing tasks utilizing PySpark on Amazon EMR clusters and serverless AWS Glue ETL jobs.

• - **Mentor and guide engineers:** Facilitate the development of technical abilities (particularly in Python and Spark optimization), best practices in data modeling, and advancements in their careers.

• - **Collaborate with stakeholders:** Work alongside engineering leadership to assess, strategize, and execute data-centric projects across advertising platforms, analytics services, and reporting functionalities.

• - **Lead through action:** Develop production-ready Python and PySpark code, conduct code reviews, and fine-tune Spark configurations to enhance performance and minimize costs. Implement Agile methodologies such as Scrum to promote iterative development, encourage team collaboration, and guarantee the continuous delivery of high-quality data solutions.

• - **Assist engineers:** Provide support through regular one-on-one meetings, constructive feedback, quarterly evaluations, recognition, and performance management.

⛳️ Requirements

• - Bachelor’s degree in Computer Engineering, Data Science, or equivalent practical experience.

• - Over 8 years of experience in technology, particularly concentrating on data engineering, data warehousing, or big data architecture.

• - At least 2 years of experience in leading a data engineering team.

• - **Proficiency in Python & PySpark:** Extensive experience in writing and optimizing distributed processing applications, managing data skew, and enhancing Spark memory management.

• - **Advanced AWS Skills:** Demonstrated success in managing Amazon EMR for robust processing tasks.

• - Familiarity with Big Data Infrastructure: Capable of constructing systems necessary for the efficient extraction, transformation, and loading of data from a diverse range of data sources using SQL and AWS ‘big data’ technologies (such as S3, EMR, Glue, Athena, and Lambda).

• - **Strong SQL capabilities** for complex transformations, performance optimization, and in-depth analytics.

• - **Experience with Orchestration:** High-level proficiency with Airflow and Git.

• - **AI-Driven Engineering:** Proven expertise in utilizing AI throughout the data engineering process to promote modernization, automate data quality evaluations, and improve delivery results.

• - Practical experience with AI-native tools such as Cursor, Claude, or GitHub Copilot for scaling data development.

🏝️ Benefits

• At GroundTruth, we aim for our employees to feel secure in their benefits so they can concentrate on their passions.

• - Parental leave for both maternity and paternity.

• - Flexible Time Off (including earned leaves, sick leaves, birthday leave, bereavement leave, and company holidays).

• - Daily in-office catered breakfast, lunch, snacks, and beverages.

• - Health coverage for any hospitalization, inclusive of both nuclear family and parents.

• - Telemedicine services for free doctor consultations, along with discounts on health checkups and medications.

• - Wellness/Gym reimbursement.

• - Reimbursement for pet expenses.

• - Coverage for childcare expenses and reimbursements.

• - Employee referral program.

• - Education reimbursement program.

• - Skill development initiatives.

• - Cell phone reimbursement (Mobile Subsidy program).

• - Internet reimbursement/Postpaid cell phone bill/or both.

• - Birthday treat reimbursement.

• - Employee Provident Fund Scheme providing various tax-saving options, including Voluntary Provident Fund and contributions from both employee and employer up to 12% of Basic.

• - Crèche reimbursement.

• - Co-working space reimbursement.

• - National Pension System employer matching.

• - Meal card for tax benefits.

• - Special benefits related to salary accounts.