Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Develop and sustain data infrastructure that supports reporting, analytics, and data science efforts.

• Design and manage data pipelines on AWS utilizing Redshift, EC2, EMR/Spark, S3, Lambda, Glue, and associated services.

• Oversee the data and analytics ecosystem from ingestion and ETL to the creation of aggregate tables.

• Create and enhance internal data pipeline processes through automation, optimization, and infrastructure redesign.

• Write scripts for scheduling data ingestion and synchronization tasks.

• Implement backend functionalities to establish data marts for stakeholder self-service capabilities.

• Collaborate with data architects to develop metrics-as-code frameworks and improve data search and retrieval efficiency.

• Diagnose and resolve issues in production data jobs and processes, address data quality challenges, and enhance pipeline performance.

• Construct complex datasets with multidimensional relationships to meet both functional and non-functional business requirements.

• Develop system integrations to facilitate smooth data flow.

• Work alongside business stakeholders, data architects, and fellow data team members.

• Utilize AI responsibly while ensuring ownership of outputs, mastering the codebase, and preventing software bloat.

⛳️ Requirements

• Bachelor's degree or higher in a quantitative or technical discipline (e.g., Computer Science, Statistics, Engineering) or equivalent experience.

• Over 5 years of experience in data engineering, database engineering, business intelligence, or business analytics.

• More than 5 years of SQL expertise for reporting and transformation, including Redshift, MySQL, PostgreSQL, Snowflake, or Databricks.

• At least 4 years of Python experience, including class development, in a Git-managed CI/CD team development setting.

• A minimum of 4 years of experience in schema design and dimensional data modeling.

• Proficiency with Data Lake architectures and the integration of structured and unstructured data into cohesive models.

• Experience with API design and the development of RESTful web services.

• Capability to define and adhere to a long-term vision, independently diagnose issues, and work with code, data, and logs.

• Strong analytical skills to structure and process qualitative data and derive meaningful insights.

• Familiarity with data science and machine learning (a plus).

• Experience with GIS (a plus).

• Data visualization experience with tools such as Tableau (a plus).

• Familiarity with JIRA (preferred).

• A strong interest in understanding business strategy and the role of data engineering in achieving organizational objectives.

🏝️ Benefits

• Remote work arrangement as detailed in the description.

• Travel required is less than 5%.