Lead Engineer, Data

This is a fully remote position, open to applicants in India.

📋 Description

• Develop, maintain, and implement ELT/ETL pipelines along with database architectures.

• Collaborate effectively with fellow developers within the team.

• Work alongside internal technology teams to comprehend and assist in the execution of database and data transformation needs.

• Design and construct data structures at all phases of the data lifecycle (raw, refined, analytics/report ready).

• Sustain and enhance existing data structures across all stages of the data lifecycle (raw, refined, analytics/report ready).

• Create ELT/ETL Python scripts to extract data from various systems.

• Validate data and transformations throughout the complete data lifecycle.

• Investigate data discrepancies to identify root causes and determine appropriate actions.

• Incorporate emerging data management and software engineering technologies into current data structures.

• Document data lineage, transformations, business logic, calculations, and maintain a data dictionary.

• Provide guidance on automated data quality assurance checks throughout the data lifecycle.

• Ensure all systems adhere to business/company requirements as well as industry standards.

• Collaborate with team members to achieve project deliverables and objectives.

• Install and update disaster recovery protocols.

• Suggest various methods to continually enhance data reliability and quality.

• Mentor and train team members on best practices, techniques, and programming languages.

⛳️ Requirements

• Over 6 years of experience in Python programming utilizing packages such as numpy, pandas, etc.

• Significant experience with Python in event-driven programming.

• Proficient in using Python lists, classes, and dictionaries to create modules/functions.

• Experience in analyzing, mapping, and connecting with data from various source systems.

• Strong background in building and maintaining ETL/ELT pipelines using Python.

• Extensive experience with Postgres and PSQL for writing data transformations and structures.

• Excellent communication skills, capable of collaborating with non-technical stakeholders.

• Experience in an Agile environment, particularly within a Scrum team.

• Strong understanding of concepts or experience with ETL and ELT, data pipelines, data warehousing, data marts, Kimball vs. Inmon architecture patterns, TDD, source control, CI/CD, and DevOps.

🏝️ Benefits

• Flexible work environment.

• Fluid career trajectories.

• Focus on purpose, well-being, and work-life balance.

• A welcoming and inclusive workplace.

• Opportunities for volunteering.