This is a fully remote position, open to applicants in India.

• Design, develop, and support scalable data pipelines for both batch and real-time data processing.

• Create and enhance ETL/ELT workflows to gather, transform, and load data from diverse sources.

• Develop and uphold data models, data warehouses, and data lakes.

• Ensure data quality, consistency, accuracy, and reliability across all data pipelines.

• Optimize data processing workflows to enhance performance, scalability, and cost-effectiveness.

• Work with extensive and complex datasets sourced from various origins.

• Collaborate with Data Scientists and ML Engineers to prepare and deliver high-quality datasets for machine learning applications.

• Develop data integrations with APIs, databases, cloud platforms, and third-party systems.

• Monitor data pipelines and resolve issues related to data processing and infrastructure.

• Implement frameworks for data validation, monitoring, and testing.

• Maintain comprehensive documentation for data pipelines, data models, and technical procedures.

• Adhere to best practices for data security, governance, and access control.

• Contribute to the design and advancement of Hypersonix's data platform and architecture.

• 5–7 years of experience in Data Engineering or a comparable role.

• Strong programming capabilities in Python or an alternative programming language.

• Extensive experience with SQL and relational databases.

• Practical experience in constructing ETL/ELT pipelines and data workflows.

• Familiarity with data processing technologies such as Spark/PySpark.

• Experience with cloud platforms like AWS, Azure, or GCP.

• Solid understanding of data warehousing and data lake concepts.

• Experience with workflow orchestration tools such as Airflow, Dagster, or similar solutions.

• Experience working with distributed systems and large-scale datasets.

• Strong grasp of data modeling, database design, and performance enhancement.

• Familiarity with Git and CI/CD methodologies.

• Good understanding of software engineering principles and coding best practices.

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work options.

• Comprehensive health and wellness benefits.

• Opportunities for professional development and continuous learning.

• Collaborative and innovative work environment.

Data Engineer

People also viewed