Data Engineer

This is a fully remote position, open to applicants in New York.

📋 Description

• Integrate data sets from multiple source systems into standardized formats

• Execute ELT (Extract, Load, Transform) operations

• Clean and transform data by applying established business rules

• Perform data cleansing and validation tasks

• Monitor and resolve data-related issues

• Create and sustain conceptual, logical, and physical data models

• Develop and manage data pipelines

• Load processed data into analytical data repositories

• Oversee the performance and quality of data transfers

• Integrate testing suites into CI/CD pipelines

• Enhance data flows for efficiency, scalability, and reliability

• Collaborate with team members to gather and clarify requirements

⛳️ Requirements

• Bachelor’s degree in information systems, Computer Science, Engineering, or a related field, or an equivalent combination of education and training

• 6-8 years of relevant experience

• Proficiency in SQL and data pipeline tools (e.g., Fabric, Azure Data Factory)

• Expertise in data quality within a Big Data environment in the cloud for Enterprise Data Lake (Azure or similar), Data Warehouse (Azure Synapse or similar), and Data Hubs (Azure Cosmos DB or similar)

• Strong comprehension of ETL processes and data warehousing principles

• Experience with DevOps toolsets (Azure DevOps or similar)

• Familiarity with QA methodologies (e.g., Agile, Scrum)

• Excellent verbal and written communication abilities

• Experience in data modeling and metadata management

• Understanding of data quality frameworks and validation techniques

🏝️ Benefits

• Medical, vision, dental, life, and disability insurance

• 401(k) plan with a 6% employer match per pay period

• Flexible paid time off

• 11 paid holidays each year