Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Enhance and optimize data and data pipeline architecture.

• Monitor, troubleshoot, and fine-tune the performance of data flows utilized for data collection, integration, and provisioning.

• Design, implement, and sustain a robust, efficient, and compliant data pipeline architecture.

• Identify and execute process improvements, including automation, optimization of data delivery, and redesign of infrastructure for scalability.

• Construct and maintain a service-based architecture for disseminating consumable data and information objects.

• Collaborate with data architects and data analysts to improve and develop the data environment.

• Assist Business and IT stakeholders with data-related technical challenges and information needs.

• Establish frameworks, guidelines, best practices, and examples for creating accurate, compliant, and secure data structures and integration processes.

• Facilitate the development and implementation of enterprise data quality and data protection standards.

• Define performance indicators and quality metrics, ensuring adherence to data-related policies and standards.

• Participate in an on-call rotation to monitor, troubleshoot, and resolve data integration alerts and failures.

• Work in collaboration with software development teams, database architects, data analysts, and end users on complex data initiatives.

⛳️ Requirements

• Minimum of 5 years of Data Engineering experience in a supervisory role.

• Extensive domain-specific experience within the Financial Services industry.

• Familiarity with Microsoft cloud-based technologies in a hybrid architecture.

• Advanced proficiency in TSQL and experience with relational databases, query authoring, stored procedure development, and comprehensive data pipeline development.

• Experience in conducting operational analysis on internal and external data and processes.

• Strong analytical skills related to complex, multi-layered data pipelines and dependent datasets.

• Experience in facilitating discussions to gather end-user requirements from both technical and non-technical audiences.

• Knowledge of data preparation, metadata, dependencies, lineages, compliance, and workload management.

• Understanding of conceptual, logical, relational, dimensional, and multi-dimensional data modeling.

• Comprehension of meta-model and metadata management requirements.

• Extensive experience with SQL syntax.

• Experience in designing and implementing data structures and interfaces for applications and business processes.

• Familiarity with Microsoft Fabric, including pipelines, notebooks, Lakehouse/Warehouse concepts, and Medallion architecture.

• Experience with relational database platforms, preferably MS SQL Server.

• Proficient in SSIS and Azure Integration Services.

• Experience with orchestration tools such as ActiveBatch.

• Knowledge of web services and API integrations.

• Proficiency in Python and PowerShell.

• Familiarity with Agile, DevOps, and DataOps methodologies and technologies.

• Dedication to client confidentiality and data security.

• Clear, service-oriented communication using appropriate professional language and grammar.

• Ability to proactively engage with external and internal clients.

• Capacity to maintain regular, predictable attendance.

🏝️ Benefits

• Medical, Dental, and Vision coverage.

• Company 401(k) and ESOP contributions.

• Generous sick leave, vacation, and maternity/parental leave.

• Paid holidays.

• Opportunities for Professional Development.

• Tuition Reimbursement (up to a $15,000 lifetime cap).

• Discounted personal insurance including home, auto, and recreational vehicles.

• Charitable gift-matching program.

• Davidson Day of Giving.