Data Integration Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, test, deploy, and support ETL/ELT processes along with data integration solutions.

• Construct and maintain data pipelines that gather information from internal applications, vendors, APIs, and third-party financial systems.

• Create reusable integration frameworks and patterns to enhance scalability and maintainability.

• Support batch processing, near real-time, and event-driven data integration architectures.

• Diagnose and resolve issues related to data flow, performance, and reliability.

• Implement controls to ensure data accuracy, completeness, and consistency.

• Assist with data lineage, metadata management, and data governance initiatives.

• Engage in regulatory and audit-related data validation efforts.

• Help establish standards for secure and compliant data movement.

• Monitor production workflows and address operational challenges.

• Optimize SQL queries, integration jobs, and data pipelines for enhanced performance.

• Take part in release, deployment, and change management processes.

• Maintain thorough documentation for integration processes, data mappings, and technical designs.

• Gather and analyze data requirements in collaboration with business users.

• Collaborate with data architects and senior engineers on enterprise data initiatives.

• Provide reliable, well-structured datasets for analysts and reporting teams.

• Engage in Agile planning, code reviews, testing, and continual improvement activities.

⛳️ Requirements

• 3-5 years of experience in Data Engineering, Data Integration, or ETL development.

• Proven experience supporting production data integration environments.

• Familiarity with Microsoft cloud-based technologies in a hybrid architecture.

• Experience with cloud services, specifically Microsoft Azure and AWS.

• Advanced TSQL knowledge with experience in relational databases, query authoring, stored procedure development, and comprehensive data pipeline development.

• Proficient in ETL/ELT platforms such as SSIS, Azure Data Factory, and Microsoft Fabric Data Pipelines.

• Experience with API and file-based integrations.

• Knowledge of relational database platforms, preferably Microsoft SQL Server.

• Proficiency in scripting languages such as Python, PowerShell, and DiamondPlate.

• Experience with orchestration platforms like ActiveBatch or similar scheduling tools.

• Familiarity with Git, CI/CD, DevOps, and DataOps methodologies.

• Understanding of dimensional modeling, data warehousing, and data governance principles.

• Knowledge of database security, backup and recovery, and performance monitoring standards.

• Familiarity with Agile work methodologies.

• Understanding of software and database development life cycle concepts.

• Awareness of information sensitivity regulations and best practices for data security and confidentiality.

• Extensive experience with SQL syntax.

• Experience with Microsoft Fabric pipelines, notebooks, Lakehouse/Warehouse concepts, and Medallion architecture.

• Experience with web services and API integration.

• Familiarity with Agile, DevOps, and DataOps practices and technologies.

• Experience collaborating with vendors and third-party data integrations.

• MCSE/MCSA certifications are preferred.

• Experience in the financial services sector, including banking, wealth management, brokerage, insurance, or other regulated industries is preferred.

🏝️ Benefits

• Medical, Dental, and Vision coverage.

• Company 401(k) and ESOP contributions.

• Generous sick leave, vacation, and maternity/parental leave.

• Paid holidays.

• Opportunities for professional development.

• Tuition reimbursement with a lifetime cap of $15,000.

• Discounted personal insurance, including home, auto, and recreational vehicles.

• Charitable gift-matching program.

• Davidson Day of Giving.