
Senior Data Engineer
Posted 10 hours ago

Posted 10 hours ago
This is a fully remote position, open to applicants in United States.
• Design and develop scalable data ingestion pipelines utilizing AWS services and Azure DevOps.
• Create APIs and file-upload systems for client data ingestion.
• Construct data mapping and transformation workflows for loading into SQL Server client databases.
• Contribute to the architecture of a Databricks-based Lakehouse.
• Facilitate data flow from the SaaS platform to the analytical platform.
• Enhance ETL/ELT processes for improved performance and reliability.
• Collaborate with analytics teams to support reporting and machine learning applications.
• Provide operational support for ingestion processes integrated with C# .NET code and user interface.
• Diagnose and resolve issues within data pipelines across various environments.
• Partner with Software Engineers, Architects, and Product teams to align data solutions with business objectives.
• Enforce data governance, security, and compliance best practices in a multi-tenant setting.
• Document architecture, workflows, and operational procedures thoroughly.
• Assist in building and scaling the next-generation data platform, modernizing legacy ingestion and enhancing Databricks analytics capabilities.
• A Bachelor’s degree in Computer Science, Information Technology, or a related discipline is required.
• Over 7 years of experience in Data Engineering or a similar position.
• Extensive experience with AWS data engineering services, such as S3, Lambda, Glue, Step Functions, and API Gateway.
• Proficiency in Python and/or C# .NET for data processing and integration tasks.
• Practical experience with SQL Server and concepts related to relational databases.
• Familiarity with Databricks, Spark, and Lakehouse architectures.
• Understanding of ETL/ELT design patterns and data modeling techniques.
• Experience in creating APIs and file-based ingestion solutions.
• Strong analytical and problem-solving capabilities.
• Ability to work effectively as part of a cross-functional team.
• Exceptional communication and documentation skills.
• Experience in multi-tenant SaaS environments is advantageous.
• Preferred: experience with CI/CD pipelines for data workflows.
• Preferred: knowledge of data governance and security best practices within cloud settings.
• Preferred: familiarity with contemporary data integration tools and frameworks.
• Preferred: exposure to machine learning pipelines and real-time data processing.
• Eligibility for bonuses.
• Medical and dental coverage for employees, dependents, domestic partners, and spouses.
• Vision insurance.
• Short- and long-term disability insurance.
• Basic life insurance.
• Flexible paid time off and sick leave benefits (subject to state availability).
• 10 paid company holidays where applicable.
• Generous family leave policies, including for adoption and foster care placements.
• Flexible Spending Account.
• Health Savings Account.
• Commuter Benefits.
• Dependent Care Savings Account.
• 401(k) plan with company match up to 4%.
• Employee Assistance Program (EAP).
• Education Assistance Program for industry and role-specific certifications.
• Wellness reimbursement program.
• Pet Insurance.
• Critical Illness Insurance.
• Optional Life & AD&D coverage.
• Many full-time positions are eligible for complete remote work.
ASRC Federal
The Standard
VendueTech
Get handpicked remote jobs straight to your inbox weekly.