
Data Engineer
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in United States.
• Responsible for designing and executing scalable data ingestion pipelines utilizing AWS services such as S3, Lambda, API Gateway, Glue, and Step Functions.
• Develops APIs and mechanisms for file uploads to facilitate client data ingestion.
• Creates data mapping and transformation workflows for integration into SQL Server client databases.
• Participates in the design and execution of a lakehouse architecture using Databricks.
• Ensures smooth data transitions from the SaaS platform to the analytical platform.
• Enhances ETL/ELT processes for improved performance and reliability.
• Works in collaboration with analytics teams to guarantee data availability and quality for reporting and machine learning purposes.
• Offers operational support for current ingestion processes embedded within C# .NET code and user interface.
• Diagnoses and resolves issues within data pipelines across various environments.
• Collaborates closely with Software Engineers, Architects, and Product teams to ensure data solutions meet business objectives.
• Applies best practices for data governance, security, and compliance within a multi-tenant framework.
• Maintains documentation for architecture, workflows, and operational procedures.
• Bachelor’s degree in Computer Science, Information Technology, or a related discipline is required.
• Minimum of 3 years of experience in Data Engineering or similar roles.
• Extensive experience with AWS services pertinent to data engineering, including S3, Lambda, Glue, Step Functions, and API Gateway.
• Proficient in Python and/or C# .NET for data processing and integration tasks.
• Practical experience with SQL Server and relational database principles.
• Familiarity with Databricks, Spark, and lakehouse architectures.
• Understanding of ETL/ELT design patterns and data modeling techniques.
• Experience in developing APIs and solutions for file-based data ingestion.
• Exposure to multi-tenant SaaS environments is advantageous.
• Strong analytical and problem-solving capabilities.
• Ability to work effectively as part of a cross-functional team.
• Excellent communication and documentation skills.
• Medical and Dental coverage is available for employees, their dependents, domestic partners, and spouses.
• Paid Time Off – Flexible options plus 10 paid company holidays when applicable.
• Fully covered by Origami Risk – Vision insurance, Short & Long-Term Disability Insurance, and Basic Life Insurance.
• Generous family leave options, including for adoption and foster care placements.
• Pre-Tax Savings Accounts – Flexible Spending Account, Health Savings Account, Commuter Benefits, and Dependent Care Savings Account.
• Retirement Savings – 401(k) with company match up to 4%.
• Employee Assistance Program (EAP) – Confidential and free support for colleagues dealing with personal or work-related challenges.
• Education Assistance Program – To help colleagues obtain industry-specific certifications and training.
• Wellness Benefits – Reimbursement program aimed at encouraging healthy habits and enhancing colleague productivity and stress management.
• Additional coverages available – Pet Insurance, Critical Illness Insurance, and Voluntary Life & AD&D coverage.
Bixal
Vigil
Get handpicked remote jobs straight to your inbox weekly.