Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop comprehensive data pipelines and ETL/ELT processes.

• Create scalable data architectures utilizing medallion/multi-hop, data mesh, or lakehouse frameworks.

• Transition data infrastructure from on-premise or hybrid settings to AWS.

• Oversee and enhance AWS data services like Redshift, Glue, EMR, and Kinesis.

• Construct data-processing logic using Python, Pandas, PySpark, Polars, and advanced SQL.

• Automate data workflows through Airflow/MWAA and Step Functions.

• Implement Infrastructure-as-Code with Terraform/CloudFormation and CI/CD for data workloads.

• Design data architecture, storage solutions, and analytics platforms to support business insights.

• Collaborate with clients, as well as both technical and non-technical stakeholders, and team members.

• Present findings to clients and may conduct on-site client work and demonstrations.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related field (or equivalent practical experience).

• Over 6 years of professional experience in data engineering or a related area.

• Extensive knowledge of Snowflake, encompassing warehouse design, role-based access control, performance tuning, and cost optimization.

• Advanced skills with dbt for modular, tested, and version-controlled data transformations.

• Practical experience with Dagster for pipeline orchestration, asset management, and data observability.

• Proven experience in designing and implementing data pipelines, data storage solutions, and analytics platforms on contemporary cloud data stacks.

• Experience in migrating data pipelines and infrastructure to Snowflake from legacy warehouses, on-premise systems, or hybrid environments.

• Advanced proficiency in Python, with hands-on experience in Pandas, Polars, PySpark, or similar tools.

• Strong SQL capabilities across both analytical and transactional workloads.

• Experience with relational and/or columnar databases such as PostgreSQL, SQL Server, or Snowflake.

• In-depth understanding of data modeling, ETL/ELT processes, and data warehousing principles.

• Experience implementing medallion/multi-hop, data mesh, or lakehouse architectural patterns.

• Familiarity with Infrastructure-as-Code tools such as Pulumi or Terraform.

• Understanding of event-driven architectures and integrating orchestration platforms with cloud services.

• Strong Git version-control practices and experience in building CI/CD workflows such as GitHub Actions.

• Ability to translate business and technical requirements into production-ready, maintainable data pipelines.

• Excellent problem-solving and analytical skills.

• Ability to communicate effectively with both technical and non-technical stakeholders.

• Proactive in collaboration, mentoring, and enhancing the technical capabilities of the team.

• Experience in building and consuming RESTful APIs.

• Exposure to Docker is advantageous.

• Familiarity with data quality and observability tools such as dbt tests, Great Expectations, or Monte Carlo is preferred.

• Must be legally authorized to work in the country of employment without requiring sponsorship for employment visa status.

🏝️ Benefits

• Two comprehensive medical plans, including an HSA-eligible option.

• Dental and vision insurance.

• Company-paid Basic Life and AD&D Insurance.

• Company-paid Short-Term Disability (STD) coverage.

• Company-paid Long-Term Disability (LTD) coverage.

• Discounted employee-paid Voluntary Life and AD&D, Accident, Critical Illness, and Hospital Indemnity insurance.

• Pet Insurance.

• Legal Support and Identity Theft Protection plans.

• 401(k) plan with a company match of up to 3.5% and immediate vesting.

• Flex PTO for vacation, personal time, personal illness, or dependent care.

• Remote-friendly workplace.

• Professional development resources and funding for industry conferences and certifications.