Senior Data Engineer

This is a fully remote position, open to applicants in New York, +1 more state.

📋 Description

• Design, build, and sustain production-quality data platforms and scalable ELT/ETL pipelines.

• Ingest, transform, and model intricate structured and unstructured scientific and clinical datasets.

• Establish data architecture patterns, engineering standards, and best practices across the team.

• Work alongside scientists, ML engineers, and business stakeholders to convert domain needs into data solutions.

• Create data infrastructure that supports machine learning training, inference, and analytics workloads.

• Ensure data quality, lineage, reproducibility, security, and system observability.

• Enhance pipeline performance, address architectural bottlenecks, and improve infrastructure cost efficiency.

• Engage in technical design discussions, code reviews, and architectural decision-making.

⛳️ Requirements

• Over 5 years of experience in data engineering, data platform engineering, or data-intensive software engineering.

• Advanced professional proficiency in Python and SQL.

• Significant experience in designing and managing production-grade distributed data architectures.

• Solid grasp of ETL/ELT patterns, data modeling, orchestration, and data observability.

• Strong foundation in software engineering principles, including testing, CI/CD, version control, and system design.

• Experience in managing large, complex, and heterogeneous datasets within cloud environments.

• Ability to work autonomously, navigate technical ambiguity, and take ownership of deliverables.

• Familiarity with cloud platforms (AWS, GCP, or Azure) and technologies like Spark, Databricks, Snowflake, or BigQuery (bonus points).

• Experience with workflow orchestrators such as Apache Airflow, Dagster, or Prefect (bonus points).

• Domain knowledge in life sciences, clinical trials, genomics, or drug discovery datasets (bonus points).

• Exposure to data governance, lineage, or working in regulated data environments (bonus points).

🏝️ Benefits

• Competitive salary with travel expenses reimbursed when travel is necessary.

• Flexible work arrangements (Hybrid in Indianapolis, IN, or Fully Remote for U.S. East Coast with occasional travel).

• Opportunities for dynamic career growth through innovative, high-impact enterprise projects.

• Long-term independent contractor agreement.