Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and take complete ownership of the data infrastructure that supports our investment operations.

• Manage the entire data lifecycle, including ingestion, transformation, warehousing, analytics, and machine learning.

• Architect ETL/ELT pipelines orchestrated by Apache Airflow (AWS MWAA).

• Construct and optimize a Snowflake data warehouse utilizing data from S3 data lakes.

• Create analytical models and dashboards that convert raw data into actionable insights.

• Drive the evolution of our data infrastructure from manual processes to scalable, governed, automated data systems.

• Replace manual file transfers with event-driven Airflow DAGs and AWS Lambda functions.

• Define all cloud infrastructure using Terraform or AWS CDK.

• Develop clean, governed, and accessible datasets that support AI agents and intelligent automation.

⛳️ Requirements

• Over 5 years of professional experience in Python development, with a strong grasp of object-oriented design and data manipulation libraries (pandas, NumPy).

• Familiarity with financial research data vendors and feed/API products such as CapIQ Xpressfeed, FactSet, Bloomberg, Thomson Reuters/Refinitiv/LSEG, Russell, or MSCI.

• Understanding of financial business data and feed/API products from Broadridge, Morningstar, and custodian banks as well as fund administrators.

• Proven expertise in designing and managing ETL/ELT pipelines, with experience in Apache Airflow and Lambda considered a plus.

• In-depth knowledge of Snowflake architecture (including clustering keys, micro-partitions, Snowpipe, and Stages), with the ability to write complex analytical SQL, window functions, CTEs, and recursive queries, optimizing them for cost and performance.

• Practical experience with AWS CDK or Terraform; you define infrastructure as code rather than through the AWS Console.

• Exposure to LLM integration patterns, including markdown files and prompt engineering. Experience with RAG, knowledge bases, and embeddings is advantageous.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work options.

• Opportunities for professional development and continuous learning.

• Comprehensive health and wellness benefits.

• A collaborative and innovative work environment.