Software Engineer, Data

This is a fully remote position, open to applicants in New York.

📋 Description

• Collaborate with technologies that ensure our data pipeline efficiently manages and computes data for over 7 million securities within our portfolio.

• Develop features that guarantee financial data is consistent, reliable, timely, and accurate by importing data from third-party providers and executing custom calculations, with daily focus on database load management, caching strategies, memory efficiency, and query optimization.

• Write code (and unit tests!) using Python and the Django framework to implement intricate backend functionalities.

• Utilize tools such as Airflow to construct and enhance financial data pipelines for more than 7 million securities.

• Leverage pandas and asynchronous task tools like Celery to efficiently compute over 4,000 unique data points for each security.

• Profile and optimize database queries — analyze query plans, devise effective indexes, and eliminate N+1 issues and slow paths that falter under production load.

• Manage database load — assess read/write patterns, connection usage, replica strategy, and batching to maintain a healthy data tier as volume increases.

• Design and fine-tune caching layers to minimize redundant computation and database strain while ensuring data remains fresh and accurate.

• Create robust, scalable data models that consider the structure, type, and volume of data to be stored, as well as how it will be queried.

• Investigate and resolve performance regressions and incidents — utilizing metrics, profiling, and monitoring to identify root causes.

• Design, plan, estimate, and ticket features that are defined by our product team.

• Conduct code reviews for fellow engineers on the team.

• Document your work both in the repository and externally for the benefit of future engineers.

• Collaborate with other engineers, both verbally and in writing, to plan, design, and develop a world-class financial research platform.

⛳️ Requirements

• A minimum of 2 years of relevant industry or academic experience.

• Proficiency in Python (knowledge of the Django framework is a plus).

• Experience in designing, building, and maintaining backend application features.

• Familiarity with relational databases, including writing and optimizing queries and understanding indexing and query performance.

• Experience participating in multi-month projects from conception to maintenance, collaborating with multiple team members.

• Knowledge of caching and strategies for managing database and memory load at scale is a plus.

• Experience working with large datasets and an interest in the associated performance and efficiency challenges.

• A desire to take ownership and accountability when problems or opportunities arise.

• Experience collaborating with non-technical teams (product, business, etc.) where explaining technical concepts is necessary.

• Self-organized and capable of working independently.

🏝️ Benefits

• 100% employer-paid health, dental, and vision insurance.

• 401(k) match to support your financial future.

• Opportunities for internal mobility and cross-functional collaboration.

• Flexible time off, including vacation days, sick days, and a celebration day.

• Paid parental leave to promote work-life balance.

• Professional development stipend to assist in your career growth.

• Hybrid work schedule with the flexibility to work both in-office and remotely.

• Summer hours to allow for more time in the sun.

• Recognition programs to acknowledge contributions and milestones.

• Modern, centrally located offices equipped with premium snacks, coffee, beverages, and weekly lunch credits to energize your day.

• Regular team events, celebrations, and company-wide gatherings to sustain our connected and collaborative culture.