Staff Data Platform Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop PrizePicks’ advanced Data platform catering to both batch and streaming requirements.

• Create and sustain data catalog and data lineage functionalities.

• Engineer a comprehensive data platform that enhances automation and scalability while implementing strong data security frameworks and controls.

• Develop infrastructure for deploying low-latency services that cater to streaming and near-real-time scenarios.

• Facilitate real-time decision-making across sports betting and daily fantasy environments, including dynamic oddsmaking, risk assessment, and intelligent deposit defaults.

• Advocate for best practices in model deployment, monitoring, and CI/CD processes for data pipeline implementation.

• Ensure full observability for both batch and streaming data platforms while achieving 99.99% uptime.

• Collaborate with Product, Backend Engineering, Data Engineering, and Data Science teams to implement intricate data engineering and data science functionalities.

⛳️ Requirements

• Over 8 years of experience in Platform Engineering, demonstrating a successful history of deploying and managing scalable Data platforms in high-traffic production settings.

• Skilled in streaming architectures (Kafka/Flink/PubSub) and in creating low-latency services for stream ingestion and processing that support model inference in under 100ms.

• Proficient in Containerization, Docker, Kubernetes, and cluster-level management.

• Significant experience with Big data technologies including Spark, Flink, Kafka or Kinesis, Argo/Airflow, Polaris, OpenMetadata, Iceberg, Lakehouse, Redis, Elasticsearch, and databases.

• Experience in developing REST APIs, managing packages, and creating libraries.

• Extensive experience in building a platform that manages the complete Data lifecycle, including establishing a data exploration environment.

• Expertise in programming with Python and Go.

• In-depth experience with Cloud services, preferably with GCP services (BigQuery, Cloud Functions, GKE) or their AWS counterparts.

• Strong communication abilities, stakeholder management skills, and exceptional problem-solving capabilities.

• Proven track record as a key contributor throughout the entire development lifecycle from concept to launch.

• Must be eligible to work for any employer in the U.S.; visa sponsorship is not available.

• Experience in implementing data platform infrastructure while adhering to best practices for deploying large-scale data platforms.

• Designed and constructed scalable, fault-tolerant data storage, distributed processing systems, and extensive data lakes using technologies like Apache Spark, Flink, Trino, Presto, or Kafka.

• Developed internal tools for data pipeline creation, orchestration, and AI-assisted analytics.

• Established protocols and tools for data quality, compliance, lineage, and secure access control.

• Enabled self-service capabilities for Data teams regarding pipeline development and deployment.

• Background in Daily Fantasy Sports (DFS), oddsmaking, high-frequency trading, or similar domain expertise.

🏝️ Benefits

• Company-subsidized medical, dental, & vision plans.

• 401(k) plan with company matching.

• Annual bonus opportunities.

• Flexible PTO to promote a healthy work/life balance (2 weeks STRONGLY encouraged!).

• Generous paid leave programs, including 16-week paid parental leave and disability benefits.

• Workplace flexibility and modern work schedules focused on results rather than hours logged.

• Company-wide in-person events and team outings.

• Lifestyle enhancement program.

• Company-provided equipment (Windows & Mac options).

• Annual performance reviews with opportunities for growth and career advancement.