Data Platform Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and develop a scalable data platform suitable for both batch and streaming applications.

• Establish data catalog and data lineage functionalities.

• Design and implement strong data security frameworks and controls.

• Develop low-latency services tailored for streaming and near-real-time scenarios.

• Facilitate real-time decision-making for dynamic oddsmaking, risk assessment, and intelligent deposit defaults.

• Advocate for best practices in model deployment, monitoring, and CI/CD for data pipeline implementation.

• Ensure comprehensive observability for both batch and streaming data platforms.

• Maintain a platform availability of 99.99%.

⛳️ Requirements

• Over 3 years of experience in Platform Engineering with a focus on deploying and maintaining scalable data platforms in high-traffic production settings.

• Expertise in streaming architectures such as Kafka, Flink, and PubSub.

• Capability to build low-latency services for stream ingestion and processing, achieving model inference in under 100ms.

• Proficient in containerization technologies, including Docker and Kubernetes, along with cluster-level management.

• Extensive experience overseeing the complete data lifecycle and establishing data exploration environments.

• Advanced coding abilities in Python and Go.

• Significant experience with cloud services, ideally GCP services (BigQuery, Cloud Functions, GKE) or their AWS counterparts.

• Broad experience with big data technologies like Spark, Flink, Kafka or Kinesis, Argo/Airflow, Polaris, OpenMetadata, Iceberg, Lakehouse, Redis, Elasticsearch, and various databases.

• Experience in developing REST APIs, managing packages, and utilizing libraries.

• Key involvement in projects throughout the entire development lifecycle, from initial concept to final release.

• Strong communication, stakeholder management, and problem-solving abilities.

• Authorization to work for any employer in the U.S. is required; employment visa sponsorship is not available.

• Noteworthy qualifications include infrastructure implementation, experience in Daily Fantasy Sports/oddsmaking/high-frequency trading, scalability of batch and real-time data platforms, enabling data-team self-service, and experience with AI agents or AI coding.

🏝️ Benefits

• Company-subsidized medical, dental, and vision plans.

• 401(k) plan with company matching.

• Annual bonus opportunities.

• Flexible PTO to promote a healthy work-life balance (2 weeks STRONGLY encouraged!).

• Generous paid leave programs, including a 16-week paid parental leave and disability benefits.

• Workplace flexibility and modern work schedules focused on outcomes rather than hours worked.

• Company-wide in-person events and team outings.

• Lifestyle enhancement program.

• Company-provided equipment (Windows and Mac options available).

• Annual performance evaluations with opportunities for career growth and development.