Staff Software Engineer – Data

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and maintain large-scale distributed data systems that facilitate real-time and near real-time analytics and data-driven applications across PlayStation.

• Spearhead the architecture and advancement of the Real-Time Analytics Platform’s streaming and analytics systems.

• Manage platform functionalities comprehensively, from architecture and implementation to production operations, performance enhancement, reliability, and lifecycle management.

• Construct and refine distributed data services utilizing Apache Flink, Spark Structured Streaming, ClickHouse, and Apache Druid.

• Combine batch and streaming workloads using contemporary lakehouse models.

• Develop AI-enhanced features to automate engineering tasks, elevate data quality, streamline platform operations, expedite troubleshooting, and boost developer efficiency.

• Set technical standards and engineering best practices for distributed systems, stream processing, data modeling, query optimization, and platform reliability.

• Guide engineers through architecture, design, and code evaluations.

• Collaborate with Product, Infrastructure, Security, Data Engineering, and Platform Engineering teams on technical strategy and scalable platform capabilities.

• Investigate and tackle intricate production issues, ensuring high availability and operational excellence.

• Engage in production support and on-call rotations, lead incident response efforts, conduct root-cause analyses, and implement reliability enhancements.

• Assess emerging technologies and distributed data platforms, recommending investment opportunities.

• Direct roadmap initiatives, shape technical direction, and mentor engineers during the initial 90 days.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline, or equivalent practical experience.

• Over 8 years of experience in designing and constructing large-scale distributed systems, with a focus on real-time data processing, analytics, or data platform engineering.

• High proficiency in Python.

• Familiarity with Scala is advantageous for supporting and enhancing existing platform components.

• Practical experience in designing and operating large-scale stream processing applications using Apache Flink, Apache Spark Structured Streaming, or similar distributed streaming technologies.

• Production experience in designing, operating, and optimizing distributed analytics platforms using ClickHouse, Apache Druid, or comparable high-performance OLAP/analytics databases.

• Proficient in query optimization, data modeling, and performance tuning at scale.

• Experience in constructing and utilizing event-driven data pipelines via AWS MSK, Apache Kafka, or equivalent messaging platforms.

• Experience in applying AI/ML methodologies and contemporary AI tools.

• Strong systems design capabilities focused on scalability, latency, throughput, consistency, reliability, and cost.

• Proven technical leadership through architecture ownership, mentoring engineers, and influencing technical decisions across various teams.

• Background checks at the offer stage for all new hires.

🏝️ Benefits

• Medical insurance

• Dental insurance

• Vision insurance

• Matching 401(k)

• Paid time off

• Wellness program

• Employee discounts for Sony products

• Eligibility for a bonus package

• Hybrid working policy