Software Engineer II, Big Data

This is a fully remote position, open to applicants in California.

📋 Description

• Design and build a resilient data infrastructure on AWS, utilizing Spark with Scala.

• Enhance our primary data pipelines to effectively accommodate our substantial growth.

• Store data in optimal engines and formats, aligning your designs with our performance requirements and cost considerations.

• Work collaboratively with our cross-functional teams to develop data solutions that fulfill business requirements.

• Create and implement knowledge graphs, making their functionality accessible through both Batch Processing and APIs.

• Utilize and optimize AWS resources while designing for scalability.

• Collaborate closely with our Data Science and Product teams.

⛳️ Requirements

• Experience in production data engineering.

• Proficiency in Spark and Scala.

• Background in delivering significant technical projects and developing reliable, large-scale services.

• Experience in creating APIs supported by relationship-intensive datasets.

• Knowledge of data lakes, cloud warehouses, and various storage formats.

• Strong expertise in AWS services.

• Advanced SQL skills for data manipulation and extraction.

• Excellent communication skills, both written and verbal.

• Bachelor's degree in Computer Science or a related discipline.

• Proven ability to leverage AI to enhance efficiency and quality in your daily workflow for relevant outputs.

• Strong history of critically evaluating and verifying AI-assisted work.

• High integrity and a sense of ownership.

🏝️ Benefits

• Competitive salary.

• Equity opportunities.