Senior Software Engineer, Big Data

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and manage extensive data pipelines.

• Gather, consolidate, and evaluate data at scale using continuous and incremental development practices.

• Architect and advance the data pipeline to accommodate greater volumes through cloud data warehouses.

• Integrate additional data sources.

• Extract new features from current data.

• Enhance the rating algorithm.

• Partner with data science and research teams.

• Establish trust with customers regarding the quality and integrity of data.

• Collaborate with a cohesive engineering team across various locations.

• Contribute to the wider engineering team through effective generalist problem-solving and collaboration.

⛳️ Requirements

• Previous experience in constructing and managing large-scale data pipelines.

• Strong expertise in modern Java programming.

• Solid computer science fundamentals in design, data structures, and algorithms.

• Experience collaborating with a team of engineers, designers, and product owners to deliver a product to end-users.

• Excellent written and verbal communication skills in English.

• Preferred experience with Python.

• Preferred familiarity with Hadoop and Spark ecosystems.

• Preferred experience with Data Lakehouse technology stack, such as Apache Iceberg.

• Preferred knowledge of Elasticsearch or OpenSearch.

• Preferred experience with CI/CD and Kubernetes.

• Preferred experience with modern AI development tools, such as GitHub Copilot, Cursor, or LLMs.

• Preferred background in the IT security field.

• Must reside in the United States.

🏝️ Benefits

• Eligibility for bonus or commission plans.

• Equity grant.

• Medical insurance.

• Dental insurance.

• Vision insurance.

• Paid parental leave.

• Flexible time off.

• 401(k) plan with opportunities for employee and company contributions.

• Life insurance.

• Disability insurance.

• Tuition reimbursement.

• Reasonable accommodations for qualified individuals with disabilities or sincerely held religious beliefs.