Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and maintain scalable data pipelines utilizing Python, Spark, and Airflow to enhance our core data acquisition and entity resolution engines.

• Work collaboratively across AI/ML and Product teams to implement innovative features and AI-driven products.

• Proactively identify and troubleshoot bottlenecks in our intricate ETL processes, bringing a new perspective to refine and optimize our existing codebase.

• Contribute to a strong engineering culture through thorough code reviews, unit testing, and effective communication of design decisions.

• Manage the complete delivery of roadmap tasks within two-week sprints, ensuring that work adheres to high standards of quality, documentation, and performance.

• Engage in roadmap planning and story refinement, ultimately taking ownership of significant epics that bolster our long-term product defensibility.

⛳️ Requirements

• Professional competency in Python and experience contributing to shared codebases via Git (branching, pull requests, code reviews).

• Over 3 years of experience in Data Engineering.

• Proven experience with relational databases (PostgreSQL/BigQuery) and an interest in or familiarity with graph databases.

• Understanding of distributed computing (Spark) or a strong desire to learn it.

• Excellent collaboration skills and the ability to function effectively in an Agile, sprint-based environment.

• A self-directed mindset: capable of progressing tasks from "assigned" to "complete" with high autonomy and clear communication.

• Experience with Django, Scala, or Scrapy.

• Practical experience with workflow orchestration tools such as Airflow.

• Experience or a strong interest in LLM tuning, deployment, and best practices in AI engineering.

• Experience working with international or non-English datasets.

• Previous experience managing high-scale, complex data pipelines.

🏝️ Benefits

• 100% fully covered medical, vision, and dental insurance for employees and their dependents.

• Generous time off; we recognize all US federal holidays, close our office for a winter break (12/24-12/31), in addition to offering 18 PTO days and 10 sick days.

• Exceptional compensation package; competitive commissions for revenue roles and bonuses for non-revenue positions.

• A strong commitment to diversity, equity, and inclusion.

• Eligibility for additional benefits such as a 401k match up to 5%, fully paid life insurance (up to $100,000 coverage), and parental leave.

• A collaborative and positive culture - your team will be as intelligent and driven as you are.

• Unlimited growth and learning opportunities.