Data Engineer, Databricks

This is a fully remote position, open to applicants in Canada, +1 more country.

📋 Description

• Create data products that drive the Fluent Audience Solutions business by converting raw survey and behavioral data into declared and modeled audiences.

• Design tables, views, jobs/pipelines, and orchestration within the Databricks environment.

• Adhere to Fluent’s best practices for data modeling and architecture.

• Enhance standards for testing, code repository management, CI/CD, and naming conventions.

• Develop and sustain pipelines that deliver both syndicated and custom audience segments.

• Assist in the delivery and performance tracking of completed segments on platforms like LiveRamp, TruAudience (TransUnion), and Lotame.

• Explore and utilize Databricks capabilities for real-time processing and operational workloads, including Spark Structured Streaming and Lakeflow Declarative Pipelines.

• Ensure a high-quality codebase with data observability, adherence to metadata standards, best practices, and compliant consumer-data handling.

• Implement AI-assisted development techniques using tools like Claude Code for pipeline creation, testing, and documentation.

• Collaborate with Data Engineering, Data Science, and commercial stakeholders to clarify business requirements and translate them into functional specifications.

• Monitor emerging technologies and trends within the Databricks ecosystem.

• Share knowledge through informal presentations and tech discussions, promoting engineering best practices.

• Provide internal teams with updates on architecture, execution strategies, releases, and training opportunities.

⛳️ Requirements

• Bachelor’s or Master’s degree in computer science or a related discipline.

• Over 4 years of professional experience in Data Engineering, with strong proficiency in SQL, Python, Spark, and distributed processing.

• At least 2 years of experience working in the Databricks environment, utilizing Jobs & Workflows, Notebooks, Unity Catalog, and Delta Lake.

• Solid foundation in database design, data structures, and algorithms.

• Experience with AI coding assistants, such as Claude Code or GitHub Copilot, as part of a contemporary engineering process.

• Preferred: Familiarity with emerging Databricks technologies and recent offerings like Genie, Lakebase, AI/BI Dashboards, and Databricks Apps.

• Preferred: Previous experience in digital marketing, ad-tech, media/advertising, or a related field.

• Preferred: Knowledge of audience, identity, or consumer segmentation data.

• Preferred: Experience with data marketplaces such as LiveRamp, TransUnion, and/or Lotame.

• Fluent participates in the E-Verify Program and complies with applicable federal work authorization regulations.

🏝️ Benefits

• Competitive salary.

• Extensive opportunities for career and professional advancement.

• New headquarters featuring an open floor plan to foster collaboration.

• Health, dental, and vision insurance coverage.

• Pre-tax savings plans along with transit and parking programs.

• 401K plan with a competitive employer matching contribution.

• Volunteer and philanthropic initiatives throughout the year.

• Educational and social events.

• Fully stocked kitchen.

• Catered breakfasts and lunches.

• Engaging events filled with activities.

• Recreational sports leagues.

• Networking opportunities with She Runs It.

• Quarterly outings to baseball games, fine dining experiences, and pizza-making classes.

• Chance to work for a high-performing marketing company.