Senior Data Engineer

This is a fully remote position, open to applicants in Florida, +2 more states.

📋 Description

• Construct and sustain data pipelines and datasets that facilitate reporting, visualization, machine learning, and data-driven decision-making across various business areas, including finance, sales, supply chain, and marketing.

• Design and uphold scalable data pipelines and reusable datasets within a Databricks lakehouse environment.

• Ingest, validate, cleanse, and transform both structured and unstructured data from diverse sources utilizing Python, PySpark, and SQL.

• Develop data models and reporting datasets that support Tableau and well-established analytics tools like Spotfire.

• Connect established data warehouse and reporting systems with contemporary cloud analytics platforms.

• Enhance pipeline reliability, data quality, and processing efficiency.

• Execute automated testing, monitoring, documentation, and CI/CD methodologies.

• Collaborate with analysts, architects, developers, and business stakeholders to deliver effective data solutions.

• Offer technical guidance, review code, and mentor fellow data engineers.

⛳️ Requirements

• Over 7 years of experience in data engineering, including the construction and support of production data pipelines.

• Strong SQL expertise along with a comprehensive understanding of data modeling, database design, and data warehousing.

• Practical experience with Databricks, Apache Spark, and cloud data platforms.

• High proficiency in Python and PySpark.

• Experience in developing ETL/ELT pipelines and integrating data from various source systems.

• Proven track record in preparing reliable datasets for Tableau or similar business intelligence tools.

• Familiarity with source control, automated testing, and CI/CD practices.

• Capability to troubleshoot complex data challenges and enhance pipeline performance.

• Excellent communication skills and experience working collaboratively with technical teams and business stakeholders.

• Experience with Spotfire, Oracle, Informatica, R, or data virtualization is preferred.

• Databricks certification is preferred.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Comprehensive health, dental, and vision insurance plans.

• Opportunities for professional development and continuous learning.

• Flexible work hours and the option for remote work.

• A vibrant and inclusive company culture.