Senior Data Engineer

This is a fully remote position, open to applicants in Texas.

📋 Description

• Design, construct, and sustain scalable, enterprise-level data systems that drive data products and capabilities.

• Create and manage streaming data pipelines utilizing Databricks and Spark.

• Develop ML pipelines to supply data and refresh a variety of models.

• Build ML models to enhance predictive analytics and facilitate decision-making across departments.

• Take ownership of operational excellence for data pipelines and domains.

• Enable analytics functionality and an AI platform to foster AI-driven product innovation.

• Enhance streaming data management and improve data quality.

• Work collaboratively with teams, provide and receive constructive feedback, and contribute throughout the software development lifecycle.

• Automate, test, document, and support CI/CD processes.

⛳️ Requirements

• Experienced and enthusiastic Senior Data Engineer.

• Strong product ownership skills and a keen intuition for utilizing data in business decisions.

• Proficient in Python and SQL.

• Solid background in distributed data processing or software engineering of data services.

• Familiarity with big data technologies, such as Spark.

• Experience handling web-scale datasets.

• Exposure to cloud-based data lake tools.

• Proven experience in designing and implementing data pipelines.

• Proficient in Python and SparkSQL/Spark.

• Passionate about automation, testing, CI/CD, documentation, and data quality.

• Ability to independently acquire new technological skills.

• Capable of working autonomously and collaborating in a fast-paced environment with ambiguous requirements.

• Experience with Azure data tools, such as Data Lake, Synapse, or Fabric, is advantageous.

• Knowledge of Power BI is a plus.

• A Bachelor's degree in Computer Science or a related field is preferred, though not mandatory.

🏝️ Benefits

• Comprehensive employee health and wellness benefits.

• Caregiver/adoption/family leave.

• Flexible Time Off Policy.

• Casual dress code.

• Perks and discounts offered through the employee assistance program.