Senior Data Engineer

This is a fully remote position, open to applicants in Texas.

📋 Description

• Design and implement scalable data pipelines: Create, develop, and uphold dependable ETL/ELT workflows utilizing Databricks, Spark, and Python.

• Facilitate data access and analytics: Collaborate with analytics, product, and engineering teams to guarantee timely, precise, and governed access to data for downstream reporting and analytics.

• Enhance data workflows: Boost performance, minimize latency, and optimize processes by refining SQL, tuning Spark jobs, and improving cloud data pipelines.

• Utilize cloud infrastructure: Leverage AWS services (such as S3, Glue, Lambda) to manage and scale data engineering workloads.

• Promote best practices: Create and uphold data engineering standards, which include code quality, data security, version control, and documentation.

• Develop and maintain data models: Build and support dimensional and normalized data models that fulfill cross-functional use cases and reporting requirements.

• Implement automation and monitoring: Establish robust pipeline orchestration (for example, using Airflow, Databricks Jobs, or AWS Step Functions) along with monitoring and alerting systems.

• Collaborate across functions: Engage with data analysts, scientists, and business users to comprehend requirements and convert raw data into business-ready datasets.

⛳️ Requirements

• A minimum of 3 years of experience as a Data Engineer or in a comparable position.

• Extensive hands-on experience with Databricks (Spark, Delta Lake) and Python-based ETL frameworks.

• Strong experience with AWS cloud services for data processing and storage.

• Moderate to advanced SQL proficiency for data wrangling, transformation, and performance tuning.

• Familiarity with data lake architectures, ELT/ETL development, and orchestration tools.

• Knowledge of software engineering best practices, including CI/CD, version control, and code reviews.

• Experience with Power BI or other BI tools (e.g., Tableau, Looker) to support data visualization or self-service reporting capabilities.

🏝️ Benefits

• Generous, flexible vacation policy

• Educational assistance

• Comprehensive health benefits

• 401(k) employer match