Senior Data Engineer

This is a fully remote position, open to applicants in Alabama, +27 more states.

📋 Description

• Design, construct, and sustain scalable data pipelines that facilitate batch processing, real-time streaming, and event-driven data transfers from both on-premises and cloud sources.

• Act as a primary developer for the Snowflake data platform, ensuring optimal performance, effective data modeling, and efficient storage structures.

• Architect and create transformation pipelines that deliver high-quality data inputs for Snowflake and dbt AI features.

• Develop and maintain semantic layers and metadata models that support Self-Service 2.0 natural-language user interfaces.

• Define reference architectures, reusable templates, and CI/CD best practices for decentralized line-of-business data products.

• Offer direct management and career mentorship to one data engineer, with opportunities for team expansion.

• Assist decentralized data analysts in enhancing their engineering practices.

• Promote the use of dbt for data transformation.

• Assess the integration of AWS and Azure cloud data tools, including Azure Data Factory, Azure Functions, and Stream Analytics, to enhance data flow efficiency.

• Perform additional duties as assigned.

• Support the organization's quality programs.

• Travel as necessary.

⛳️ Requirements

• A bachelor's degree in computer science, information systems, data engineering, or a related field from an accredited institution is preferred.

• An equivalent combination of education, professional certifications, and relevant work experience will also be considered.

• A minimum of five (5) years of dedicated experience in data engineering, with a proven track record of building production-grade data pipelines, is required.

• Advanced hands-on experience with Snowflake architecture, performance optimization, and data sharing is essential.

• Experience in transferring data across hybrid environments, including from on-premises to cloud, utilizing batch, streaming, and event-driven patterns is required.

• Experience in building or maintaining semantic layers and structuring data for downstream AI, large language models, or natural-language search capabilities is preferred.

• Advanced knowledge of Snowflake architecture, performance tuning, data modeling, storage structures, and secure data sharing.

• Strong understanding of scalable batch processing, real-time streaming, and event-driven data pipeline architecture.

• Experience with semantic layers, including dbt Semantic Layer and Snowflake Cortex or semantic definitions.

• Proficient in Python, particularly in cloud environments and with Azure Functions for data workloads.

• Strong SQL skills.

• Experience with dbt is highly preferred.

• Familiarity with Azure data tools, including Azure Data Factory, Azure Functions, and Stream Analytics, is preferred.

• Knowledge of AWS data ecosystems is preferred.

• Understanding of reference architecture, reusable pipeline patterns, templates, and CI/CD practices.

• Collaborative coaching and leadership skills, with the capacity to teach, establish governance, and enhance engineering practices across cross-functional teams.

• Strong analytical, problem-solving, organizational, and communication abilities.

• Capability to meet or exceed performance competencies.

• Ability to manage work-related stress and handle multiple priorities concurrently.

• Ability to meet deadlines.

• Travel as needed.

🏝️ Benefits

• Work-life balance.

• Opportunities for career advancement.

• Supportive culture.

• Reasonable accommodations when applicable and suitable.

• Equal opportunity employer.

• Drug-free workplace.