Junior Forward Deployed Engineer

This is a fully remote position, open to applicants in Florida.

📋 Description

• Design, develop, and sustain robust ETL/ELT pipelines integrating on-premise systems, AWS services, and Azure platforms with Snowflake and subsequent AI services.

• Create and manage feature stores as well as analytically optimized datasets tailored for machine learning workflows.

• Construct generative AI data pipelines, which encompass extraction, transformation, chunking, and loading into vector databases.

• Execute Snowflake data modeling, automate Snowpipe, and enhance compute and storage efficiency.

• Conduct non-invasive data extraction from legacy systems while ensuring system stability is maintained.

• Design and oversee cross-platform workflows utilizing Airflow, AWS Step Functions, and Azure Data Factory.

• Collaborate with IT, database, infrastructure, and security teams to address connectivity and access issues while obtaining necessary production approvals.

• Implement frameworks for data quality, validation, and observability.

• Enhance storage, compute utilization, and query performance across Snowflake, AWS, and Azure environments.

• Collaborate with MLOps, Data Science, and AI teams to transform experimental use cases into scalable production data solutions.

• Perform additional tasks as assigned.

⛳️ Requirements

• A Master’s degree in Computer Science, Data Engineering, or a relevant field is preferred (but not mandatory).

• A minimum of six (6) years of practical data engineering experience, demonstrating a history of developing production-grade pipelines for Data Science and AI in multi-cloud settings, or a suitable combination of education and experience.

• Expert-level knowledge of Snowflake architecture, including data sharing, performance optimization, and integration with external cloud AI services.

• Advanced practical expertise in AWS S3, Glue, Lambda, and Azure Data Factory, Synapse.

• Proficient in Python, SQL, and PySpark.

• Extensive experience in data orchestration and containerization, particularly with Docker.

• Familiarity with on-premise SQL, mainframe extracts, and flat files.

• Knowledge of machine learning data requirements, including feature engineering.

• Understanding of generative AI concepts, including vectorization and embedding pipelines.

• Capability to work effectively within a team environment.

• Ability to meet or exceed Performance Competencies.

• Competence to manage multiple priorities and adhere to deadlines.

• Willingness to travel as necessary.

🏝️ Benefits

• Work-life balance.

• Travel as necessary.

• Reasonable accommodations when applicable and appropriate.

• Equal Opportunity Employer.

• Drug-Free Workplace.