Data Engineer III

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop production-quality Python and SQL code, focusing on intricate SQL for data transformation, pipeline logic, and the optimization of analytical queries.

• Employ AI tools and large language models to enhance engineering workflows — encompassing code generation, query optimization, automated testing, documentation, and process enhancement.

• Utilize AWS services like Lambda, Glue, and Fargate to facilitate scalable data operations.

• Construct and sustain large-scale data pipelines using Apache Airflow.

• Manage the upkeep of Extract, Load, and Transform (ELT) processes employing DBT.

• Create optimized database schemas in PostgreSQL and Amazon Redshift to ensure data integrity and optimal performance.

• Spot opportunities to implement AI-driven automation for repetitive or high-volume data engineering tasks, minimizing manual effort and enhancing throughput.

⛳️ Requirements

• A Bachelor's degree in Computer Science, Engineering, or a related discipline, or equivalent professional experience.

• Over 5 years of experience in the data engineering field.

• Proficient in SQL, with expertise in query optimization, schema design, and managing large-scale datasets in live environments.

• Strong capabilities in Python, with experience in writing and maintaining production-level code.

• Familiarity with AWS systems within a production setting.

• Proven experience in scaling data infrastructure to accommodate high data volumes.

• A track record of integrating AI tools (e.g., GitHub Copilot, LLM-assisted development) into engineering workflows to enhance efficiency and quality.

• Experience with medical and pharmacy claims data (preferred).

🏝️ Benefits

• The offered compensation will be based on geographic location, experience, and qualifications.