Senior Data Engineer – GenAI, AWS

This is a fully remote position, open to applicants in Florida.

📋 Description

• Design and construct data pipelines utilizing AWS Step Functions, Lambda, S3, Textract, and Comprehend.

• Create automated workflows for document processing to extract, transform, and handle both structured and unstructured data.

• Execute document chunking, embeddings, vector indexing, and semantic search functionalities.

• Develop and sustain vector databases and knowledge bases to enhance Retrieval-Augmented Generation (RAG).

• Connect knowledge bases with AI agents for contextual information retrieval.

• Construct AI agents using the Claude Agent SDK and deploy them on the Amazon Bedrock AgentCore Runtime.

• Create CI/CD pipelines with GitHub Actions to streamline builds, testing, and deployments.

• Enhance data pipelines for improved scalability, reliability, security, and performance.

⛳️ Requirements

• 12–20+ years of cumulative experience.

• Familiarity with the AWS cloud platform.

• Primary programming language: Python.

• Proficient in Python and SQL.

• Experience with AWS Step Functions, Lambda, and S3.

• Familiarity with Amazon Textract and Comprehend.

• Knowledge of vector databases and embeddings.

• Experience in document chunking and indexing.

• Understanding of RAG and knowledge-base integration.

• Experience with Amazon Bedrock.

• Proficient in using the Claude Agent SDK and AgentCore Runtime for building and deploying Claude agents.

• Knowledge of AWS IAM and API integrations.

• Ability to operate within western time zones.

• Willingness to travel to client locations for workshops and meetings.

🏝️ Benefits

• Travel to client locations for workshops and meetings.