Senior Data Engineer – GenAI, AWS, Python

Posted 7 hours ago

This is a fully remote position, open to applicants in California.

📋 Description

• Design and engineer scalable data pipelines utilizing AWS Step Functions, Lambda, S3, Textract, and Comprehend

• Create automated workflows for processing documents containing both structured and unstructured data

• Execute document chunking, embeddings, vector indexing, semantic search, and retrieval-augmented generation (RAG) solutions

• Develop and oversee vector databases and knowledge repositories

• Integrate knowledge bases with AI agents to facilitate contextual information retrieval

• Construct and deploy AI agents leveraging the Claude Agent SDK on the Amazon Bedrock AgentCore Runtime

• Establish and maintain CI/CD pipelines using GitHub Actions

• Enhance data pipelines for scalability, security, reliability, and performance


⛳️ Requirements

• Over 12 years of experience in Data Engineering

• AWS certification is mandatory

• Candidates must be located in California

• Strong proficiency in Python and SQL

• Familiarity with AWS Step Functions, Lambda, and S3

• Experience with Amazon Textract and Comprehend

• Understanding of Document AI/OCR technologies

• Background in vector databases and embeddings

• Experience in document chunking and indexing

• Proficiency in advanced retrieval methods and reranking

• Familiarity with RAG and knowledge base integration

• Experience with Amazon Bedrock

• Knowledge of the Claude Agent SDK

• Experience with the AgentCore Runtime

• Proficient in GitHub Actions and CI/CD practices

• Knowledge of AWS IAM and API integrations

• C2C contract engagement


🏝️ Benefits

• Contract duration of over 3 months with the possibility of extension

• Flexible remote or hybrid work arrangement

• Confidential handling of information in accordance with EEO guidelines

People also viewed

Coderio6 hours ago

Senior Data Engineer

US flagCalifornia, +4 more statesFull-timeData Engineer
ApplyView job
3Cloud7 hours ago

Principal Architect – Data Platforms, Architecture

US flagUnited States OnlyFull-timeData Engineer$158.2k – $237.3k/year
ApplyView job
YouGov7 hours ago

Data Engineer

MX flagMexico, +1 more countryFull-timeData Engineer
ApplyView job
Sowelo Consulting sp. z o.o. sp. k.7 hours ago

Senior Data Engineer

PL flagPoland OnlyFull-timeData Engineer
ApplyView job
Hermanson Company7 hours ago

Senior Fabric Technical Data Architect

US flagWashington OnlyFull-timeData Engineer$165k – $195k/year
ApplyView job
Oportun8 hours ago

Senior DataOps Engineer

MX flagMexico OnlyFull-timeData Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers