getSummary
Written in English from the original postingThis contract role involves building and optimizing AWS-based data pipelines for structured and unstructured document processing. The engineer will implement vector indexing, semantic search, RAG knowledge bases, and AI agent integrations using Amazon Bedrock and Claude Agent SDK. Responsibilities also include CI/CD automation and pipeline scalability, reliability, security, and performance improvements.
Job description
Job Description
Senior Data Engineer (GenAI / AWS)
Duration: 3+ Months (Extension Possible)
Experience: 14+ years Cloud Platform: AWS Primary Language: Python
Key Responsibilities
- Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
- Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
- Implement document chunking, embeddings, vector indexing, and semantic search.
- Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
- Integrate knowledge bases with AI agents for contextual information retrieval.
- Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
- Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
- Optimize data pipelines for scalability, reliability, security, and performance.
Additional Information
All your information will be kept confidential according to EEO guidelines.
The weekly Digest
The week's most transparent data engineering jobs in your inbox once a week.
Once a week, a few new jobs that state their salary, location and stack, plus links to the rest. No open tracking; clicks are counted per issue, not per person. Unsubscribe with one click.
