Generative AI Data Automation Engineer

About this role

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Protos IT, is seeking the following. Apply via Dice today!


Job Title: Generative AI Data Automation Engineer


Location: Remote


Duration: 6 + Months Contract


s are encouraged to apply for this position, Must be able to obtain Public Trust clearance
In this role, you will:

• Design and maintain data pipelines in AWS using S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB, and Step Functions.Develop ETL/ELT processes to move data from multiple data systems including DynamoDB SQL Server (AWS) and between AWS Azure SQL systems.Integrate AWS Connect, Nice in Contact CRM data into the enterprise data pipeline for analytics and operational reporting.
• Engineer, enhance ingestion pipelines with Apache Spark, Flume, Kafka for real-time and batch processing into Apache Solr, AWS Open Search platforms.Leverage Generative AI services and Frameworks (AWS Bedrock, Amazon Q, Azure OpenAI, Hugging Face, LangChain) to:Create automated processes for vector generation and embedding from unstructured data to support Generative AI models.Automate data quality checks, metadata tagging, and lineage tracking.
• Enhance ingestion/ETL with LLM-assisted transformation and anomaly detection.Build conversational BI interfaces that allow natural language access to Solr and SQL data.Develop
• AI-powered copilots for pipeline monitoring and automated troubleshooting.
• Implement SQL Server stored procedures, indexing, query optimization, profiling, and execution plan tuning to maximize performance.
• Apply CI/CD best practices using GitHub, Jenkins, or Azure DevOps for both data pipelines and GenAI model integration.Ensure security and compliance through IAM, KMS encryption, VPC isolation, RBAC, and firewalls.
• Support Agile DevOps processes with sprint-based delivery of pipeline and AI-enabled features.

Qualifications:

• BS in Computer Science or related fi...