Lead Data Engineer - Generative AI
Develop AI-driven systems to improve data capabilities, ensuring compliance with industry best practices. Implement efficient Retrieval-Augmented Generation (RAG) architectures and integrate with enterprise data infrastructure. Collaborate with cross-functional teams to integrate solutions into operational processes and systems supporting various functions. Stay up to date with industry advancements in AI and apply modern technologies and methodologies to our systems. Design, build and maintain scalable and robust real-time data streaming pipelines using technologies such as GCP, Vertex AI, S 3, AWS Bedrock, Spark streaming, or similar. Develop data domains and data products for various consumption archetypes including Reporting, Data Science, AI/ ML, Analytics etc. Ensure the reliability, availability, and scalability of data pipelines and systems through effective monitoring, alerting, and incident management. Implement best practices in reliability engineering, including redundancy,...Data Engineer, Reliability Engineer, AI, Engineer, Lead, Processing, Technology