Generative AI Data Engineer SME

Generative AI Data Engineer SMEThe client is looking for a technical data engineer focused on preparing data, metadata, training datasets (e.g. in a vector database) and building data pipelines and reusable data assets/APIs using devops tools to make data available for GenAI use cases. As a consultant within the Dell organization, aligned to consulting service delivery, you will provide consultative business and technical delivery services for a range of complex customer-facing consulting engagements.Specifically, you will be part of projects deploying, administering, and configuring Large Language Models, Generative and other AI software stacks and their associated models. These projects will focus on allowing Dell customers to implement AI Use cases for their business. As a member of the services delivery team, you will work alongside Dell badged Consultants, to earn the customer's trust through competence, technical acumen, consulting expertise, and partnership.This position requires a dynamic individual with expert customer-facing skills. The ability to guide customers and communicate technical processes and ideas is essential. These engagements often ensure that the customer is also enabled in the technologies being delivered. As the data engineering consultant, you should have the common traits and capabilities that are listed in Section 2 (Essential Requirements) and meet many of the capabilities listed in Section 3 (Desirable Requirements).Essential Requirements and Skills10+ years working with customers in the Data Analytics, Big Data and Data Warehousing field.10+ years working with data modeling tools.5+ years building data pipelines for large customers.2+ years of experience working in the field of Artificial Intelligence that leverages Big Data. This should be in a customer-facing services delivery role.3+ years of experience in Big Data database design.A good understanding of LLMs, prompt engineering, fine tuning and training.Strong knowledge of SQL, NoSQL and Vector databases. Experience with popular enterprise databases such as SQL Server, MySQL, Postgres and Redis is a must. Additionally experience with popular Vector Databases such as PGVector and Milvus is a requirement.Experience with major data warehousing providers such as Teradata.Experience with data lake tools such as Databricks, Snowflake and Starburst.Proven experience building data pipelines and ETLs for both data transformation and multiple data source data extraction. Experience with automation of the deployment and execution of these pipelines.Experience with tools such as Apache Spark, Apache Hadoop, Informatica and similar data processing tools. Proficient knowledge of Python and SQL is a must.Proven experience with building test procedures, ensuring the quality, reliability, performance, and scalability of the data pipelines.Ability to develop applications that expose Restful APIs for data querying and ingestion.Experience preparing training data for Large Language Model ingestion and training (e.g. through vector databases).Experience with integrating with RAG solutions and leveraging related tools such as Nvidia Guardrails. Ability to define and implement metrics for RAG solutions.Understanding of typical AI tooling ecosystem including knowledge and experience of Kubernetes, MLOps and AIOps tools.Ability to gain customer trust, ability to plan, organize and drive customer workshops. Good communication skills in English is a must.The ability to work in a highly efficient team using an Agile methodology such as Scrum or Kanban. Ability to have extended pairing sessions with customers, enabling knowledge transfers in complex domains.Ability to influence and interact with confidence and credibility at all levels within the Dell Technologies companies and with our customers, partners, and vendors.Experience working on project teams within a defined methodology while adhering to margin, planning and SOW requirements.Ability to be onsite during customer workshops and enablement sessions.Desirable Requirements and SkillsGeneral awareness of Dell Technologies products.Knowledge of industry widespread AI Studios and AI Workbenches is a plus.Experience building and using Information Retrieval (IR) frameworks to support LLM inferencing.Working knowledge of Linux is a plusExperience using Lean and Iterative Deployment Methodologies.Working knowledge of cloud technologies is a plus.University Degree aligned to Data Engineering is a plus.In possession of relevant industry certifications e.g. Databricks Certified Data Engineer, Microsoft Certifications, etc.