{"schemaVersion":"jobsearcher.job.v1","id":"bd68dd84fe6ad46aaf24a23b","url":"https://jobsearcher.com/jobs/bd68dd84fe6ad46aaf24a23b","canonicalUrl":"https://jobsearcher.com/jobs/bd68dd84fe6ad46aaf24a23b","title":"Lead Data Engineer","description":"ROLE: Lead Data Engineer – Hands-On\r\nClient:MetLife\r\nLocation:Cary, NC — On-site / Hybrid\r\nExperience:12–18 Years\r\nEmployment Type:Full-Time\r\nThe engagement involves building a centralized,AI-first enterprise Data Hubfor a global insurance and financial services organization usingAzure Databricks .\r\nThe platform ingests150+ inbound data feedsand distributes data to35+ downstream systems , leveraging aMedallion Architecture — Bronze / Silver / Gold .\r\nAI is embedded across ingestion, canonical mapping, data quality, reconciliation, and business-user access.\r\nThis is asenior hands-on technical leadership role . The selected candidate will own the end-to-end technical design of thedata and AI layers , build reference implementations, mentor engineering teams, and continue writing/reviewing production-gradePython, Scala, and PySpark code every week .\r\nCandidates who have NOT written or reviewed production code within the past year will NOT be considered.\r\nData Platform Architecture & EngineeringDesign and implement enterprise-scale Lakehouse architecture.\r\nDefine Bronze / Silver / Gold data contracts.\r\nBuild scalable and reusable data platform components.\r\nMetadata-Driven IngestionDesign parameterized ingestion frameworks for:\r\nBatch files\r\nCDC feeds\r\nBuild schema inference, data profiling, metadata and lineage capabilities.\r\nDevelop production-gradePython, Scala and PySparksolutions.\r\nEstablish coding and testing standards.\r\nConduct PR/code reviews.\r\nOptimize Spark workloads, clusters and pipelines.\r\nImplement performance and cost optimization strategies.\r\nUnity Catalog\r\nDatabricks Jobs & Workflows\r\nCluster and pool management\r\nModel Serving\r\nADLS Gen2\r\nCI/CD & Infrastructure as CodeImplement CI/CD for Databricks and ADF usingAzure DevOps .\r\nWork withDatabricks Asset Bundles .\r\nImplement Infrastructure as Code usingTerraform .\r\nAutomate data pipeline testing and deployments.\r\nEstablish observability and operational monitoring.\r\nA major component of this role is designing and deliveringproduction-grade AI/LLM solutions .\r\nYou will work on:AI-augmented ingestion.\r\nAI-assisted canonical mapping.\r\nAuto-generated bridge documentation.\r\nDML and canonical table generation.\r\nSource-to-canonical mapping with human review gates.\r\nData drift and schema drift detection.\r\nVolume anomaly detection.\r\nAutomated reconciliation.\r\nSynthetic privacy-preserving test data generation.\r\nKnowledge graphs.\r\nGPT-powered conversational interfaces.\r\nText-to-SQL.\r\nRow-level and column-level security.\r\nCandidates must have3+ years of hands-on experience designing and shipping LLM-based systems in production , including:\r\nAgentic AI workflows\r\nTool-calling workflows\r\nChunking strategies\r\nEmbedding strategies\r\nVector retrieval\r\nHybrid retrieval\r\nLLM evaluation\r\nRegression test suites\r\nAccuracy tracking\r\nHallucination monitoring\r\nHuman-in-the-loop feedback\r\nHands-on experience with at least one of:LangChain\r\nLangGraph\r\nProvider/platform experience:OpenAI\r\nDatabricks Model Serving\r\nStrong enterprise security and governance experience is required across:Unity Catalog\r\nAccess control\r\nPII standards\r\nManaged Identities\r\nRBAC\r\nPOSIX ACLs\r\nData privacy and protection\r\nThe candidate will also participate in:AI Governance Forums\r\n12–18 yearsof total experience in Data Engineering / Data Platform delivery\r\nData contracts & schema design\r\nUnity Catalog\r\nKafka / Spark Structured Streaming\r\nSpark performance tuning\r\nEnterprise Lakehouse / Medallion Architecture\r\nAzure security & governance\r\n3+ years production LLM/GenAI engineering\r\nRAG / Agentic AI / Tool Calling\r\nLangChain / LlamaIndex / LangGraph\r\nAzure OpenAI / OpenAI / Databricks Model Serving\r\nRDF / SPARQL\r\nNeo4j\r\nGraph modelling over Lakehouse\r\nText-to-SQL\r\nML-based anomaly detection\r\nFinance Close\r\nSubledger\r\nLLMOps / MLOps\r\nLLM cost governance\r\nAI observability\r\ndbt\r\nWorkday\r\nWorkday Prism\r\nAccounting Center\r\nWe are looking for ahands-on Lead Data Engineer / Data Architect / Principal Data Engineerwho can operate at botharchitecture and engineering levels .\r\nYou should be comfortabledesigning the architecture, making technical decisions, writing production code, reviewing code, troubleshooting Spark workloads, mentoring engineers, and presenting architecture decisions to senior technical and business stakeholders.\r\nThis is NOT a pure Data Architect, Solution Architect, Engineering Manager, or AI Strategy role.\r\nRecent hands-on production coding experience is mandatory.\r\n#Nazztec #NazztecHiring #JoinNazztec #Hiring #UrgentHiring #LeadDataEngineer #DataEngineer #SeniorDataEngineer #PrincipalDataEngineer #DataArchitect #DataEngineering #DataPlatform #DataPlatformEngineer #BigData #BigDataEngineering #Azure #MicrosoftAzure #AzureDatabricks #Databricks #DeltaLake #UnityCatalog #AzureDataFactory #ADF #ADLS #ADLSGen2 #AzureEventHubs #Kafka #Spark #ApacheSpark #PySpark #Scala #Python #SQL #DataLake #Lakehouse #LakehouseArchitecture #MedallionArchitecture #BronzeSilverGold #DataArchitecture #DataModeling #DataEngineeringJobs #AzureJobs #DatabricksJobs #AI #ArtificialIntelligence #GenerativeAI #GenAI #LLM #LLMEngineering #LLMEngineer #LLMJobs #RAG #RAGPipeline #RetrievalAugmentedGeneration #AgenticAI #AgenticWorkflows #ToolCalling #LangChain #LlamaIndex #LangGraph #AzureOpenAI #OpenAI #DatabricksModelServing #PromptEngineering #VectorDatabase #VectorSearch #HybridSearch #Embeddings #SemanticSearch #TextToSQL #SemanticLayer #KnowledgeGraph #Neo4j #RDF #SPARQL #MLOps #LLMOps #AIEngineering #AIEngineer #MachineLearning #AnomalyDetection #DataQuality #DataGovernance #DataSecurity #DataLineage #DataCatalog #Metadata #MetadataDriven #DataContracts #SchemaEvolution #DataProfiling #DataObservability #DataOps #DevOps #AzureDevOps #Terraform #InfrastructureAsCode #IaC #CICD #ContinuousIntegration #ContinuousDeployment #SparkTuning #PerformanceTuning #CloudDataEngineering #CloudArchitecture #EnterpriseData #EnterpriseArchitecture #FinancialServices #Insurance #InsuranceTechnology #FinTech #MetLife #CaryNC #NorthCarolinaJobs #USJobs #USAJobs #USCitizen #USCitizenJobs #TechJobs #ITJobs #TechnologyJobs #DataScience #CloudJobs #DataProfessionals #TechHiring #ITHiring #DataHiring #AIJobs #RemoteJobs #HybridJobs #OnsiteJobs#J-18808-Ljbffr","company":"Nazztec Group","rawCompany":"nazztec group","city":"Cary","state":"NC","isRemote":false,"isActive":false,"createdAt":"2026-10-14T02:09:20.809Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer","description":"ROLE: Lead Data Engineer – Hands-On\r\nClient:MetLife\r\nLocation:Cary, NC — On-site / Hybrid\r\nExperience:12–18 Years\r\nEmployment Type:Full-Time\r\nThe engagement involves building a centralized,AI-first enterprise Data Hubfor a global insurance and financial services organization usingAzure Databricks .\r\nThe platform ingests150+ inbound data feedsand distributes data to35+ downstream systems , leveraging aMedallion Architecture — Bronze / Silver / Gold .\r\nAI is embedded across ingestion, canonical mapping, data quality, reconciliation, and business-user access.\r\nThis is asenior hands-on technical leadership role . The selected candidate will own the end-to-end technical design of thedata and AI layers , build reference implementations, mentor engineering teams, and continue writing/reviewing production-gradePython, Scala, and PySpark code every week .\r\nCandidates who have NOT written or reviewed production code within the past year will NOT be considered.\r\nData Platform Architecture & EngineeringDesign and implement enterprise-scale Lakehouse architecture.\r\nDefine Bronze / Silver / Gold data contracts.\r\nBuild scalable and reusable data platform components.\r\nMetadata-Driven IngestionDesign parameterized ingestion frameworks for:\r\nBatch files\r\nCDC feeds\r\nBuild schema inference, data profiling, metadata and lineage capabilities.\r\nDevelop production-gradePython, Scala and PySparksolutions.\r\nEstablish coding and testing standards.\r\nConduct PR/code reviews.\r\nOptimize Spark workloads, clusters and pipelines.\r\nImplement performance and cost optimization strategies.\r\nUnity Catalog\r\nDatabricks Jobs & Workflows\r\nCluster and pool management\r\nModel Serving\r\nADLS Gen2\r\nCI/CD & Infrastructure as CodeImplement CI/CD for Databricks and ADF usingAzure DevOps .\r\nWork withDatabricks Asset Bundles .\r\nImplement Infrastructure as Code usingTerraform .\r\nAutomate data pipeline testing and deployments.\r\nEstablish observability and operational monitoring.\r\nA major component of this role is designing and deliveringproduction-grade AI/LLM solutions .\r\nYou will work on:AI-augmented ingestion.\r\nAI-assisted canonical mapping.\r\nAuto-generated bridge documentation.\r\nDML and canonical table generation.\r\nSource-to-canonical mapping with human review gates.\r\nData drift and schema drift detection.\r\nVolume anomaly detection.\r\nAutomated reconciliation.\r\nSynthetic privacy-preserving test data generation.\r\nKnowledge graphs.\r\nGPT-powered conversational interfaces.\r\nText-to-SQL.\r\nRow-level and column-level security.\r\nCandidates must have3+ years of hands-on experience designing and shipping LLM-based systems in production , including:\r\nAgentic AI workflows\r\nTool-calling workflows\r\nChunking strategies\r\nEmbedding strategies\r\nVector retrieval\r\nHybrid retrieval\r\nLLM evaluation\r\nRegression test suites\r\nAccuracy tracking\r\nHallucination monitoring\r\nHuman-in-the-loop feedback\r\nHands-on experience with at least one of:LangChain\r\nLangGraph\r\nProvider/platform experience:OpenAI\r\nDatabricks Model Serving\r\nStrong enterprise security and governance experience is required across:Unity Catalog\r\nAccess control\r\nPII standards\r\nManaged Identities\r\nRBAC\r\nPOSIX ACLs\r\nData privacy and protection\r\nThe candidate will also participate in:AI Governance Forums\r\n12–18 yearsof total experience in Data Engineering / Data Platform delivery\r\nData contracts & schema design\r\nUnity Catalog\r\nKafka / Spark Structured Streaming\r\nSpark performance tuning\r\nEnterprise Lakehouse / Medallion Architecture\r\nAzure security & governance\r\n3+ years production LLM/GenAI engineering\r\nRAG / Agentic AI / Tool Calling\r\nLangChain / LlamaIndex / LangGraph\r\nAzure OpenAI / OpenAI / Databricks Model Serving\r\nRDF / SPARQL\r\nNeo4j\r\nGraph modelling over Lakehouse\r\nText-to-SQL\r\nML-based anomaly detection\r\nFinance Close\r\nSubledger\r\nLLMOps / MLOps\r\nLLM cost governance\r\nAI observability\r\ndbt\r\nWorkday\r\nWorkday Prism\r\nAccounting Center\r\nWe are looking for ahands-on Lead Data Engineer / Data Architect / Principal Data Engineerwho can operate at botharchitecture and engineering levels .\r\nYou should be comfortabledesigning the architecture, making technical decisions, writing production code, reviewing code, troubleshooting Spark workloads, mentoring engineers, and presenting architecture decisions to senior technical and business stakeholders.\r\nThis is NOT a pure Data Architect, Solution Architect, Engineering Manager, or AI Strategy role.\r\nRecent hands-on production coding experience is mandatory.\r\n#Nazztec #NazztecHiring #JoinNazztec #Hiring #UrgentHiring #LeadDataEngineer #DataEngineer #SeniorDataEngineer #PrincipalDataEngineer #DataArchitect #DataEngineering #DataPlatform #DataPlatformEngineer #BigData #BigDataEngineering #Azure #MicrosoftAzure #AzureDatabricks #Databricks #DeltaLake #UnityCatalog #AzureDataFactory #ADF #ADLS #ADLSGen2 #AzureEventHubs #Kafka #Spark #ApacheSpark #PySpark #Scala #Python #SQL #DataLake #Lakehouse #LakehouseArchitecture #MedallionArchitecture #BronzeSilverGold #DataArchitecture #DataModeling #DataEngineeringJobs #AzureJobs #DatabricksJobs #AI #ArtificialIntelligence #GenerativeAI #GenAI #LLM #LLMEngineering #LLMEngineer #LLMJobs #RAG #RAGPipeline #RetrievalAugmentedGeneration #AgenticAI #AgenticWorkflows #ToolCalling #LangChain #LlamaIndex #LangGraph #AzureOpenAI #OpenAI #DatabricksModelServing #PromptEngineering #VectorDatabase #VectorSearch #HybridSearch #Embeddings #SemanticSearch #TextToSQL #SemanticLayer #KnowledgeGraph #Neo4j #RDF #SPARQL #MLOps #LLMOps #AIEngineering #AIEngineer #MachineLearning #AnomalyDetection #DataQuality #DataGovernance #DataSecurity #DataLineage #DataCatalog #Metadata #MetadataDriven #DataContracts #SchemaEvolution #DataProfiling #DataObservability #DataOps #DevOps #AzureDevOps #Terraform #InfrastructureAsCode #IaC #CICD #ContinuousIntegration #ContinuousDeployment #SparkTuning #PerformanceTuning #CloudDataEngineering #CloudArchitecture #EnterpriseData #EnterpriseArchitecture #FinancialServices #Insurance #InsuranceTechnology #FinTech #MetLife #CaryNC #NorthCarolinaJobs #USJobs #USAJobs #USCitizen #USCitizenJobs #TechJobs #ITJobs #TechnologyJobs #DataScience #CloudJobs #DataProfessionals #TechHiring #ITHiring #DataHiring #AIJobs #RemoteJobs #HybridJobs #OnsiteJobs#J-18808-Ljbffr","datePosted":"2026-10-14T02:09:20.809Z","dateModified":"2026-10-14T02:09:20.809Z","hiringOrganization":{"@type":"Organization","name":"Nazztec Group","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Cary","addressRegion":"NC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"bd68dd84fe6ad46aaf24a23b"},"url":"https://jobsearcher.com/jobs/bd68dd84fe6ad46aaf24a23b"}}