{"schemaVersion":"jobsearcher.job.v1","id":"8222fb6b44ea79b06af545c3","url":"https://jobsearcher.com/jobs/8222fb6b44ea79b06af545c3","canonicalUrl":"https://jobsearcher.com/jobs/8222fb6b44ea79b06af545c3","title":"Senior Data Platform Engineer","description":"Overview of the Function\n\nWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms used by the Data Office. The role combines deep data engineering capability with platform engineering accountability across Microsoft Azure, Databricks, Unity Catalog, integration and ingestion services, Collibra, and Immuta.\n\nThe successful candidate will ensure that the Data Office platform estate is secure, reliable, scalable, observable, and cost-effective. This includes optimizing performance, workloads, storage, compute, access, and platform configurations, while also designing and delivering robust data pipelines and lakehouse solutions that support analytics, business intelligence, AI, and machine learning.\n\nThis is a hands-on role working across engineering, architecture, governance, security, and operations to provide a trusted enterprise data platform and a strong developer and consumer experience.\n\nRole Summary / Purpose of Job\n\nThe Senior Data Platform Engineer will be responsible for the day-to-day engineering and technical management of the Data Office platform ecosystem. The role will maintain platform health, availability, security, performance, and cost efficiency, while supporting platform upgrades, configuration, automation, monitoring, access management, and incident resolution.\n\nIn parallel, the role will deliver senior-level data engineering outcomes across ingestion, integration, transformation, orchestration, governance, and data access. The engineer will work with data architects, engineers, analysts, governance teams, security teams, and business stakeholders to ensure that data products are reliable, discoverable, controlled, and fit for purpose.\n\nKey Responsibilities and Deliverables\n\nManage the Data Office platform estate across Azure, Databricks, Unity Catalog, integration and ingestion services, Collibra, and Immuta, ensuring operational reliability and alignment with enterprise standards.\nMonitor and optimize platform performance, workloads, clusters, SQL warehouses, jobs, storage, and compute to improve reliability, scalability, user experience, and cost efficiency.\nOwn capacity and workload management, including resource allocation, concurrency, job scheduling, autoscaling, workload isolation, and the assessment of serverless and cluster-based compute options.\nAdminister platform configuration, workspaces, environments, service connections, secrets, policies, and technical integrations across development, test, and production.\nManage data access controls and entitlements across Azure, Databricks, Unity Catalog, Collibra, and Immuta, applying least-privilege, role-based, attribute-based, and policy-based access principles.\nImplement and maintain Unity Catalog structures, including catalogs, schemas, permissions, data objects, lineage, and controlled data-sharing patterns.\nSupport Collibra integration and adoption for cataloging, metadata, business glossaries, lineage, ownership, stewardship, and governance workflows.\nDesign, build, and maintain secure, scalable lakehouse solutions using Azure Data Lake Storage, Databricks, Delta Lake, Spark, PySpark, Python, and SQL.\nDevelop and optimize batch and streaming ingestion, integration, ETL, and ELT pipelines using Azure Data Factory, Databricks Workflows, APIs, event-based services, and appropriate orchestration tools.\nEngineer reusable integration and ingestion patterns for structured, semi-structured, and unstructured data from enterprise applications, files, databases, APIs, and event streams.\nImplement observability across platforms and pipelines, including monitoring, logging, alerting, performance metrics, usage reporting, cost reporting, failure analysis, and operational dashboards.\nLead technical incident investigation, root-cause analysis, remediation, and problem management for platform, workload, access, and data pipeline issues.\nAutomate platform deployment and configuration through infrastructure as code, CI/CD, testing, release management, and version control using tools such as Terraform, Git, Azure DevOps, or GitHub Actions.\nImplement data quality, reconciliation, validation, exception handling, recovery, and audit controls to improve reliability and trust in enterprise data products.\nPlan and execute platform upgrades, feature adoption, migrations, configuration changes, resilience testing, backup and recovery activities, and lifecycle management.\nMaintain technical standards, runbooks, architecture diagrams, support procedures, data dictionaries, operating documentation, and knowledge articles.\nProvide technical leadership, coaching, design review, and best-practice guidance to data engineers and other platform users.\nCollaborate with architecture, cloud operations, cyber security, risk, governance, analytics, and business teams to translate requirements into secure and sustainable engineering solutions.\n\nKey Requirements\n\nExperience and Background\n5–10 years of hands-on experience in data engineering, data platform engineering, cloud engineering, or a closely related field.\nProven experience managing and supporting enterprise data platforms in production, including performance, workloads, storage, compute, access, availability, and cost.\nProven experience designing and implementing cloud data lake or lakehouse architectures at scale.\nExperience operating in a Microsoft Azure enterprise environment and working with cross-functional platform, security, governance, and engineering teams.\nExperience working in a regulated environment, preferably legal or financial services, with an understanding of security, privacy, audit, and compliance obligations.\n\nCore Platform and Engineering Skills\nAdvanced hands-on experience with Databricks, including Spark, PySpark, Delta Lake, SQL, Workflows, clusters, SQL warehouses, jobs, performance tuning, and cost optimization.\nHands-on experience with Unity Catalog, including catalogs, schemas, permissions, lineage, secure data access, and governance administration.\nStrong experience with Microsoft Azure services, including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Functions, Logic Apps, Key Vault, networking, identity, monitoring, and related services.\nStrong Python and SQL skills, with the ability to develop, review, troubleshoot, and optimize production-grade code and queries.\nExperience designing and supporting integration and ingestion patterns across databases, enterprise applications, files, APIs, and streaming or event-based sources.\nExperience with Collibra or a comparable data catalog and governance platform, including metadata, lineage, stewardship, ownership, and workflow integration.\nExperience with Immuta or a comparable data security platform, including policy-based access, sensitive data controls, auditability, and integration with Databricks.\nKnowledge of identity, access management, role-based access control, attribute-based access control, service principals, managed identities, secrets, and least-privilege design.\nExperience with platform monitoring, observability, capacity management, incident response, root-cause analysis, resilience, backup, and recovery.\nExperience with CI/CD, infrastructure as code, source control, automated testing, and release management using Terraform, Git, Azure DevOps, GitHub Actions, or equivalent tooling.\nDesirable Skills\nExperience with dbt, Apache Airflow, Azure Event Hubs, Spark Structured Streaming, or comparable transformation and orchestration technologies.\nExperience with Azure Synapse Analytics, Microsoft Purview, containerization, Kubernetes, or enterprise API management.\nKnowledge of FinOps practices for data platforms, including attribution, budgeting, forecasting, chargeback or showback, and cost-control policies.\nUnderstanding of data quality, metadata management, lineage, retention, classification, privacy, and records-management controls.\nFamiliarity with agile delivery and IT service management practices, including change, incident, problem, and release management.\n\nProfessional Skills\n\nStrong analytical, problem-solving, troubleshooting, and root-cause analysis skills.\nAbility to balance platform stability and control with delivery speed, usability, and innovation.\nClear verbal and written communication skills, with the ability to work effectively across technical and non-technical teams.\nAbility to prioritize operational work, engineering delivery, platform improvements, and technical debt.\nProactive ownership, sound judgement, attention to detail, and commitment to continuous improvement and knowledge sharing.\n\nEEO Statement\nFreshfields US LLP is proud to be an equal employment employer. Our policies and practices will be free from unlawful discrimination based upon race, color, ethnicity, religion, creed, sex (including pregnancy, childbirth or related medical conditions), national origin, citizenship, immigration status, ancestry, age, marital status, protected veteran status, military service, disability, medical condition, genetic information, sexual orientation, gender identity, or any basis prohibited under federal, state or local law. We strive to promote an atmosphere that encourages equal opportunities and prohibits discriminatory practices, including sexual harassment.\n\nDisability Accommodation for Applicants to Freshfields US LLP\nFreshfields US LLP is an Equal Employment Opportunity employer and provides reasonable accommodation for qualified individuals with disabilities and disabled veterans in job application procedures. If you have any difficulty using our online system and you need an accommodation due to a disability, you may use the alternative email address below to contact us about your interest in employment at BusinessServicesRecruitment@Freshfields.com , or you can send your resume to BusinessServicesRecruitment@Freshfields.com , or you can call us at +1-212-277-4000.","company":"Freshfields","rawCompany":"freshfields","city":"Raleigh","state":"NC","isRemote":false,"isActive":false,"createdAt":"2026-10-21T10:16:40.808Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Platform Engineer","description":"Overview of the Function\n\nWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms used by the Data Office. The role combines deep data engineering capability with platform engineering accountability across Microsoft Azure, Databricks, Unity Catalog, integration and ingestion services, Collibra, and Immuta.\n\nThe successful candidate will ensure that the Data Office platform estate is secure, reliable, scalable, observable, and cost-effective. This includes optimizing performance, workloads, storage, compute, access, and platform configurations, while also designing and delivering robust data pipelines and lakehouse solutions that support analytics, business intelligence, AI, and machine learning.\n\nThis is a hands-on role working across engineering, architecture, governance, security, and operations to provide a trusted enterprise data platform and a strong developer and consumer experience.\n\nRole Summary / Purpose of Job\n\nThe Senior Data Platform Engineer will be responsible for the day-to-day engineering and technical management of the Data Office platform ecosystem. The role will maintain platform health, availability, security, performance, and cost efficiency, while supporting platform upgrades, configuration, automation, monitoring, access management, and incident resolution.\n\nIn parallel, the role will deliver senior-level data engineering outcomes across ingestion, integration, transformation, orchestration, governance, and data access. The engineer will work with data architects, engineers, analysts, governance teams, security teams, and business stakeholders to ensure that data products are reliable, discoverable, controlled, and fit for purpose.\n\nKey Responsibilities and Deliverables\n\nManage the Data Office platform estate across Azure, Databricks, Unity Catalog, integration and ingestion services, Collibra, and Immuta, ensuring operational reliability and alignment with enterprise standards.\nMonitor and optimize platform performance, workloads, clusters, SQL warehouses, jobs, storage, and compute to improve reliability, scalability, user experience, and cost efficiency.\nOwn capacity and workload management, including resource allocation, concurrency, job scheduling, autoscaling, workload isolation, and the assessment of serverless and cluster-based compute options.\nAdminister platform configuration, workspaces, environments, service connections, secrets, policies, and technical integrations across development, test, and production.\nManage data access controls and entitlements across Azure, Databricks, Unity Catalog, Collibra, and Immuta, applying least-privilege, role-based, attribute-based, and policy-based access principles.\nImplement and maintain Unity Catalog structures, including catalogs, schemas, permissions, data objects, lineage, and controlled data-sharing patterns.\nSupport Collibra integration and adoption for cataloging, metadata, business glossaries, lineage, ownership, stewardship, and governance workflows.\nDesign, build, and maintain secure, scalable lakehouse solutions using Azure Data Lake Storage, Databricks, Delta Lake, Spark, PySpark, Python, and SQL.\nDevelop and optimize batch and streaming ingestion, integration, ETL, and ELT pipelines using Azure Data Factory, Databricks Workflows, APIs, event-based services, and appropriate orchestration tools.\nEngineer reusable integration and ingestion patterns for structured, semi-structured, and unstructured data from enterprise applications, files, databases, APIs, and event streams.\nImplement observability across platforms and pipelines, including monitoring, logging, alerting, performance metrics, usage reporting, cost reporting, failure analysis, and operational dashboards.\nLead technical incident investigation, root-cause analysis, remediation, and problem management for platform, workload, access, and data pipeline issues.\nAutomate platform deployment and configuration through infrastructure as code, CI/CD, testing, release management, and version control using tools such as Terraform, Git, Azure DevOps, or GitHub Actions.\nImplement data quality, reconciliation, validation, exception handling, recovery, and audit controls to improve reliability and trust in enterprise data products.\nPlan and execute platform upgrades, feature adoption, migrations, configuration changes, resilience testing, backup and recovery activities, and lifecycle management.\nMaintain technical standards, runbooks, architecture diagrams, support procedures, data dictionaries, operating documentation, and knowledge articles.\nProvide technical leadership, coaching, design review, and best-practice guidance to data engineers and other platform users.\nCollaborate with architecture, cloud operations, cyber security, risk, governance, analytics, and business teams to translate requirements into secure and sustainable engineering solutions.\n\nKey Requirements\n\nExperience and Background\n5–10 years of hands-on experience in data engineering, data platform engineering, cloud engineering, or a closely related field.\nProven experience managing and supporting enterprise data platforms in production, including performance, workloads, storage, compute, access, availability, and cost.\nProven experience designing and implementing cloud data lake or lakehouse architectures at scale.\nExperience operating in a Microsoft Azure enterprise environment and working with cross-functional platform, security, governance, and engineering teams.\nExperience working in a regulated environment, preferably legal or financial services, with an understanding of security, privacy, audit, and compliance obligations.\n\nCore Platform and Engineering Skills\nAdvanced hands-on experience with Databricks, including Spark, PySpark, Delta Lake, SQL, Workflows, clusters, SQL warehouses, jobs, performance tuning, and cost optimization.\nHands-on experience with Unity Catalog, including catalogs, schemas, permissions, lineage, secure data access, and governance administration.\nStrong experience with Microsoft Azure services, including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Functions, Logic Apps, Key Vault, networking, identity, monitoring, and related services.\nStrong Python and SQL skills, with the ability to develop, review, troubleshoot, and optimize production-grade code and queries.\nExperience designing and supporting integration and ingestion patterns across databases, enterprise applications, files, APIs, and streaming or event-based sources.\nExperience with Collibra or a comparable data catalog and governance platform, including metadata, lineage, stewardship, ownership, and workflow integration.\nExperience with Immuta or a comparable data security platform, including policy-based access, sensitive data controls, auditability, and integration with Databricks.\nKnowledge of identity, access management, role-based access control, attribute-based access control, service principals, managed identities, secrets, and least-privilege design.\nExperience with platform monitoring, observability, capacity management, incident response, root-cause analysis, resilience, backup, and recovery.\nExperience with CI/CD, infrastructure as code, source control, automated testing, and release management using Terraform, Git, Azure DevOps, GitHub Actions, or equivalent tooling.\nDesirable Skills\nExperience with dbt, Apache Airflow, Azure Event Hubs, Spark Structured Streaming, or comparable transformation and orchestration technologies.\nExperience with Azure Synapse Analytics, Microsoft Purview, containerization, Kubernetes, or enterprise API management.\nKnowledge of FinOps practices for data platforms, including attribution, budgeting, forecasting, chargeback or showback, and cost-control policies.\nUnderstanding of data quality, metadata management, lineage, retention, classification, privacy, and records-management controls.\nFamiliarity with agile delivery and IT service management practices, including change, incident, problem, and release management.\n\nProfessional Skills\n\nStrong analytical, problem-solving, troubleshooting, and root-cause analysis skills.\nAbility to balance platform stability and control with delivery speed, usability, and innovation.\nClear verbal and written communication skills, with the ability to work effectively across technical and non-technical teams.\nAbility to prioritize operational work, engineering delivery, platform improvements, and technical debt.\nProactive ownership, sound judgement, attention to detail, and commitment to continuous improvement and knowledge sharing.\n\nEEO Statement\nFreshfields US LLP is proud to be an equal employment employer. Our policies and practices will be free from unlawful discrimination based upon race, color, ethnicity, religion, creed, sex (including pregnancy, childbirth or related medical conditions), national origin, citizenship, immigration status, ancestry, age, marital status, protected veteran status, military service, disability, medical condition, genetic information, sexual orientation, gender identity, or any basis prohibited under federal, state or local law. We strive to promote an atmosphere that encourages equal opportunities and prohibits discriminatory practices, including sexual harassment.\n\nDisability Accommodation for Applicants to Freshfields US LLP\nFreshfields US LLP is an Equal Employment Opportunity employer and provides reasonable accommodation for qualified individuals with disabilities and disabled veterans in job application procedures. If you have any difficulty using our online system and you need an accommodation due to a disability, you may use the alternative email address below to contact us about your interest in employment at BusinessServicesRecruitment@Freshfields.com , or you can send your resume to BusinessServicesRecruitment@Freshfields.com , or you can call us at +1-212-277-4000.","datePosted":"2026-10-21T10:16:40.808Z","dateModified":"2026-10-21T10:16:40.808Z","hiringOrganization":{"@type":"Organization","name":"Freshfields","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Raleigh","addressRegion":"NC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"8222fb6b44ea79b06af545c3"},"url":"https://jobsearcher.com/jobs/8222fb6b44ea79b06af545c3"}}