{"schemaVersion":"jobsearcher.job.v1","id":"b3b1bda7ea05b2d4c3717f0a","url":"https://jobsearcher.com/jobs/b3b1bda7ea05b2d4c3717f0a","canonicalUrl":"https://jobsearcher.com/jobs/b3b1bda7ea05b2d4c3717f0a","title":"Data Engineer – Azure Databricks","description":"Data Engineer – Azure Databricks\nLocation: Seattle, WA (Preferred)\nAlso Open To: St. Louis, MO | Dallas/Plano, TX | Charleston, SC | Ridley Park, PA\nDuration: 6+ Months (Extension Possible)\nEmployment Type: W2 Only\nWork Authorization: US Citizen or Green Card Holders Only\nPosition Overview\nWe are seeking an experienced Data Engineer with strong Azure Databricks expertise to support a large-scale enterprise data migration and modernization initiative. This role requires a well-rounded engineer with hands-on experience across the full software development lifecycle, including architecture, development, migration, deployment, production support, and ongoing optimization of cloud-based data platforms.\nThe ideal candidate will possess deep expertise in Python, PySpark, Azure Databricks, SQL, Azure services, CI/CD, Infrastructure as Code, and production operations. This position involves close collaboration with business stakeholders, application teams, infrastructure teams, and data consumers to deliver scalable, secure, and high-performing data solutions.\nWork Breakdown\n60% Development & Engineering\n20% Business & Stakeholder Collaboration\n20% Production Support & Operations\nRequired Technical SkillsData Engineering & Development\nStrong programming experience in Python and PySpark\nAdvanced SQL skills for analytics, ETL, and data transformation workloads\nExperience designing, developing, and optimizing large-scale ETL/ELT pipelines\nStrong understanding of data modeling, data integration, and data governance principles\nExperience processing large volumes of structured and unstructured data\nAzure Databricks\nHands-on experience with Azure Databricks\nCluster configuration, optimization, and management\nJob orchestration and scheduling\nWorkspace administration and governance\nPerformance tuning and workload optimization\nMonitoring and troubleshooting production workloads\nAzure Cloud Services\nStrong experience with:\nAzure Storage Accounts\nAzure Synapse Analytics\nAzure Key Vault\nVirtual Machine Scale Sets (VMSS)\nAzure Function Apps\nAzure Web Apps\nAzure Log Analytics Workspace\nService Principals\nManaged Identities\nAzure Container Apps (ACA)\nAzure Container Instances\nInfrastructure & DevOps\nExperience creating and managing Azure infrastructure using ARM Templates\nStrong experience with GitLab and Azure DevOps\nCI/CD pipeline development and release management\nSource control and branching strategies\nInfrastructure as Code (IaC) best practices\nSecurity & Networking\nExperience implementing secure access using:\nAzure Active Directory\nManaged Identities\nService Principals\nUnderstanding of Azure networking concepts\nExperience integrating secure networking solutions within cloud data platforms\nSoft Skills\nExcellent communication and stakeholder management skills\nStrong analytical and problem-solving abilities\nAbility to work effectively in Agile/Scrum environments\nExperience collaborating with cross-functional teams and business users\nKey Responsibilities\nDesign, develop, and maintain end-to-end data pipelines and ETL/ELT solutions using Python and PySpark.\nBuild, optimize, and support large-scale data processing workloads within Azure Databricks.\nConfigure and manage Databricks clusters, job scheduling, governance controls, and monitoring frameworks.\nDevelop scalable and secure cloud-based data integration solutions using Azure services.\nCollaborate with business stakeholders and application teams to gather requirements and translate them into technical solutions.\nImplement secure authentication and authorization mechanisms using Azure Active Directory, Managed Identities, and Service Principals.\nCreate and maintain Infrastructure as Code (IaC) solutions using ARM Templates.\nConfigure and support Azure services including Storage Accounts, Synapse, Key Vault, VMSS, Function Apps, Web Apps, Log Analytics Workspace, and Container Services.\nPartner with networking and security teams to design secure cloud-based data architectures.\nImplement monitoring, alerting, logging, and cost optimization strategies across data workloads.\nBuild and maintain CI/CD pipelines using GitLab and Azure DevOps.\nSupport production deployments, incident management, troubleshooting, and operational activities.\nParticipate in Agile ceremonies including sprint planning, daily stand-ups, backlog grooming, and retrospectives.\nEnsure compliance with enterprise data governance, lineage, security, and regulatory requirements.\nProvide on-call and production support for critical business applications and data platforms.\nWork closely with both legacy and modernization teams to support enterprise transformation initiatives.\nIdeal Candidate Profile\nThe ideal candidate will have:\n8+ years of Data Engineering experience\nStrong Azure Databricks implementation experience\nProven experience in large-scale migration and modernization projects\nExperience owning solutions from development through production deployment and support\nStrong cloud engineering, automation, and operational support background\nAbility to thrive in a highly collaborative enterprise environment\nPay: $55.00 - $60.00 per hour\nWork Location: In person","company":"Scalable Systems","rawCompany":"scalable systems","city":"Dallas","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-08-04T21:57:03.927Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer – Azure Databricks","description":"Data Engineer – Azure Databricks\nLocation: Seattle, WA (Preferred)\nAlso Open To: St. Louis, MO | Dallas/Plano, TX | Charleston, SC | Ridley Park, PA\nDuration: 6+ Months (Extension Possible)\nEmployment Type: W2 Only\nWork Authorization: US Citizen or Green Card Holders Only\nPosition Overview\nWe are seeking an experienced Data Engineer with strong Azure Databricks expertise to support a large-scale enterprise data migration and modernization initiative. This role requires a well-rounded engineer with hands-on experience across the full software development lifecycle, including architecture, development, migration, deployment, production support, and ongoing optimization of cloud-based data platforms.\nThe ideal candidate will possess deep expertise in Python, PySpark, Azure Databricks, SQL, Azure services, CI/CD, Infrastructure as Code, and production operations. This position involves close collaboration with business stakeholders, application teams, infrastructure teams, and data consumers to deliver scalable, secure, and high-performing data solutions.\nWork Breakdown\n60% Development & Engineering\n20% Business & Stakeholder Collaboration\n20% Production Support & Operations\nRequired Technical SkillsData Engineering & Development\nStrong programming experience in Python and PySpark\nAdvanced SQL skills for analytics, ETL, and data transformation workloads\nExperience designing, developing, and optimizing large-scale ETL/ELT pipelines\nStrong understanding of data modeling, data integration, and data governance principles\nExperience processing large volumes of structured and unstructured data\nAzure Databricks\nHands-on experience with Azure Databricks\nCluster configuration, optimization, and management\nJob orchestration and scheduling\nWorkspace administration and governance\nPerformance tuning and workload optimization\nMonitoring and troubleshooting production workloads\nAzure Cloud Services\nStrong experience with:\nAzure Storage Accounts\nAzure Synapse Analytics\nAzure Key Vault\nVirtual Machine Scale Sets (VMSS)\nAzure Function Apps\nAzure Web Apps\nAzure Log Analytics Workspace\nService Principals\nManaged Identities\nAzure Container Apps (ACA)\nAzure Container Instances\nInfrastructure & DevOps\nExperience creating and managing Azure infrastructure using ARM Templates\nStrong experience with GitLab and Azure DevOps\nCI/CD pipeline development and release management\nSource control and branching strategies\nInfrastructure as Code (IaC) best practices\nSecurity & Networking\nExperience implementing secure access using:\nAzure Active Directory\nManaged Identities\nService Principals\nUnderstanding of Azure networking concepts\nExperience integrating secure networking solutions within cloud data platforms\nSoft Skills\nExcellent communication and stakeholder management skills\nStrong analytical and problem-solving abilities\nAbility to work effectively in Agile/Scrum environments\nExperience collaborating with cross-functional teams and business users\nKey Responsibilities\nDesign, develop, and maintain end-to-end data pipelines and ETL/ELT solutions using Python and PySpark.\nBuild, optimize, and support large-scale data processing workloads within Azure Databricks.\nConfigure and manage Databricks clusters, job scheduling, governance controls, and monitoring frameworks.\nDevelop scalable and secure cloud-based data integration solutions using Azure services.\nCollaborate with business stakeholders and application teams to gather requirements and translate them into technical solutions.\nImplement secure authentication and authorization mechanisms using Azure Active Directory, Managed Identities, and Service Principals.\nCreate and maintain Infrastructure as Code (IaC) solutions using ARM Templates.\nConfigure and support Azure services including Storage Accounts, Synapse, Key Vault, VMSS, Function Apps, Web Apps, Log Analytics Workspace, and Container Services.\nPartner with networking and security teams to design secure cloud-based data architectures.\nImplement monitoring, alerting, logging, and cost optimization strategies across data workloads.\nBuild and maintain CI/CD pipelines using GitLab and Azure DevOps.\nSupport production deployments, incident management, troubleshooting, and operational activities.\nParticipate in Agile ceremonies including sprint planning, daily stand-ups, backlog grooming, and retrospectives.\nEnsure compliance with enterprise data governance, lineage, security, and regulatory requirements.\nProvide on-call and production support for critical business applications and data platforms.\nWork closely with both legacy and modernization teams to support enterprise transformation initiatives.\nIdeal Candidate Profile\nThe ideal candidate will have:\n8+ years of Data Engineering experience\nStrong Azure Databricks implementation experience\nProven experience in large-scale migration and modernization projects\nExperience owning solutions from development through production deployment and support\nStrong cloud engineering, automation, and operational support background\nAbility to thrive in a highly collaborative enterprise environment\nPay: $55.00 - $60.00 per hour\nWork Location: In person","datePosted":"2026-08-04T21:57:03.927Z","dateModified":"2026-08-04T21:57:03.927Z","hiringOrganization":{"@type":"Organization","name":"Scalable Systems","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Dallas","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b3b1bda7ea05b2d4c3717f0a"},"url":"https://jobsearcher.com/jobs/b3b1bda7ea05b2d4c3717f0a"}}