{"schemaVersion":"jobsearcher.job.v1","id":"187f834a3d0b2bc3575761ab","url":"https://jobsearcher.com/jobs/187f834a3d0b2bc3575761ab","canonicalUrl":"https://jobsearcher.com/jobs/187f834a3d0b2bc3575761ab","title":"Apache Spark Platform Engineer","description":"*Apache Spark Platform Engineer *-Only W2\n\n*REMOTE *\n*Long Term*\n\nMust have skills:-\nData Mesh\nVirtualization\nMetadata\n\nResponsibilities :\nApache Spark:\nStrong understanding and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming.\n\nDatabricks:\nProficiency in using Azure Databricks, including setting up and managing clusters, notebooks, and jobs.\n\nPython and SQL:\nStrong programming skills in either Python and SQL as these are the primary languages used for writing Spark applications.\n\nData Processing and Analysis:\nExperience in designing and implementing data processing and analysis pipelines using Spark and Databricks.\n\nDistributed Computing:\nKnowledge of distributed computing concepts and experience with distributed computing frameworks like Spark.\n\nCloud Platform:\nFamiliarity with Azure cloud platform and its services, including Azure Data Factory, Azure access, Azure Storage, Azure Data Lake, and Azure SQL Database.\nData Engineering:\n\nUnderstanding of data engineering concepts and experience with ETL processes, data modeling, and data warehousing.\n\nPerformance Optimization:\nAbility to optimize Spark applications for performance and scalability, including tuning Spark configurations and leveraging Spark optimizations.\n\nData Security and Governance:\nUnderstanding of data security and governance practices, including data encryption, access controls, and compliance regulations.\n\nMonitoring and Troubleshooting:\nProficiency in monitoring and troubleshooting Spark applications, identifying and resolving performance bottlenecks or issues.\n\nCollaboration and Communication:\nExcellent communication skills and the ability to collaborate effectively with cross-functional teams, including data scientists, data engineers, and business stakeholders. Desired skills: •Must know Spark, Databricks, Azure, and Linux OS experience.\n•Experience in Spark platform performance improvements and Capacity planning. •Knowledge of cloud platform-based database troubleshooting.\n•Experience with CI/CD pipelines, version control systems (e.g., Git), and automated deployment of Spark applications.\n\nJob Type: Contract\n\nPay: $43.00 - $45.00 per hour\n\nSchedule:\n* 8 hour shift\n\nExperience:\n* Data Mesh: 5 years (Required)\n* Virtualization: 5 years (Required)\n* Metadata: 9 years (Required)\n* Apache Spark:: 8 years (Required)\n* Databricks:: 6 years (Required)\n* Python and SQL:: 8 years (Required)\n* Data Processing and Analysis:: 1 year (Required)\n* Azure Data Factory, Azure access, Azure Storage: 6 years (Required)\n* Azure Data Lake, and Azure SQL Database.: 6 years (Required)\n\nWork Location: Remote","company":"Apptrics","rawCompany":"apptrics","city":"Myrtle Point","state":"OR","isRemote":false,"isActive":false,"createdAt":"2026-09-28T10:46:26.925Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Apache Spark Platform Engineer","description":"*Apache Spark Platform Engineer *-Only W2\n\n*REMOTE *\n*Long Term*\n\nMust have skills:-\nData Mesh\nVirtualization\nMetadata\n\nResponsibilities :\nApache Spark:\nStrong understanding and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming.\n\nDatabricks:\nProficiency in using Azure Databricks, including setting up and managing clusters, notebooks, and jobs.\n\nPython and SQL:\nStrong programming skills in either Python and SQL as these are the primary languages used for writing Spark applications.\n\nData Processing and Analysis:\nExperience in designing and implementing data processing and analysis pipelines using Spark and Databricks.\n\nDistributed Computing:\nKnowledge of distributed computing concepts and experience with distributed computing frameworks like Spark.\n\nCloud Platform:\nFamiliarity with Azure cloud platform and its services, including Azure Data Factory, Azure access, Azure Storage, Azure Data Lake, and Azure SQL Database.\nData Engineering:\n\nUnderstanding of data engineering concepts and experience with ETL processes, data modeling, and data warehousing.\n\nPerformance Optimization:\nAbility to optimize Spark applications for performance and scalability, including tuning Spark configurations and leveraging Spark optimizations.\n\nData Security and Governance:\nUnderstanding of data security and governance practices, including data encryption, access controls, and compliance regulations.\n\nMonitoring and Troubleshooting:\nProficiency in monitoring and troubleshooting Spark applications, identifying and resolving performance bottlenecks or issues.\n\nCollaboration and Communication:\nExcellent communication skills and the ability to collaborate effectively with cross-functional teams, including data scientists, data engineers, and business stakeholders. Desired skills: •Must know Spark, Databricks, Azure, and Linux OS experience.\n•Experience in Spark platform performance improvements and Capacity planning. •Knowledge of cloud platform-based database troubleshooting.\n•Experience with CI/CD pipelines, version control systems (e.g., Git), and automated deployment of Spark applications.\n\nJob Type: Contract\n\nPay: $43.00 - $45.00 per hour\n\nSchedule:\n* 8 hour shift\n\nExperience:\n* Data Mesh: 5 years (Required)\n* Virtualization: 5 years (Required)\n* Metadata: 9 years (Required)\n* Apache Spark:: 8 years (Required)\n* Databricks:: 6 years (Required)\n* Python and SQL:: 8 years (Required)\n* Data Processing and Analysis:: 1 year (Required)\n* Azure Data Factory, Azure access, Azure Storage: 6 years (Required)\n* Azure Data Lake, and Azure SQL Database.: 6 years (Required)\n\nWork Location: Remote","datePosted":"2026-09-28T10:46:26.925Z","dateModified":"2026-09-28T10:46:26.925Z","hiringOrganization":{"@type":"Organization","name":"Apptrics","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Myrtle Point","addressRegion":"OR","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"187f834a3d0b2bc3575761ab"},"url":"https://jobsearcher.com/jobs/187f834a3d0b2bc3575761ab"}}