{"schemaVersion":"jobsearcher.job.v1","id":"b19b4198c44f5aece9725a46","url":"https://jobsearcher.com/jobs/b19b4198c44f5aece9725a46","canonicalUrl":"https://jobsearcher.com/jobs/b19b4198c44f5aece9725a46","title":"Data Platform Engineer","description":"Role : Data Platform Infrastructure EngineerLocation : Scottsdale, AZ (100% Onsite)Type: ContractJob Description:Role OverviewWe are seeking a highly skilled Data Platform Infrastructure Engineer to design, build, and manage scalable data platforms across on-premise and cloud environments. The role involves working with cluster technologies, infrastructure automation, and modern data ecosystems to enable reliable and high-performing data platforms.Key ResponsibilitiesDesign, deploy, and manage data platform infrastructure across on-prem (Cloudera) and cloud (AWS, Databricks) environmentsBuild and maintain distributed data clusters ensuring high availability, scalability, and performanceAutomate infrastructure provisioning using Terraform and AnsibleManage and optimize Cloudera Hadoop ecosystems (HDFS, Hive, Spark, YARN, etc.)Deploy and manage Databricks workspaces, clusters, and integrations on AWSImplement infrastructure-as-code (IaC) and configuration management best practicesMonitor cluster performance, troubleshoot issues, and ensure system reliabilityCollaborate with data engineers, architects, and DevOps teams to support data pipelines and analytics workloadsEnsure security, compliance, and governance across data platformsSupport migration from on-prem to cloud-based data platformsTechnical Skills RequiredCore TechnologiesStrong experience in Cloudera (CDH/CDP) cluster setup and administrationHands-on experience with Databricks (cluster management, jobs, notebooks)Strong exposure to AWS (EC2, S3, IAM, VPC, EMR, networking concepts)Infrastructure & AutomationExpertise in Terraform (mandatory) for infrastructure provisioningProficiency in Ansible for configuration management and automationExperience with CI/CD pipelines for infrastructure deploymentsCluster & Data TechnologiesExperience managing distributed systems / cluster technologiesStrong understanding of: Hadoop ecosystem (HDFS, Hive, Spark, Kafka, etc.)Spark performance tuning and cluster optimizationKnowledge of containerization (Docker/Kubernetes) is a plusPreferred Skill Combination (Must-Have Exposure to One or Both):Cloudera + Ansible + Terraform + AWSCloudera + Databricks + Terraform + AWS","company":"Arkhya Tech","rawCompany":"arkhya tech","city":"Scottsdale","state":"AZ","isRemote":false,"isActive":false,"createdAt":"2026-07-15T09:19:33.232Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Platform Engineer","description":"Role : Data Platform Infrastructure EngineerLocation : Scottsdale, AZ (100% Onsite)Type: ContractJob Description:Role OverviewWe are seeking a highly skilled Data Platform Infrastructure Engineer to design, build, and manage scalable data platforms across on-premise and cloud environments. The role involves working with cluster technologies, infrastructure automation, and modern data ecosystems to enable reliable and high-performing data platforms.Key ResponsibilitiesDesign, deploy, and manage data platform infrastructure across on-prem (Cloudera) and cloud (AWS, Databricks) environmentsBuild and maintain distributed data clusters ensuring high availability, scalability, and performanceAutomate infrastructure provisioning using Terraform and AnsibleManage and optimize Cloudera Hadoop ecosystems (HDFS, Hive, Spark, YARN, etc.)Deploy and manage Databricks workspaces, clusters, and integrations on AWSImplement infrastructure-as-code (IaC) and configuration management best practicesMonitor cluster performance, troubleshoot issues, and ensure system reliabilityCollaborate with data engineers, architects, and DevOps teams to support data pipelines and analytics workloadsEnsure security, compliance, and governance across data platformsSupport migration from on-prem to cloud-based data platformsTechnical Skills RequiredCore TechnologiesStrong experience in Cloudera (CDH/CDP) cluster setup and administrationHands-on experience with Databricks (cluster management, jobs, notebooks)Strong exposure to AWS (EC2, S3, IAM, VPC, EMR, networking concepts)Infrastructure & AutomationExpertise in Terraform (mandatory) for infrastructure provisioningProficiency in Ansible for configuration management and automationExperience with CI/CD pipelines for infrastructure deploymentsCluster & Data TechnologiesExperience managing distributed systems / cluster technologiesStrong understanding of: Hadoop ecosystem (HDFS, Hive, Spark, Kafka, etc.)Spark performance tuning and cluster optimizationKnowledge of containerization (Docker/Kubernetes) is a plusPreferred Skill Combination (Must-Have Exposure to One or Both):Cloudera + Ansible + Terraform + AWSCloudera + Databricks + Terraform + AWS","datePosted":"2026-07-15T09:19:33.232Z","dateModified":"2026-07-15T09:19:33.232Z","hiringOrganization":{"@type":"Organization","name":"Arkhya Tech","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Scottsdale","addressRegion":"AZ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b19b4198c44f5aece9725a46"},"url":"https://jobsearcher.com/jobs/b19b4198c44f5aece9725a46"}}