{"schemaVersion":"jobsearcher.job.v1","id":"d28bee1c4a842a0ed99b7035","url":"https://jobsearcher.com/jobs/d28bee1c4a842a0ed99b7035","canonicalUrl":"https://jobsearcher.com/jobs/d28bee1c4a842a0ed99b7035","title":"Data Engineer","description":"Job DescriptionWe are looking for an experienced Data Engineer with strong Python and data engineering skills to support the development and processing of large-scale data pipelines. The ideal candidate will have hands-on experience with Databricks, AWS/S3, SQL, and Spark, along with exposure to machine learning data and large image datasets.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Python.Work with Databricks for large-scale data processing and transformation.Manage and process data stored in AWS S3 and other cloud-based environments.Develop complex SQL queries for data extraction, transformation, and analysis.Use Apache Spark for distributed data processing.Work with ML outputs and support data preparation for machine learning workflows.Process and manage large image datasets and associated metadata.Collaborate with data scientists, ML engineers, and software teams to deliver reliable data solutions.Troubleshoot data pipeline issues and ensure data quality, accuracy, and scalability.Required SkillsStrong Python programming and Data Engineering experienceDatabricksAWS / S3Strong SQLSpark experienceExperience working with Machine Learning data/outputsExperience handling large datasets, preferably including image dataMust Have: Python, Databricks, AWS/S3, SQL, Spark, and exposure to ML/image datasets.","company":"Pentangle Tech Services","rawCompany":"pentangle tech services p5 group","city":"Wi","state":"SD","isRemote":false,"isActive":false,"createdAt":"2026-08-19T13:26:24.774Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"Job DescriptionWe are looking for an experienced Data Engineer with strong Python and data engineering skills to support the development and processing of large-scale data pipelines. The ideal candidate will have hands-on experience with Databricks, AWS/S3, SQL, and Spark, along with exposure to machine learning data and large image datasets.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Python.Work with Databricks for large-scale data processing and transformation.Manage and process data stored in AWS S3 and other cloud-based environments.Develop complex SQL queries for data extraction, transformation, and analysis.Use Apache Spark for distributed data processing.Work with ML outputs and support data preparation for machine learning workflows.Process and manage large image datasets and associated metadata.Collaborate with data scientists, ML engineers, and software teams to deliver reliable data solutions.Troubleshoot data pipeline issues and ensure data quality, accuracy, and scalability.Required SkillsStrong Python programming and Data Engineering experienceDatabricksAWS / S3Strong SQLSpark experienceExperience working with Machine Learning data/outputsExperience handling large datasets, preferably including image dataMust Have: Python, Databricks, AWS/S3, SQL, Spark, and exposure to ML/image datasets.","datePosted":"2026-08-19T13:26:24.774Z","dateModified":"2026-08-19T13:26:24.774Z","hiringOrganization":{"@type":"Organization","name":"Pentangle Tech Services","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Wi","addressRegion":"SD","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"d28bee1c4a842a0ed99b7035"},"url":"https://jobsearcher.com/jobs/d28bee1c4a842a0ed99b7035"}}