{"schemaVersion":"jobsearcher.job.v1","id":"7059ab5c9a91c1ba2c111fce","url":"https://jobsearcher.com/jobs/7059ab5c9a91c1ba2c111fce","canonicalUrl":"https://jobsearcher.com/jobs/7059ab5c9a91c1ba2c111fce","title":"Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role","description":"Job Description\n\nJob Title: Technical Lead Data Engineering (Palantir, Spark, PySpark, Python)Please dont apply if you dont havePALANTIRexperienceOnsite work :One or two days in a month\r\nW2 role\r\nOPT with 7 years exp is fineJob SummaryWe are looking for a hands-on Technical Lead in Data Engineering to drive the design, development, and delivery of scalable data solutions in a large retail enterprise. This role requires strong expertise in Palantir Foundry, Spark/PySpark, SQL, and Python, along with the ability to lead engineering teams and partner with business stakeholders across supply chain, merchandising, and store operations.Key ResponsibilitiesLead the design and implementation ofscalable data platforms and pipelinesusingPySpark, Spark, and Python\r\nDrive adoption and best practices forPalantir Foundry(data pipelines, ontology, workflows, and operational applications)\r\nArchitect and optimizehigh-performance data processing solutionsfor large-scale datasets\r\nProvide technical leadership and mentorship to data engineers, ensuring code quality and best practices\r\nCollaborate with cross-functional teams (business, analytics, data science) to translate requirements into scalable solutions\r\nDesign robustdata models, ETL/ELT frameworks , and data integration strategies\r\nEnsuredata quality, governance, security, and complianceacross enterprise data platforms\r\nLead performance tuning, troubleshooting, and optimization of data pipelines\r\nDriveCI/CD implementation , code reviews, and release management\r\nStay current with emerging data engineering technologies and recommend improvements\r\nRequired QualificationsBachelors or Masters degree in Computer Science, Engineering, or related field\r\n8+ years of experience indata engineering , with at least 23 years in atechnical leadership role\r\nStrong hands-on experience with:Python & PySpark\r\nApache Spark\r\nAdvancedSQLExperience withPalantir Foundryor similar modern data platforms\r\nDeep understanding ofdata engineering principles(ETL/ELT, data modeling, distributed systems)\r\nExperience designing and managinglarge-scale data architectures\r\nStrong leadership, communication, and stakeholder management skills\r\nPreferred QualificationsExperience inretail domain(supply chain, inventory, merchandising, store analytics)\r\nExperience withcloud platforms(Azure, AWS, or GCP)\r\nFamiliarity with orchestration tools (Airflow, Azure Data Factory, etc.)\r\nExperience withreal-time/streaming data pipelines\r\nExposure to DevSecOps practices\r\nKey SkillsTechnical Leadership\r\nData Engineering Architecture\r\nPySpark & Spark\r\nPython Programming\r\nSQL Optimization\r\nPalantir Foundry\r\nData Modeling & Warehousing\r\nCI/CD & DevOpsFlexible work from home options available.","company":"Cloudscouts Software Solutions","rawCompany":"cloudscouts software solutions","city":"Frisco","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-06-02T04:24:34.333Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role","description":"Job Description\n\nJob Title: Technical Lead Data Engineering (Palantir, Spark, PySpark, Python)Please dont apply if you dont havePALANTIRexperienceOnsite work :One or two days in a month\r\nW2 role\r\nOPT with 7 years exp is fineJob SummaryWe are looking for a hands-on Technical Lead in Data Engineering to drive the design, development, and delivery of scalable data solutions in a large retail enterprise. This role requires strong expertise in Palantir Foundry, Spark/PySpark, SQL, and Python, along with the ability to lead engineering teams and partner with business stakeholders across supply chain, merchandising, and store operations.Key ResponsibilitiesLead the design and implementation ofscalable data platforms and pipelinesusingPySpark, Spark, and Python\r\nDrive adoption and best practices forPalantir Foundry(data pipelines, ontology, workflows, and operational applications)\r\nArchitect and optimizehigh-performance data processing solutionsfor large-scale datasets\r\nProvide technical leadership and mentorship to data engineers, ensuring code quality and best practices\r\nCollaborate with cross-functional teams (business, analytics, data science) to translate requirements into scalable solutions\r\nDesign robustdata models, ETL/ELT frameworks , and data integration strategies\r\nEnsuredata quality, governance, security, and complianceacross enterprise data platforms\r\nLead performance tuning, troubleshooting, and optimization of data pipelines\r\nDriveCI/CD implementation , code reviews, and release management\r\nStay current with emerging data engineering technologies and recommend improvements\r\nRequired QualificationsBachelors or Masters degree in Computer Science, Engineering, or related field\r\n8+ years of experience indata engineering , with at least 23 years in atechnical leadership role\r\nStrong hands-on experience with:Python & PySpark\r\nApache Spark\r\nAdvancedSQLExperience withPalantir Foundryor similar modern data platforms\r\nDeep understanding ofdata engineering principles(ETL/ELT, data modeling, distributed systems)\r\nExperience designing and managinglarge-scale data architectures\r\nStrong leadership, communication, and stakeholder management skills\r\nPreferred QualificationsExperience inretail domain(supply chain, inventory, merchandising, store analytics)\r\nExperience withcloud platforms(Azure, AWS, or GCP)\r\nFamiliarity with orchestration tools (Airflow, Azure Data Factory, etc.)\r\nExperience withreal-time/streaming data pipelines\r\nExposure to DevSecOps practices\r\nKey SkillsTechnical Leadership\r\nData Engineering Architecture\r\nPySpark & Spark\r\nPython Programming\r\nSQL Optimization\r\nPalantir Foundry\r\nData Modeling & Warehousing\r\nCI/CD & DevOpsFlexible work from home options available.","datePosted":"2026-06-02T04:24:34.333Z","dateModified":"2026-06-02T04:24:34.333Z","hiringOrganization":{"@type":"Organization","name":"Cloudscouts Software Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Frisco","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"7059ab5c9a91c1ba2c111fce"},"url":"https://jobsearcher.com/jobs/7059ab5c9a91c1ba2c111fce"}}