{"schemaVersion":"jobsearcher.job.v1","id":"6ec52a3ce1573fa04be68644","url":"https://jobsearcher.com/jobs/6ec52a3ce1573fa04be68644","canonicalUrl":"https://jobsearcher.com/jobs/6ec52a3ce1573fa04be68644","title":"Lead Data Engineer - Remote must be in USA","description":"Lead Data Engineer Remote must be in USA Skill Set: Pyspark, Python, AWS, GIS, Palantir Foundry Need a SME in Python coding (Data structures and algorithms) Responsibilities • Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. • Collaborate with product and technology teams to design and validate the capabilities of the data platform • Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability • Provide technical support and usage guidance to the users of our platform's services. • Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services. Qualifications • Experience building and optimizing data pipelines in a distributed environment • Experience supporting and working with cross-functional teams • Proficiency working in Linux environment • 5+ years of advanced working knowledge of SQL, Python, and PySpark • Knowledge on Palantir • Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline • Experience with platform monitoring and alerts tools","company":"Rootshell Enterprise Technologies","rawCompany":"rootshell enterprise technologies","isRemote":true,"isActive":false,"createdAt":"2026-07-19T00:29:09.963Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer - Remote must be in USA","description":"Lead Data Engineer Remote must be in USA Skill Set: Pyspark, Python, AWS, GIS, Palantir Foundry Need a SME in Python coding (Data structures and algorithms) Responsibilities • Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. • Collaborate with product and technology teams to design and validate the capabilities of the data platform • Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability • Provide technical support and usage guidance to the users of our platform's services. • Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services. Qualifications • Experience building and optimizing data pipelines in a distributed environment • Experience supporting and working with cross-functional teams • Proficiency working in Linux environment • 5+ years of advanced working knowledge of SQL, Python, and PySpark • Knowledge on Palantir • Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline • Experience with platform monitoring and alerts tools","datePosted":"2026-07-19T00:29:09.963Z","dateModified":"2026-07-19T00:29:09.963Z","hiringOrganization":{"@type":"Organization","name":"Rootshell Enterprise Technologies","sameAs":"https://jobsearcher.com"},"jobLocationType":"TELECOMMUTE","applicantLocationRequirements":{"@type":"Country","name":"US"},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"6ec52a3ce1573fa04be68644"},"url":"https://jobsearcher.com/jobs/6ec52a3ce1573fa04be68644"}}