JOBSEARCHER

Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

Job Description
Job Title: Technical Lead Data Engineering (Palantir, Spark, PySpark, Python)
Please dont apply if you dont havePALANTIRexperienceOnsite work :One or two days in a month W2 role OPT with 7 years exp is fine
Job Summary: We are looking for a hands-on Technical Lead in Data Engineering to drive the design, development, and delivery of scalable data solutions in a large retail enterprise. This role requires strong expertise in Palantir Foundry, Spark/PySpark, SQL, and Python, along with the ability to lead engineering teams and partner with business stakeholders across supply chain, merchandising, and store operations.
Key Responsibilities: Lead the design and implementation ofscalable data platforms and pipelinesusing PySpark, Spark, and Python Drive adoption and best practices for Palantir Foundry(data pipelines, ontology, workflows, and operational applications) Architect and optimizehigh-performance data processing solutionsfor large-scale datasets Provide technical leadership and mentorship to data engineers, ensuring code quality and best practices Collaborate with cross-functional teams (business, analytics, data science) to translate requirements into scalable solutions Design robustdata models, ETL/ELT frameworks, and data integration strategies Ensuredata quality, governance, security, and complianceacross enterprise data platforms Lead performance tuning, troubleshooting, and optimization of data pipelines DriveCI/CD implementation, code reviews, and release management Stay current with emerging data engineering technologies and recommend improvements
Required Qualifications: Bachelors or Masters degree in Computer Science, Engineering, or related field 8+ years of experience indata engineering, with at least 23 years in atechnical leadership role Strong hands-on experience with: Python & PySpark Apache Spark AdvancedSQLExperience with Palantir Foundryor similar modern data platforms Deep understanding ofdata engineering principles(ETL/ELT, data modeling, distributed systems) Experience designing and managinglarge-scale data architectures Strong leadership, communication, and stakeholder management skills
Preferred Qualifications: Experience inretail domain(supply chain, inventory, merchandising, store analytics) Experience withcloud platforms(Azure, AWS, or GCP) Familiarity with orchestration tools (Airflow, Azure Data Factory, etc.) Experience withreal-time/streaming data pipelines Exposure to DevSecOps practices
Key Skills: Technical Leadership Data Engineering Architecture PySpark & Spark Python Programming SQL Optimization Palantir Foundry Data Modeling & Warehousing CI/CD & DevOpsFlexible work from home options available.