JOBSEARCHER

Senior PySpark Developer

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

🚀 We're Hiring: Senior PySpark Developer | Long-Term Contract | Remote📍 Location: Remote 📄 Duration: Long-term contract
About the Role: You'll design, develop, and optimize scalable data pipelines that ingest, transform, and process large volumes of enterprise data — working closely with data architects, business analysts, cloud engineers, and application teams to deliver reliable, high-performance data solutions supporting analytics, reporting, and operational workloads.
Required Qualifications: ✅ Bachelor's degree in Computer Science, Information Systems, Engineering, or related field ✅ 10+ years of IT experience, with 6+ years in Data Engineering / Big Data development ✅ Strong hands-on experience with PySpark and Spark-based data processing ✅ Experience developing data pipelines on Cloudera Data Platform (CDP) ✅ Strong knowledge of Apache Iceberg table architecture and data lake concepts ✅ Experience designing and managing workflows using Apache Airflow ✅ Experience with SQL and data modeling techniques ✅ Strong understanding of ETL/ELT development and data transformation frameworks ✅ Experience with large-scale structured and unstructured datasets ✅ Knowledge of Git, CI/CD pipelines, and DevOps practices ✅ Strong analytical, troubleshooting, and problem-solving skills ✅ Excellent communication and collaboration skills
Preferred Qualifications: ⭐ Experience with AWS services: S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, CloudWatch ⭐ Experience building cloud-native data lake and Lakehouse solutions ⭐ Strong knowledge of data partitioning, performance tuning, and query optimization ⭐ Experience with Kafka or event-driven data processing frameworks ⭐ Experience with Java or Python application development ⭐ Experience implementing data quality, metadata, and data governance solutions ⭐ Healthcare, Medicaid, Claims Processing, or Insurance industry experience ⭐ Experience in Agile development environments ⭐ AWS Certification and/or Cloudera Certification preferred ⭐ Experience supporting large-scale cloud migration and modernization initiatives📩 Interested candidates, please apply directly or send your resume. Thanks & Regards, Sapna Daniel- Lead – US IT Recruitment✉️ sapna@quebecsol.com|🔗 LinkedIn: sapna-daniel1a8512140🌐 Delivering Talent and driving Success. Connecting Top Talent with the Right Opportunities