Senior PySpark Developer

🚀 We're Hiring: Senior PySpark Developer | Long-Term Contract | Remote📍 Location: Remote 📄 Duration: Long-term contractAbout the Role: You'll design, develop, and optimize scalable data pipelines that ingest, transform, and process large volumes of enterprise data — working closely with data architects, business analysts, cloud engineers, and application teams to deliver reliable, high-performance data solutions supporting analytics, reporting, and operational workloads.Required Qualifications ✅ Bachelor's degree in Computer Science, Information Systems, Engineering, or related field ✅ 10+ years of IT experience, with 6+ years in Data Engineering / Big Data development ✅ Strong hands-on experience with PySpark and Spark-based data processing ✅ Experience developing data pipelines on Cloudera Data Platform (CDP) ✅ Strong knowledge of Apache Iceberg table architecture and data lake concepts ✅ Experience designing and managing workflows using Apache Airflow ✅ Experience with SQL and data modeling techniques ✅ Strong understanding of ETL/ELT development and data transformation frameworks ✅ Experience with large-scale structured and unstructured datasets ✅ Knowledge of Git, CI/CD pipelines, and DevOps practices ✅ Strong analytical, troubleshooting, and problem-solving skills ✅ Excellent communication and collaboration skillsPreferred Qualifications ⭐ Experience with AWS services: S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, CloudWatch ⭐ Experience building cloud-native data lake and Lakehouse solutions ⭐ Strong knowledge of data partitioning, performance tuning, and query optimization ⭐ Experience with Kafka or event-driven data processing frameworks ⭐ Experience with Java or Python application development ⭐ Experience implementing data quality, metadata, and data governance solutions ⭐ Healthcare, Medicaid, Claims Processing, or Insurance industry experience ⭐ Experience in Agile development environments ⭐ AWS Certification and/or Cloudera Certification preferred ⭐ Experience supporting large-scale cloud migration and modernization initiatives📩 Interested candidates, please apply directly or send your resume.Thanks & Regards,Sapna Daniel- Lead – US IT Recruitment✉️ sapna@quebecsol.com|🔗 LinkedIn: sapna-daniel1a8512140🌐 Delivering Talent and driving Success.Connecting Top Talent with the Right Opportunities