JOBSEARCHER

Python PySpark/ Data Engineer

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

Overview: As a Python PySpark/Data Engineer at HAN Staffing, you will design and implement cloud-based data pipelines to support analytics. You will migrate and develop data solutions on AWS, and build real-time streaming processes with Spark. You’ll leverage Databricks or similar cloud databases, write optimized SQL, and follow data-lake architecture best practices. This role offers impact through scalable data platforms and collaboration with cross-functional teams to enable data-driven decisions.
Responsibilities: Design and implement cloud-based data pipelinesMigrate and develop data solutions on AWSBuild data pipelines using Databricks or equivalentWrite complex, optimized SQL for large data volumesDevelop real-time data streams with SparkApply architectural best practices for data lakes
Key requirements: 6+ years experience designing and implementing cloud data pipelines 5+ years experience with AWS2+ years experience with Databricks or similar cloud databasesExpert SQL for large datasetsHands-on Python (object-oriented) programmingExperience building real-time data streams with SparkKnowledge of data lake architectural best practicesPythonPySparkSparkDatabricksSQLAWS