Python PySpark/ Data Engineer

Overview As a Python PySpark/Data Engineer at HAN Staffing, you will design and implement cloud-based data pipelines to support analytics. You will migrate and develop data solutions on AWS, and build real-time streaming processes with Spark. You’ll leverage Databricks or similar cloud databases, write optimized SQL, and follow data-lake architecture best practices. This role offers impact through scalable data platforms and collaboration with cross-functional teams to enable data-driven decisions. ResponsibilitiesDesign and implement cloud-based data pipelinesMigrate and develop data solutions on AWSBuild data pipelines using Databricks or equivalentWrite complex, optimized SQL for large data volumesDevelop real-time data streams with SparkApply architectural best practices for data lakes Key requirements6+ years experience designing and implementing cloud data pipelines5+ years experience with AWS2+ years experience with Databricks or similar cloud databasesExpert SQL for large datasetsHands-on Python (object-oriented) programmingExperience building real-time data streams with SparkKnowledge of data lake architectural best practicesPythonPySparkSparkDatabricksSQLAWS