JOBSEARCHER

IT - Python PySpark Databricks Developer

Role: Python PySpark Databricks DeveloperLocation: Boston, MA onsiteWe are seeking a Python PySpark Databricks Developer with experience in building scalable data pipelines and processing large datasets. The ideal candidate will develop ETL/ELT solutions, optimize Spark jobs, and collaborate with cross-functional teams to deliver reliable data solutions.Key ResponsibilitiesDevelop and maintain ETL/ELT pipelines using Python, PySpark, and Databricks.Build and optimize Spark-based data processing workflows.Write efficient SQL queries for data extraction and transformation.Work with Delta Lake and cloud-based data platforms.Monitor, troubleshoot, and optimize data pipelines.Collaborate with data engineers, analysts, and business stakeholders.Required SkillsStrong experience in Python, PySpark, Databricks, and SQL.Knowledge of ETL processes and data warehousing concepts.Experience with Azure or AWS cloud platforms.Familiarity with Git and Agile development practices.Strong analytical and problem-solving skills.