AWS Databricks Developer - Python
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Role: AWS Databricks EngineerLocation: Irvine CAType - ContractWe are looking for a skilled AWS Databricks Engineer with strong expertise in Python, distributed data processing, and cloud-based data engineering solutions. The candidate will design, develop, optimize, and maintain scalable data pipelines and analytics platforms using Databricks, Apache Spark, and AWS cloud services.The ideal candidate should have hands-on experience in building ETL/ELT workflows, performance optimization, data lake architecture, and implementing scalable big data solutions.Key ResponsibilitiesDesign and develop scalable ETL/ELT pipelines using PySpark and DatabricksBuild and maintain data ingestion frameworks from multiple structured and unstructured data sourcesDevelop reusable Python modules, utilities, and data processing frameworksImplement data lake and lakehouse architectures on AWSOptimize Spark jobs for performance, scalability, and cost efficiencyCreate and manage Delta Lake tables and workflowsCollaborate with data analysts, architects, and business stakeholdersImplement CI/CD pipelines and deployment automationMonitor production jobs and troubleshoot data pipeline issuesEnsure data quality, governance, and security best practices