{"schemaVersion":"jobsearcher.job.v1","id":"fc63da8804a75e92f755ed7e","url":"https://jobsearcher.com/jobs/fc63da8804a75e92f755ed7e","canonicalUrl":"https://jobsearcher.com/jobs/fc63da8804a75e92f755ed7e","title":"Lead Data Engineer","description":"Job Summary:\nWe are seeking a skilled Senior Data Engineer with strong expertise in Databricks, Python, PySpark, AWS, and Medallion Architecture (Bronze, Silver, Gold layers) to design, build, and optimize scalable data pipelines and modern data platforms. The ideal candidate will have experience developing cloud-based data solutions, implementing data lakehouse architectures, and transforming large volumes of structured and unstructured data into reliable business-ready datasets.\nKey Responsibilities\nDesign, develop, and maintain scalable data pipelines using Databricks, PySpark, and Python.\nBuild and manage data lakehouse solutions utilizing Medallion Architecture (Bronze, Silver, Gold layers).\nDevelop ETL/ELT processes to ingest, transform, and load data from various sources.\nOptimize data processing workflows for performance, scalability, and cost efficiency.\nCollaborate with Data Analysts, Data Scientists, and Business Stakeholders to understand data requirements.\nImplement data quality, validation, monitoring, and governance processes.\nCreate and maintain technical documentation, data models, and architecture diagrams.\nTroubleshoot and resolve data pipeline issues and production incidents.\nFollow best practices for security, compliance, and data management.\nRequired Qualifications\nBachelor's degree in Computer Science, Information Technology, Engineering, or a related field.\n10+ years of experience in Data Engineering.\nStrong hands-on experience with Databricks.\nProficiency in Python and PySpark.\nExperience implementing Medallion Architecture (Bronze, Silver, Gold layers).\nExperience building and optimizing large-scale ETL/ELT pipelines.\nUnderstanding of Data Lake, Data Warehouse, and Lakehouse concepts.\nExperience with SQL and performance tuning.\nStrong problem-solving and analytical skills.\nPay: $65.00 - $75.00 per hour\nWork Location: Remote","company":"Chavinsan Workforce Solutions","rawCompany":"chavinsan workforce solutions","city":"Remote","state":"OR","isRemote":false,"isActive":false,"createdAt":"2026-08-13T14:36:50.787Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer","description":"Job Summary:\nWe are seeking a skilled Senior Data Engineer with strong expertise in Databricks, Python, PySpark, AWS, and Medallion Architecture (Bronze, Silver, Gold layers) to design, build, and optimize scalable data pipelines and modern data platforms. The ideal candidate will have experience developing cloud-based data solutions, implementing data lakehouse architectures, and transforming large volumes of structured and unstructured data into reliable business-ready datasets.\nKey Responsibilities\nDesign, develop, and maintain scalable data pipelines using Databricks, PySpark, and Python.\nBuild and manage data lakehouse solutions utilizing Medallion Architecture (Bronze, Silver, Gold layers).\nDevelop ETL/ELT processes to ingest, transform, and load data from various sources.\nOptimize data processing workflows for performance, scalability, and cost efficiency.\nCollaborate with Data Analysts, Data Scientists, and Business Stakeholders to understand data requirements.\nImplement data quality, validation, monitoring, and governance processes.\nCreate and maintain technical documentation, data models, and architecture diagrams.\nTroubleshoot and resolve data pipeline issues and production incidents.\nFollow best practices for security, compliance, and data management.\nRequired Qualifications\nBachelor's degree in Computer Science, Information Technology, Engineering, or a related field.\n10+ years of experience in Data Engineering.\nStrong hands-on experience with Databricks.\nProficiency in Python and PySpark.\nExperience implementing Medallion Architecture (Bronze, Silver, Gold layers).\nExperience building and optimizing large-scale ETL/ELT pipelines.\nUnderstanding of Data Lake, Data Warehouse, and Lakehouse concepts.\nExperience with SQL and performance tuning.\nStrong problem-solving and analytical skills.\nPay: $65.00 - $75.00 per hour\nWork Location: Remote","datePosted":"2026-08-13T14:36:50.787Z","dateModified":"2026-08-13T14:36:50.787Z","hiringOrganization":{"@type":"Organization","name":"Chavinsan Workforce Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Remote","addressRegion":"OR","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"fc63da8804a75e92f755ed7e"},"url":"https://jobsearcher.com/jobs/fc63da8804a75e92f755ed7e"}}