{"schemaVersion":"jobsearcher.job.v1","id":"4a3bee091634a2ae5a81a413","url":"https://jobsearcher.com/jobs/4a3bee091634a2ae5a81a413","canonicalUrl":"https://jobsearcher.com/jobs/4a3bee091634a2ae5a81a413","title":"Azure Databricks Lead with Java","description":"Job Title - Azure Databricks Lead with JavaLocation - Alpharetta GA (or) Berkley Hills NJ - 5 days onsite / weelkHire Type - Long Term Contract1. Role OverviewExperienced Data Technical Lead to design, develop, and support scalable cloud-based data platforms and streaming data pipelines.The ideal candidate should possess strong expertise in Databricks, PySpark, Python, Java-based streaming technologies, GitLab CI/CD pipelines, and cloud migration initiatives.2. Key Responsibilities- Design and develop scalable Databricks ETL/ELT pipelines (Lakeflow & LakeBase) using Azure Databricks, PySpark, and Python.- Implement real-time and batch data ingestion frameworks using Kafka and Java-based streaming solutions.- Develop and optimize data processing workflows in Azure Databricks.- Integrate and manage data movement between PostgreSQL, YugabyteDB (Cassandra-based NoSQL), and cloud platforms.- Build reusable frameworks for data ingestion, transformation, validation, and orchestration.- Develop SQL-based data transformations, reporting datasets, and performance optimization solutions.- Design and implement GitLab CI/CD pipelines for automated deployment, testing, and release management of Databricks notebooks, jobs, and data pipelines.- Support Snowflake on-premises to Azure cloud migration initiatives.- Ensure coding standards, performance tuning, monitoring, and operational stability of data pipelines.- Develop Power BI dashboards and reports for business intelligence and analytics reporting.- Develop API automation and integration solutions for data exchange between enterprise systems.3. Required Skills.- Strong experience in Python and PySpark development.- Hands-on experience with Azure Databricks and databricks SQL.- Experience in Java-based streaming and ingestion frameworks.- Strong knowledge of Apache Kafka streaming concepts.- Experience working with PostgreSQL databases.- Experience with YugabyteDB or Cassandra-based NoSQL databases.- Strong SQL development and query optimization skills.- Hands-on experience with GitLab CI/CD pipeline development and deployment automation.- Understanding cloud-based data engineering and distributed processing concepts.- Experience in data migration projects, especially Snowflake on-prem to Azure cloud migration.- Experience designing enterprise-scale data lake or lakehouse architectures.- Knowledge of streaming architectures and real-time analytics.- Familiarity with cloud monitoring and observability tools.","company":"Envision Technology Solutions","rawCompany":"envision technology solutions","city":"Berkeley Heights","state":"NJ","isRemote":false,"isActive":false,"createdAt":"2026-06-17T04:22:42.956Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Azure Databricks Lead with Java","description":"Job Title - Azure Databricks Lead with JavaLocation - Alpharetta GA (or) Berkley Hills NJ - 5 days onsite / weelkHire Type - Long Term Contract1. Role OverviewExperienced Data Technical Lead to design, develop, and support scalable cloud-based data platforms and streaming data pipelines.The ideal candidate should possess strong expertise in Databricks, PySpark, Python, Java-based streaming technologies, GitLab CI/CD pipelines, and cloud migration initiatives.2. Key Responsibilities- Design and develop scalable Databricks ETL/ELT pipelines (Lakeflow & LakeBase) using Azure Databricks, PySpark, and Python.- Implement real-time and batch data ingestion frameworks using Kafka and Java-based streaming solutions.- Develop and optimize data processing workflows in Azure Databricks.- Integrate and manage data movement between PostgreSQL, YugabyteDB (Cassandra-based NoSQL), and cloud platforms.- Build reusable frameworks for data ingestion, transformation, validation, and orchestration.- Develop SQL-based data transformations, reporting datasets, and performance optimization solutions.- Design and implement GitLab CI/CD pipelines for automated deployment, testing, and release management of Databricks notebooks, jobs, and data pipelines.- Support Snowflake on-premises to Azure cloud migration initiatives.- Ensure coding standards, performance tuning, monitoring, and operational stability of data pipelines.- Develop Power BI dashboards and reports for business intelligence and analytics reporting.- Develop API automation and integration solutions for data exchange between enterprise systems.3. Required Skills.- Strong experience in Python and PySpark development.- Hands-on experience with Azure Databricks and databricks SQL.- Experience in Java-based streaming and ingestion frameworks.- Strong knowledge of Apache Kafka streaming concepts.- Experience working with PostgreSQL databases.- Experience with YugabyteDB or Cassandra-based NoSQL databases.- Strong SQL development and query optimization skills.- Hands-on experience with GitLab CI/CD pipeline development and deployment automation.- Understanding cloud-based data engineering and distributed processing concepts.- Experience in data migration projects, especially Snowflake on-prem to Azure cloud migration.- Experience designing enterprise-scale data lake or lakehouse architectures.- Knowledge of streaming architectures and real-time analytics.- Familiarity with cloud monitoring and observability tools.","datePosted":"2026-06-17T04:22:42.956Z","dateModified":"2026-06-17T04:22:42.956Z","hiringOrganization":{"@type":"Organization","name":"Envision Technology Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Berkeley Heights","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"4a3bee091634a2ae5a81a413"},"url":"https://jobsearcher.com/jobs/4a3bee091634a2ae5a81a413"}}