{"schemaVersion":"jobsearcher.job.v1","id":"524d3017f7c481913f10403d","url":"https://jobsearcher.com/jobs/524d3017f7c481913f10403d","canonicalUrl":"https://jobsearcher.com/jobs/524d3017f7c481913f10403d","title":"Databricks Data Engineer","description":"Work Authorization:We are seeking an experienced Senior Databricks Data Engineer with strong expertise in designing, developing, and optimizing large-scale data engineering solutions on the Databricks platform. The ideal candidate will have extensive hands-on experience in building enterprise-grade data pipelines, processing high-volume datasets, and delivering scalable analytics solutions using PySpark, Spark SQL, and AWS cloud technologies.\r\nKey Responsibilities:Design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, Spark SQL, and Apache Spark.\r\nBuild and optimize end-to-end ETL/ELT pipelines integrating Databricks with AWS S3, Snowflake, Airflow, and AWS Glue.\r\nProcess and transform large-scale structured and semi-structured datasets to support enterprise reporting, analytics, and regulatory requirements.\r\nDevelop reusable frameworks and components for: Data ingestion Data cleansing and transformation Data validation and reconciliation Data enrichment Business rule implementation Implement robust data quality checks, monitoring, and governance controls to ensure data accuracy and reliability.\r\nPerform performance tuning and optimization of Spark applications and Databricks workloads to improve scalability and processing efficiency.\r\nCollaborate with business stakeholders, architects, and analytics teams to understand data requirements and deliver scalable solutions.\r\nTroubleshoot and resolve production data pipeline issues while ensuring high availability and reliability.\r\nSupport advanced analytics, customer segmentation, campaign analytics, AML/regulatory reporting, and data validation initiatives.\r\nRequired Skills:Technical Skills 7+ years of hands-on experience with Databricks and modern data engineering platforms.\r\nStrong expertise in: PySpark Spark SQL Apache Spark Databricks Lakehouse Architecture Experience building and managing ETL/ELT pipelines on cloud platforms.\r\nStrong experience with: AWS S3 Snowflake Apache Airflow AWS Glue Knowledge of data modeling, data warehousing, and big data processing techniques.\r\nExperience working with structured and semi-structured data formats such as JSON, Parquet, Avro, and CSV.\r\nHands-on experience implementing data quality frameworks and monitoring solutions.\r\nStrong SQL and data analysis skills.\r\nPreferred Skills Experience with regulatory reporting, AML, compliance, or financial data domains.\r\nExposure to CI/CD and DevOps practices for data engineering.\r\nExperience with Delta Lake, Databricks Workflows, and Unity Catalog.\r\nKnowledge of Agile/Scrum delivery methodologies.\r\nKey Experience Areas Candidates should have demonstrated experience in one or more of the following: Customer Segmentation Analytics Campaign Analytics AML and Regulatory Reporting Enterprise Data Platforms Production Data Pipeline Support Data Validation and Reconciliation Large-Scale Data Migration and Modernization Programs.\r\nWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.#J-18808-Ljbffr","company":"Quantum Technologies","rawCompany":"quantum technologies","city":"Dallas","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-11-04T02:54:36.006Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Data Engineer","description":"Work Authorization:We are seeking an experienced Senior Databricks Data Engineer with strong expertise in designing, developing, and optimizing large-scale data engineering solutions on the Databricks platform. The ideal candidate will have extensive hands-on experience in building enterprise-grade data pipelines, processing high-volume datasets, and delivering scalable analytics solutions using PySpark, Spark SQL, and AWS cloud technologies.\r\nKey Responsibilities:Design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, Spark SQL, and Apache Spark.\r\nBuild and optimize end-to-end ETL/ELT pipelines integrating Databricks with AWS S3, Snowflake, Airflow, and AWS Glue.\r\nProcess and transform large-scale structured and semi-structured datasets to support enterprise reporting, analytics, and regulatory requirements.\r\nDevelop reusable frameworks and components for: Data ingestion Data cleansing and transformation Data validation and reconciliation Data enrichment Business rule implementation Implement robust data quality checks, monitoring, and governance controls to ensure data accuracy and reliability.\r\nPerform performance tuning and optimization of Spark applications and Databricks workloads to improve scalability and processing efficiency.\r\nCollaborate with business stakeholders, architects, and analytics teams to understand data requirements and deliver scalable solutions.\r\nTroubleshoot and resolve production data pipeline issues while ensuring high availability and reliability.\r\nSupport advanced analytics, customer segmentation, campaign analytics, AML/regulatory reporting, and data validation initiatives.\r\nRequired Skills:Technical Skills 7+ years of hands-on experience with Databricks and modern data engineering platforms.\r\nStrong expertise in: PySpark Spark SQL Apache Spark Databricks Lakehouse Architecture Experience building and managing ETL/ELT pipelines on cloud platforms.\r\nStrong experience with: AWS S3 Snowflake Apache Airflow AWS Glue Knowledge of data modeling, data warehousing, and big data processing techniques.\r\nExperience working with structured and semi-structured data formats such as JSON, Parquet, Avro, and CSV.\r\nHands-on experience implementing data quality frameworks and monitoring solutions.\r\nStrong SQL and data analysis skills.\r\nPreferred Skills Experience with regulatory reporting, AML, compliance, or financial data domains.\r\nExposure to CI/CD and DevOps practices for data engineering.\r\nExperience with Delta Lake, Databricks Workflows, and Unity Catalog.\r\nKnowledge of Agile/Scrum delivery methodologies.\r\nKey Experience Areas Candidates should have demonstrated experience in one or more of the following: Customer Segmentation Analytics Campaign Analytics AML and Regulatory Reporting Enterprise Data Platforms Production Data Pipeline Support Data Validation and Reconciliation Large-Scale Data Migration and Modernization Programs.\r\nWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.#J-18808-Ljbffr","datePosted":"2026-11-04T02:54:36.006Z","dateModified":"2026-11-04T02:54:36.006Z","hiringOrganization":{"@type":"Organization","name":"Quantum Technologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Dallas","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"524d3017f7c481913f10403d"},"url":"https://jobsearcher.com/jobs/524d3017f7c481913f10403d"}}