{"schemaVersion":"jobsearcher.job.v1","id":"0fbfcbdd10d248e1ced9c001","url":"https://jobsearcher.com/jobs/0fbfcbdd10d248e1ced9c001","canonicalUrl":"https://jobsearcher.com/jobs/0fbfcbdd10d248e1ced9c001","title":"Senior Data Engineer-Databricks","description":"Overview\nWe are seeking a highly skilled and motivated Senior Data Engineer specializing in Databricks to join our dynamic data team. In this role, you will lead the design, development, and optimization of large-scale data systems, enabling advanced analytics and business intelligence solutions. Your expertise will drive innovative data management strategies across cloud platforms, ensuring seamless integration and high-performance processing of complex datasets. This position offers an exciting opportunity to work with cutting-edge big data technologies and contribute to impactful data-driven decision-making.\nResponsibilities\nDesign, develop, and maintain scalable ETL pipelines using Databricks, Spark, Python, and SQL to process vast amounts of structured and unstructured data.\nCollaborate with cross-functional teams to translate business requirements into robust data models and architectures aligned with best practices in dimensional modeling and data warehousing design.\nOptimize big data systems leveraging Hadoop, Azure Data Lake, AWS, and other cloud-based platforms to ensure high availability and performance.\nImplement data management integration strategies utilizing Informatica, Talend, RESTful APIs, and other tools to streamline data ingestion and transformation processes.\nDevelop comprehensive documentation for data workflows, models, and pipelines while ensuring adherence to security standards and compliance regulations.\nSupport model training, analysis activities, and business intelligence reporting using Looker, SQL databases such as Oracle or Microsoft SQL Server, and cloud databases.\nParticipate in Agile development cycles to continuously improve data engineering solutions while maintaining flexibility for evolving project needs.\nRequirements\nProven experience in software development with a strong background in data engineering within big data environments.\nExtensive hands-on expertise with Databricks platform, Spark (including Apache Hive), Hadoop ecosystems, and cloud services such as Azure Data Lake or AWS Public Cloud.\nProficiency in programming languages including Python, Java, Bash (Unix shell), Shell Scripting, and VBA for automation and analysis tasks.\nDeep understanding of ETL pipeline development, SQL query management, database design (including dimensional modeling), and data warehousing concepts.\nFamiliarity with business intelligence tools like Looker or similar platforms for visualization and reporting purposes.\nKnowledge of data modeling techniques for linked data, Oracle databases, SQL databases, cloud databases, and enterprise data warehouse architecture.\nExperience working with Big Data systems such as Hadoop or Spark for large-scale processing projects.\nStrong analytical skills combined with excellent communication abilities to translate complex technical concepts into clear insights.\nAbility to work effectively within an Agile environment while managing multiple priorities simultaneously.\nJoin us as a Senior Data Engineer-Databricks to shape the future of our enterprise’s data landscape! Your expertise will empower smarter decisions through innovative big data solutions while collaborating with talented professionals dedicated to excellence in analytics and technology innovation.\nPay: $110,000.00 - $150,000.00 per year\nBenefits:\n401(k)\n401(k) matching\nDental insurance\nHealth insurance\nHealth savings account\nLife insurance\nPaid time off\nParental leave\nRetirement plan\nVision insurance\nWork Location: Remote","company":"EXL","rawCompany":"exl","city":"Remote","state":"OR","isRemote":false,"isActive":false,"createdAt":"2026-08-04T19:05:19.329Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer-Databricks","description":"Overview\nWe are seeking a highly skilled and motivated Senior Data Engineer specializing in Databricks to join our dynamic data team. In this role, you will lead the design, development, and optimization of large-scale data systems, enabling advanced analytics and business intelligence solutions. Your expertise will drive innovative data management strategies across cloud platforms, ensuring seamless integration and high-performance processing of complex datasets. This position offers an exciting opportunity to work with cutting-edge big data technologies and contribute to impactful data-driven decision-making.\nResponsibilities\nDesign, develop, and maintain scalable ETL pipelines using Databricks, Spark, Python, and SQL to process vast amounts of structured and unstructured data.\nCollaborate with cross-functional teams to translate business requirements into robust data models and architectures aligned with best practices in dimensional modeling and data warehousing design.\nOptimize big data systems leveraging Hadoop, Azure Data Lake, AWS, and other cloud-based platforms to ensure high availability and performance.\nImplement data management integration strategies utilizing Informatica, Talend, RESTful APIs, and other tools to streamline data ingestion and transformation processes.\nDevelop comprehensive documentation for data workflows, models, and pipelines while ensuring adherence to security standards and compliance regulations.\nSupport model training, analysis activities, and business intelligence reporting using Looker, SQL databases such as Oracle or Microsoft SQL Server, and cloud databases.\nParticipate in Agile development cycles to continuously improve data engineering solutions while maintaining flexibility for evolving project needs.\nRequirements\nProven experience in software development with a strong background in data engineering within big data environments.\nExtensive hands-on expertise with Databricks platform, Spark (including Apache Hive), Hadoop ecosystems, and cloud services such as Azure Data Lake or AWS Public Cloud.\nProficiency in programming languages including Python, Java, Bash (Unix shell), Shell Scripting, and VBA for automation and analysis tasks.\nDeep understanding of ETL pipeline development, SQL query management, database design (including dimensional modeling), and data warehousing concepts.\nFamiliarity with business intelligence tools like Looker or similar platforms for visualization and reporting purposes.\nKnowledge of data modeling techniques for linked data, Oracle databases, SQL databases, cloud databases, and enterprise data warehouse architecture.\nExperience working with Big Data systems such as Hadoop or Spark for large-scale processing projects.\nStrong analytical skills combined with excellent communication abilities to translate complex technical concepts into clear insights.\nAbility to work effectively within an Agile environment while managing multiple priorities simultaneously.\nJoin us as a Senior Data Engineer-Databricks to shape the future of our enterprise’s data landscape! Your expertise will empower smarter decisions through innovative big data solutions while collaborating with talented professionals dedicated to excellence in analytics and technology innovation.\nPay: $110,000.00 - $150,000.00 per year\nBenefits:\n401(k)\n401(k) matching\nDental insurance\nHealth insurance\nHealth savings account\nLife insurance\nPaid time off\nParental leave\nRetirement plan\nVision insurance\nWork Location: Remote","datePosted":"2026-08-04T19:05:19.329Z","dateModified":"2026-08-04T19:05:19.329Z","hiringOrganization":{"@type":"Organization","name":"EXL","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Remote","addressRegion":"OR","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0fbfcbdd10d248e1ced9c001"},"url":"https://jobsearcher.com/jobs/0fbfcbdd10d248e1ced9c001"}}