{"schemaVersion":"jobsearcher.job.v1","id":"7cd991c0aa8694853cb3598f","url":"https://jobsearcher.com/jobs/7cd991c0aa8694853cb3598f","canonicalUrl":"https://jobsearcher.com/jobs/7cd991c0aa8694853cb3598f","title":"Lead Big Data Engineer (Databricks + AWS)","description":"Apply now\r\nABOUT THE ROLE\r\nIn this role, you will lead the design and development of scalable data platforms on AWS, with a strong focus on the Databricks ecosystem. You will guide a team of engineers, shape architectural decisions, and ensure high-quality delivery of both batch and streaming data solutions. You will work closely with business and technical stakeholders, contributing across the full project lifecycle, from discovery and design to production implementation, within a collaborative and innovation-driven environment.\r\nRESPONSIBILITIES\r\nDesign, build, and optimize scalable data solutions on AWS using Databricks, including Lakehouse architectures based on Delta Lake and Unity Catalog\r\nDevelop and enhance batch and real-time data processing solutions using technologies such as Apache Spark, Flink, Kafka, Amazon MSK, and Kinesis\r\nLead data integration and migration activities, including source-to-target mapping, data ingestion, transformation, and quality assurance across multiple data sources\r\nDrive data platform architecture, data modeling, and engineering best practices to ensure scalability, reliability, and long-term maintainability\r\nCollaborate with business and technical stakeholders to translate requirements into effective data solutions, implementation roadmaps, and delivery plans\r\nSupport and mentor data engineering teams, helping to define priorities, promote technical excellence, and enable successful project delivery\r\nBuild and manage automated workflows and data pipelines using orchestration and analytics technologies such as Databricks Workflows, Apache Airflow, MWAA, Snowflake, and Amazon Redshift\r\nContribute across the full solution lifecycle to explore emerging technologies and sharing knowledge within the engineering community\r\nREQUIREMENTS\r\nProven experience as a Lead Data Engineer, with a strong background in designing and delivering scalable data platforms and pipelines\r\nHands-on expertise in batch and real-time data processing using technologies such as Apache Spark, Flink, Kafka, Amazon MSK, or Kinesis\r\nStrong experience with AWS and Databricks, including Delta Lake, Unity Catalog, Workflows, and Jobs\r\nProficiency in Python (preferred), Scala, or Java, combined with advanced SQL skills\r\nExperience building and orchestrating data workflows using tools such as Databricks Workflows, Apache Airflow, or MWAA\r\nPractical knowledge of modern data warehousing and analytics solutions, including Snowflake and Amazon Redshift\r\nFamiliarity with data engineering best practices, version control, and data formats, including GitHub, Avro, and SQL-based systems\r\nStrong leadership, stakeholder management, and communication skills, with the ability to translate business requirements into technical solutions and guide teams to successful delivery\r\nUpper-intermediate or higher level of English\r\nSoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.\r\nWe offer\r\nFlexible Work Model\r\nWork from home, from the office, or in a hybrid format that supports focus and collaboration.\r\nCompetitive benefits\r\nCompetitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.\r\nLeadership and culture\r\nApproachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.\r\nAdvanced tech communities\r\nStay close to AI/ML, Cloud, Quantum Computing, IoT, and Robotics communities, with projects built on modern frameworks.\r\nMore opportunities available\r\nBrowse all open positions to find the best fit for your experience.\r\nJ-18808-Ljbffr","company":"Softserve","rawCompany":"softserve","city":"Poland","state":"NY","isRemote":false,"isActive":false,"createdAt":"2026-07-04T03:01:06.157Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Big Data Engineer (Databricks + AWS)","description":"Apply now\r\nABOUT THE ROLE\r\nIn this role, you will lead the design and development of scalable data platforms on AWS, with a strong focus on the Databricks ecosystem. You will guide a team of engineers, shape architectural decisions, and ensure high-quality delivery of both batch and streaming data solutions. You will work closely with business and technical stakeholders, contributing across the full project lifecycle, from discovery and design to production implementation, within a collaborative and innovation-driven environment.\r\nRESPONSIBILITIES\r\nDesign, build, and optimize scalable data solutions on AWS using Databricks, including Lakehouse architectures based on Delta Lake and Unity Catalog\r\nDevelop and enhance batch and real-time data processing solutions using technologies such as Apache Spark, Flink, Kafka, Amazon MSK, and Kinesis\r\nLead data integration and migration activities, including source-to-target mapping, data ingestion, transformation, and quality assurance across multiple data sources\r\nDrive data platform architecture, data modeling, and engineering best practices to ensure scalability, reliability, and long-term maintainability\r\nCollaborate with business and technical stakeholders to translate requirements into effective data solutions, implementation roadmaps, and delivery plans\r\nSupport and mentor data engineering teams, helping to define priorities, promote technical excellence, and enable successful project delivery\r\nBuild and manage automated workflows and data pipelines using orchestration and analytics technologies such as Databricks Workflows, Apache Airflow, MWAA, Snowflake, and Amazon Redshift\r\nContribute across the full solution lifecycle to explore emerging technologies and sharing knowledge within the engineering community\r\nREQUIREMENTS\r\nProven experience as a Lead Data Engineer, with a strong background in designing and delivering scalable data platforms and pipelines\r\nHands-on expertise in batch and real-time data processing using technologies such as Apache Spark, Flink, Kafka, Amazon MSK, or Kinesis\r\nStrong experience with AWS and Databricks, including Delta Lake, Unity Catalog, Workflows, and Jobs\r\nProficiency in Python (preferred), Scala, or Java, combined with advanced SQL skills\r\nExperience building and orchestrating data workflows using tools such as Databricks Workflows, Apache Airflow, or MWAA\r\nPractical knowledge of modern data warehousing and analytics solutions, including Snowflake and Amazon Redshift\r\nFamiliarity with data engineering best practices, version control, and data formats, including GitHub, Avro, and SQL-based systems\r\nStrong leadership, stakeholder management, and communication skills, with the ability to translate business requirements into technical solutions and guide teams to successful delivery\r\nUpper-intermediate or higher level of English\r\nSoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.\r\nWe offer\r\nFlexible Work Model\r\nWork from home, from the office, or in a hybrid format that supports focus and collaboration.\r\nCompetitive benefits\r\nCompetitive, market-based pay, benchmarked by role and location — plus health coverage, paid time off, wellness support, and learning opportunities.\r\nLeadership and culture\r\nApproachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning.\r\nAdvanced tech communities\r\nStay close to AI/ML, Cloud, Quantum Computing, IoT, and Robotics communities, with projects built on modern frameworks.\r\nMore opportunities available\r\nBrowse all open positions to find the best fit for your experience.\r\nJ-18808-Ljbffr","datePosted":"2026-07-04T03:01:06.157Z","dateModified":"2026-07-04T03:01:06.157Z","hiringOrganization":{"@type":"Organization","name":"Softserve","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Poland","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"7cd991c0aa8694853cb3598f"},"url":"https://jobsearcher.com/jobs/7cd991c0aa8694853cb3598f"}}