{"schemaVersion":"jobsearcher.job.v1","id":"40e708db251e767d51978e2e","url":"https://jobsearcher.com/jobs/40e708db251e767d51978e2e","canonicalUrl":"https://jobsearcher.com/jobs/40e708db251e767d51978e2e","title":"Lead Data Engineer","description":"Overview\nAs Lead Data Engineer, you will drive the design and delivery of scalable data pipelines and lakehouse architectures in a fast-paced, cross-functional setting. You will partner with analytics, product, and platform teams to enable data-driven decisions and high-quality data products. The role emphasizes hands-on engineering with cloud data platforms, modern data modeling, and CI/CD practices to ship robust data solutions. This is a chance to shape data strategy and contribute to scalable, resilient data systems in a dynamic organization.\n\nResponsibilitieslead the development and maintenance of data pipelines and data modelsown data architecture decisions for cloud data lakehouse platformscollaborate with analytics, product, and platform teams to align data solutions with business needsimplement and promote CI/CD practices and test-driven or behavior-driven developmentdevelop PI plans and roadmaps within agile methodologiesensure data quality, governance, and documentation of data flows and schemassupport operations with scalable, reliable data engineering solutionsstay current with evolving data technologies and platform capabilities\nKey requirementsPython, Scala, or Java proficiency for data engineeringexperience with at least one cluster computing framework (Spark preferred)experience with cloud data lakehouse platforms (AWS data lake services or Databricks)experience with relational data stores (Postgres, Oracle) and NoSQL stores (Cassandra, Dynamo, MongoDB)experience with scheduling/orchestration tools (Airflow)familiarity with data serialization and processing formats (JSON, AVRO, Protobuf; Parquet, Iceberg)solid understanding of data processing (batch, micro-batching, stream) and data modeling (Dimensional, Data Vault, Kimball, Inmon)Agile methodology, TDD/BDD and CI/CD tools (Jenkins, Git)strong organizational, problem-solving and documentation skillsstrong communicationproblem-solvingcritical thinkingPython/Scala/JavaSpark/Flink/StormAWS Databricks Hadoop","company":"Han Staffing","rawCompany":"han staffing","city":"Brooklyn","state":"NY","isRemote":false,"isActive":false,"createdAt":"2026-09-15T04:07:12.481Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer","description":"Overview\nAs Lead Data Engineer, you will drive the design and delivery of scalable data pipelines and lakehouse architectures in a fast-paced, cross-functional setting. You will partner with analytics, product, and platform teams to enable data-driven decisions and high-quality data products. The role emphasizes hands-on engineering with cloud data platforms, modern data modeling, and CI/CD practices to ship robust data solutions. This is a chance to shape data strategy and contribute to scalable, resilient data systems in a dynamic organization.\n\nResponsibilitieslead the development and maintenance of data pipelines and data modelsown data architecture decisions for cloud data lakehouse platformscollaborate with analytics, product, and platform teams to align data solutions with business needsimplement and promote CI/CD practices and test-driven or behavior-driven developmentdevelop PI plans and roadmaps within agile methodologiesensure data quality, governance, and documentation of data flows and schemassupport operations with scalable, reliable data engineering solutionsstay current with evolving data technologies and platform capabilities\nKey requirementsPython, Scala, or Java proficiency for data engineeringexperience with at least one cluster computing framework (Spark preferred)experience with cloud data lakehouse platforms (AWS data lake services or Databricks)experience with relational data stores (Postgres, Oracle) and NoSQL stores (Cassandra, Dynamo, MongoDB)experience with scheduling/orchestration tools (Airflow)familiarity with data serialization and processing formats (JSON, AVRO, Protobuf; Parquet, Iceberg)solid understanding of data processing (batch, micro-batching, stream) and data modeling (Dimensional, Data Vault, Kimball, Inmon)Agile methodology, TDD/BDD and CI/CD tools (Jenkins, Git)strong organizational, problem-solving and documentation skillsstrong communicationproblem-solvingcritical thinkingPython/Scala/JavaSpark/Flink/StormAWS Databricks Hadoop","datePosted":"2026-09-15T04:07:12.481Z","dateModified":"2026-09-15T04:07:12.481Z","hiringOrganization":{"@type":"Organization","name":"Han Staffing","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Brooklyn","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"40e708db251e767d51978e2e"},"url":"https://jobsearcher.com/jobs/40e708db251e767d51978e2e"}}