Lead Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Overview:
As Lead Data Engineer, you will drive the design and delivery of scalable data pipelines and lakehouse architectures in a fast-paced, cross-functional setting. You will partner with analytics, product, and platform teams to enable data-driven decisions and high-quality data products. The role emphasizes hands-on engineering with cloud data platforms, modern data modeling, and CI/CD practices to ship robust data solutions. This is a chance to shape data strategy and contribute to scalable, resilient data systems in a dynamic organization.
Responsibilitieslead the development and maintenance of data pipelines and data modelsown data architecture decisions for cloud data lakehouse platformscollaborate with analytics, product, and platform teams to align data solutions with business needsimplement and promote CI/CD practices and test-driven or behavior-driven developmentdevelop PI plans and roadmaps within agile methodologiesensure data quality, governance, and documentation of data flows and schemassupport operations with scalable, reliable data engineering solutionsstay current with evolving data technologies and platform capabilities
Key requirements:
Python, Scala, or Java proficiency for data engineeringexperience with at least one cluster computing framework (Spark preferred)experience with cloud data lakehouse platforms (AWS data lake services or Databricks)experience with relational data stores (Postgres, Oracle) and NoSQL stores (Cassandra, Dynamo, MongoDB)experience with scheduling/orchestration tools (Airflow)familiarity with data serialization and processing formats (JSON, AVRO, Protobuf; Parquet, Iceberg)solid understanding of data processing (batch, micro-batching, stream) and data modeling (Dimensional, Data Vault, Kimball, Inmon) Agile methodology, TDD/BDD and CI/CD tools (Jenkins, Git)strong organizational, problem-solving and documentation skillsstrong communicationproblem-solvingcritical thinkingPython/Scala/JavaSpark/Flink/StormAWS Databricks Hadoop