Data Engineer

Big Data EngineerClient: WalmartRole: Big Data Engineer# of roles: 2 x3, 2 x4 level data engineersDuration: 6 month CTHTarget Start Date: 8/7/22Interview Process: One and done back to back: 2 hour interviewProject Details – Size, Scale, Scope?Working within the Ad-Tech Division - they support the data processing and transformation before it goes to reporting divisionCoordinated team/data foundations team (store the data for ad-tech and "source of truth" for their data metrics)They work to audit and do multiple code reviews on items before implementation so that is a big portion of their role on this teamWork with big data and large distributed systems – want someone with that exposureDay to Day Responsibilities/typical day look like:Senior:40% data analysis/Data quality50% designing and coding20% meetings with other teams on data/data sourcesStaff:Flexible on tasking a bit based on what they have most exposure but will be more cross-functional work and mix of leadership and local tasks25% meetings & 25% planning/meeting review (50% meeting related work)25% mentorship10-15% coding10% or more otherSelling Points for Candidates:Technical Stack:Apache (Spark, Hive, Airflow)Need exposure to Spark and other apache stackGoogle Cloud (BigQuery in particular)Any cloud experience can suffice instead if neededScalaWork with Python, JAVA, or other would be okay insteadAtlassian (JIRA, Jenkins, Github)Basic exposure here or similar tooling okayTeam Size & Structure: Team of 8-10 peopleEducation or Certification Requirements: N/ALevel of experience target (junior/mid/senior and/or years of experience): More concerned with level versus years. Talked about 2-3+ and that sounded like a good benchmark.