Senior Data Engineer I
Overview:
In this Senior Data Engineer role, you will design and build the data platform that enables cross-functional teams to model, store, access, and analyze SpotHero’s data. You’ll shape infrastructure services, both AWS-based and open source, to support scalable data pipelines and publishing APIs. You’ll influence technology choices for data-heavy workloads and collaborate with Data Science, Marketing, Engineering, and Business Analysts. This is a hands-on, backend-focused position with a strong emphasis on self-service tools and scalable architectures that impact the business. You’ll join a fast-growing, mission-driven team that values collaboration and impact.
Compensation / BenefitsMedical premiums coverageDental and Vision premiums partially covered 401(k) with matchPaid time offLunch stipendLearning budget Udemy
Responsibilities:
Collaborate with Analytics, Data Science, Marketing, and other squads to understand data storage and processing needsContribute to design and implementation of data platform solutions from infrastructure to APIBuild robust, scalable data pipelines to ensure timely data availabilityCreate frameworks/tools for self-service data pipeline design by othersPerform performance testing to ensure systems scale with demandContribute to implementation and operation of the data platform as a hands-on team member
Key requirements:
Proficiency in Python for software design and implementationSQL proficiency for data querying and managementExperience with ETL tools such as Airflow, Luigi, or PrefectInfrastructure-as-code experience (Terraform preferred) Hands-on experience with multiple data platforms/tools (Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte) Dockerized services, CI/CD, and Git versioningShell scripting/Makefiles or similar glue for componentsExperience deploying containerized software to Kubernetes or similar (ECS, Mesos) Strong communication across business and technology domainsProven track record designing technology used by other stakeholdersStrong communication with both business and technical stakeholdersCollaborative mindset with cross-functional teamsProblem-solving and system-thinkingPython software designSQL data queryingETL scheduling (Airflow, Luigi, Prefect)