Senior Software Engineer, Data Platform
Posted 6 months ago San Francisco, CA full-time
About This Role:
Build Avala's data platform - the ingestion, storage, and curation layer that processes multi-sensor recordings from production autonomous vehicle and robotics fleets. You'll design systems that handle petabytes of LiDAR, camera, and radar data with sub-second query performance.
What You'll Do:
- Design and build high-throughput data ingestion pipelines for fleet sensor data
- Implement dataset curation tools - search, filter, slice, and export at scale
- Build the Sessions system that groups recordings into logical units for annotation
- Optimize storage and retrieval for petabyte-scale multi-modal datasets
- Integrate with customer data lakes (S3, GCS) via zero-copy indexing
- Design APIs that power both the web UI and Python/TypeScript SDKsRequirements 5+ years building data infrastructure or platform engineering systems
- Strong Python and/or TypeScript with production systems experience
- Experience with distributed data processing (Spark, Flink, or custom pipelines)
- Deep knowledge of PostgreSQL, Redis, and cloud storage (S3/GCS)
- Experience designing APIs for developer platforms
Nice to Have:
- Experience with robotics data formats (MCAP, ROS bags, nuScenes)
- Familiarity with sensor fusion or multi-modal data pipelines
- Experience building search/indexing systems at scale
What We Offer:
Competitive salary and meaningful equity in the team building Fleet Learning Infrastructure for Physical AIFull health, dental, and vision coverage, plus FSA and unlimited PTOWork on the closed-loop data infrastructure that the next generation of autonomous systems learns from A team that built Tesla Autopilot's data infrastructure, now building something bigger