Upvote
Downvote
Software Development Engineer - Big Data Backend
Share Job
- Suggest Revision
- Foster a positive environment of integrity, operational excellence to achieve a high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools/frameworks like Docker, Kubernetes, Terraform, Java, Gradle, Jenkins, GCP, Hadoop and Spark, SQL and err on the side of shipping fast and iterating.
- Project categories: besides product requests and enhancements, we work on projects in performance and cost optimization, security and legal compliance, reliability and quality initiatives, as well as architectural refreshes such as POC in restructuring our data to be more streaming/real time friendly, new REST API for relevant services, migration of apps to Spark, Parquet, and other new technologies that could make our processing faster, more scalable, maintainable and cost effective.
- 2+ years of experience writing and optimizing large-scale batch processing pipelines in Java, Spark/Hadoop and/or SQL.
- Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam
- Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle
Active Job
Updated 14 days agoSimilar Job
Relevance
Active