- UpvoteDownvoteShare Job
- Suggest Revision
Experience building complex near real time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability and SLA adherence.
$117,000 - $234,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Administration experience of distributed computation and streaming frameworks, like Kafka, Cassandra, Elasticsearch, Flink, Storm, Spark, and cloud services EMR, Dataproc, Elasticache, AWS RDS, GCP SQL or similar.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
You know data structures, you know Python and (optionaly) Go. Our tech stack Google Cloud Platform, DataFlow, Apache Beam, BigQuery, BigLake TableOpen formats IceBerg, Avro, ParquetDataProc, Spark, Flink, PrestoPython, GOApache Kafka, Kubernetes, GitLabBigTable, Mongo, Redis.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
2+ years’ expertise in Databricks, Apache Spark, Snowflake and/or similar data processing frameworks. Databricks Expertise: Optimize data processing by using your expertise in Databricks, develop Spark-based solutions, and enhance data integration and analytics capabilities.
$150,900 - $222,200 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Familiar with one or more open-source deep learning frameworks (e.g., TensorFlow, PyTorch, Paddle, Spark ML). Experience in large-scale distributed machine learning, parallel training, distributed data processing frameworks like Hadoop/Spark.
$194,000 - $355,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Proficient in data processing technologies (e.g., Hadoop, Spark, PySpark) and real-time data platforms (e.g., Apache Kafka, Flink, Spark Streaming). Proficient in data processing technologies (e.g., Hadoop, Spark, PySpark) and real-time data platforms (e.g., Apache Kafka, Flink, Spark Streaming.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in designing, implementing and operating data engineering platforms and scalable web services, including schema management, transport (Kafka, SQS), warehousing and storage (AWS Redshift, AuroraDB, MySQL, Postgres), processing (streaming and batch ETL/ELT pipelines, Kinesis, Airflow, Spring batch), analytics (Spark, Hadoop, BigQuery, Databricks, Snowflake), and business intelligence reports (Tableau, QuickSight.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience in batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming) Spark, Presto, Hive, Flink, Beam, AWS, Kubernetes, Scala, Java, Python, big data, data pipelines, Machine Learning.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Big Data tech - Hadoop, Spark, Pig, Hive, Presto, etc. Data warehousing, data modeling, and data transformation for both batch and streaming. Hands-on experience building production data pipelines, ideally using one or more distributed processing frameworks such as Spark or Hive/Hadoop.
$150,000 - $750,000 a yearFull-timeExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You have extensive hands-on experience in building scalable data platforms and reliable data pipelines using technologies such as Spark, ElasticSearch, Databricks, Clickhouse, AWS Kinesis, and/or Kafka.
Full-timeExpandApply NowActive JobUpdated 20 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Our data science stack includes AWS EMR, Apache Spark (core, mllib, and streaming), Elasticsearch and raw Lucene, scikit-learn, and more. Our data science stack includes AWS EMR, Apache Spark (core, mllib, and streaming), Elasticsearch and raw Lucene, scikit-learn, and more.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with MongoDB, Kafka/Firehose, Redis, Spark/Spark Streaming/Spark SQL, Redshift, or similar data warehousing solutions, amplifying data processing capabilities. Familiarity with MongoDB, Kafka/Firehose, Redis, Spark/Spark Streaming/Spark SQL, Redshift, or similar data warehousing solutions, amplifying data processing capabilities.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with streaming and distributed computing technologies such as Kafka, Flink, Spark, Hadoop, CassandraExposure to working with container ecosystems (Docker, Kubernetes, Kubernetes Operator Framework)Knowledge of distributed computing architectures and principles that solve for scalability, performance, redundancy and reliabilityExperienced with an Agile DevOps engineering environment that effectively uses CI/CD pipelines (Jenkins, GitLab, Bitbucket, etc.
$174,800 - $240,350 a yearExpandApply NowActive JobUpdated 10 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with Spark and Trino compute and expertise with open table format such as delta lake and/or iceberg etc. Experience with building real time streaming applications with kafka etc.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
6+ years experience in building and maintaining large-scale ETL/ELT pipelines (batching and/or streaming) that are optimized for performance and can handle data from various sources, structured or unstructured.
ExpandApply NowActive JobUpdated 5 days ago
streaming spark jobs in Cupertino, CA
FEATURED BLOG POSTS
What is Career Cushioning?
Is your organization prepared for “career cushioning”?
Growing Discontent: Employees Wouldn't Wish Their Jobs on Their Worst Enemy
The start of a new year, and most people are already busy setting personal and professional goals. What’s on the top of the list for a growing number of working people is making an exit from the job they currently have. Why?
How to Gracefully Quit a Job You Just Started
You’ve just started learning the ropes at your new job, and you've gotten to know your colleagues. But you’re already thinking about quitting. Maybe you were deciding between to job offers and realized that you’ve made the wrong choice. Or, a change in your personal circumstances means that you have to quit.
How to Professionally Reschedule a Job Interview Without Destroying Your Chances
You’ve practiced answering common interview questions and refined your “greatest weakness.’ Nothing can stop you until BAM! The flu hits your household. Or you ran over a nail and popped a tire en route to the interview. When you need to pivot, there’s a good, better, and best way to reschedule a job interview. Here’s how to do it professionally, so you can nail the gig when the timing is right.
What is a W-9 and How to Fill One Out
When you began working for yourself, you probably didn’t account for the tax reporting work that will fall on your shoulders each year. If you’re a freelancer, independent contractor, or business owner, filing your taxes is not as simple as uploading your W-2 form into some online tax preparation software. Most self-employed people need to complete a W-9 as a step for accurately reporting their earnings to the IRS. Below, you can learn how to fill out a W-9 and when to submit it.
Tightening the HR budget in 2023
With the state of the economy still uncertain, 2023 is expected to be approached with much anticipation. Human Resource leaders have many concerns, including how they will manage to accomplish their goals with budget belts already getting snug. Let’s look at some of the factors that the new year is projected to bring for HR and how to prioritize budgets to reach human capital objectives.
A Comprehensive Guide to Becoming a Better Conversationalist
Have you ever stood awkwardly next to someone at a party because you didn’t know what to say to them? How about at a networking event or on a first date? You're not alone if you’ve ever experienced this uncomfortable silence. Many people struggle to master the art of being a great conversationalist.