- UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in Apache Spark, including Spark Core, Spark SQL and Spark Streaming. Apache Spark, Spark Core, Spark SQL, Spark Streaming.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ Administration experience of distributed computation and streaming frameworks, like Kafka, Cassandra, Elasticsearch, Flink, Storm, Spark, and cloud services EMR, Dataproc, Elasticache, AWS RDS, GCP SQL or similar.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Must have strong technical skills in Python Azure Event Hub Azure DevOps PySpark Databricks SQL and Spark in Scala. Nice to have technical skills include Azure Key Vault Azure Data Lake Azure Monitor Kafka Databricks Workflow Structured Streaming Delta Live Pipelines Databricks Unity Databricks CLI and Databricks Workspace.
Full-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
2+ years’ expertise in Databricks, Apache Spark, Snowflake and/or similar data processing frameworks. Databricks Expertise: Optimize data processing by using your expertise in Databricks, develop Spark-based solutions, and enhance data integration and analytics capabilities.
$150,900 - $222,200 a yearFull-timeExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in architecting data pipelines and solutions for streaming and batch integrations using tools/frameworks like dbt, Talend, Azure Data Factory, Spark, Spark Streaming, etc.
ExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Process streaming data by developing real-time data processing and streaming analytics solutions with Apache spark streaming and structured streaming in DataBricks. Integrate and orchestrate data by merging data from various sources and systems, such as databases, APIs, and streaming platforms, coordinating data workflows and dependencies using DataBricks.
Full-timeExpandApply NowActive JobUpdated 17 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Optimization of Spark jobs and Databricks clusters for better performance. 5+ years Hadoop, YARN, MapReduce, Pig or Hive, Spark. Integration of data from diverse sources, including APIs, databases, streaming data, and external data feeds.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data processing technologies and streaming workflows (e.g., Spark, Kafka, Flink, Beam) [Full Time] Senior Software Engineer - Streaming at TRM Labs (United States) | BEAMSTART Jobs Senior Software Engineer - Streaming TRM Labs United States.
ExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expert/Advanced level experience with ETL technologies, Data Streaming using integration patterns like Kafka, Spark Streaming. Experience with Big Data Technologies (NoSQL databases, Hadoop, Hive, Hbase, Pig, Spark, Elasticsearch, Databricks, etc.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Big Data Technologies (NoSQL databases, Hadoop, Spark, Elasticsearch, Databricks, etc.) 5+ years of experience with cloud data technologies including Snowflake, AWS, spark, Apache Airflow.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Micro-batch streaming and continuous streaming process in Databricks for high latency, low latency and ultra-low latency of data accordingly by using inbuilt Apache spark modules.
Full-timeExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming (A. Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka B. Deep knowledge of troubleshooting and tuning Spark applications.
ExpandApply NowActive JobUpdated 2 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience building complex near real time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability, and SLA adherence.
ExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong proficiency in Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib. Integrate Python, AWS services (such as S3 and EMR), Redshift, Snowflake, Hadoop, Hive, Spring, Hibernate, Cassandra, Kafka, and ETL processes into Spark applications.
Full-timeExpandApply NowActive JobUpdated 29 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data streaming infrastructure deployment (e.g., Spark Streaming, Kafka, Azure EventHub, or EventBridge) Experience with Big Data platforms such as Databricks or Apache Spark.
ExpandApply NowActive JobUpdated 9 days ago
streaming spark jobs
FEATURED BLOG POSTS
How to Write a Short Bio
First impressions can be tricky. When meeting someone in person, it’s likely you have an elevator speech. These short, practiced introductions can help you share more about who you are, what you do for work and other facts about you. While this works well in a live, in-person context, there are many cases where professionals “meet” someone via written form - like social media, a resume, or published work. In these cases, your bio works as your first impression. So, here’s a step-by-step guide on how to write a short bio.
How to Conduct a Performance Review (With Examples)
In a world where the smallest mistake can cost your business tens of thousands in lost revenue, your talent is key to keeping your edge on the market and driving growth. However, managing a workforce of any size can be a challenge. Employees come with their own particular skill set, ambitions and flaws. So, it can be difficult to uncover their individual drivers. Not to mention the challenges brought on by the hybrid and remote working models where in-person interactions have become few and far between.
How to Recruit Passive Candidates
Learning to recruit passive candidates is a different ballgame than recruiting active ones. While an active candidate is someone who is currently looking for a new job, a passive candidate tends to be the opposite. Passive candidates are either already working or not looking to work. So, instead of these candidates coming to you, you'll have to find them and reach out to them first.
How to Effectively Recruit Employees
Today, hiring and retaining talent looks much different than it did only two or three years ago. Financial instability and the strain on our mental health brought on by the pandemic has made everyone more wary and selective of their workplace and employer. Whereas in the past people might have prioritized promotions and financial reward, today they look at other factors such as workplace flexibility, personal fulfillment and values alignment.
How Many Hours is Part-Time vs. Full-Time Work?
Growing up you watched your parents shuffle to and from the office, held hostage to their 9 to 5. If jammed-packed schedules and deadlines sound frightening, you might consider pivoting your search to part-time jobs. In fact, even employers have shifted their preference, selecting more people open to the idea of flexible working hours.
How to Make a Job Offer More Competitive
Money alone makes it hard to attract and retain top-notch candidates, especially when you are competing with larger businesses and corporations in your industry. So, instead of focusing on money, figure out how to make a job offer more competitive when you can't offer more money.
5 Ways to Stretch Your Hiring Budget
Many businesses across the country have adjusted business operations to make it through the pandemic. After a period of hardship, many business owners, like yourself, are ready to start recruiting and rebuilding a bigger, more skilled workforce - only now you have to do it with a smaller hiring budget.