- UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark, Airflow, Trino, Pinot, Flink, KafkaData Warehousing and Data Lake technologies such as Snowflake, Databricks, various table formats such as Iceberg or Delta Lake. You will report into the Senior Director of Engineering, Data Platform as part of our Data organization in Engineering.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark, Apache Flink, or Apache Beam. Experience with distributed computing technologies and concepts, including Hadoop, MapReduce, and distributed file systems (e.g., HDFS.
$210,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Strong Technical Background: Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL. Experience with data processing frameworks and tools like Apache Spark (including Databricks), and Hadoop and knowledge of database technologies like SQL databases (e.g., MySQL, PostgreSQL.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data Processing: Apache Beam (Java), Apache Spark (Python), Airflow. Expertise in distributed data processing systems (e.g., Apache Beam, Apache Spark), data pipelines (e.g., Kafka), and cloud platforms (preferably Google Cloud.
$195,800 a yearFull-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data processing frameworks and tools like Spark, Kafka, Airflow and cloud provisioning environments etc. Our technology stack runs on AWS, Kubernetes, Spark and Apache Airflow.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Build real-time data processing and analytics solutions using technologies like Apache Kafka, Apache Flink, Apache Spark, and similar tools. Develop comprehensive data engineering strategies to ensure data processing.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark, Airflow, Trino, Pinot, Flink, Kafka. Experience with a range of large-scale (multiple PetaBytes) data systems such as data processing, complex/high volume real-time insights, data quality and reliability frameworks, cost efficiency, etc.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
In this role, you will work with incredibly passionate and talented colleagues from software engineering, machine learning and data science on building rideshare experiences that delight millions of riders and drivers.
$215,000 a yearFull-timeExpandApply NowActive JobUpdated 10 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Insightful experience with big data technologies like Hadoop, real-time processing frameworks (e.g., Apache Spark), and advanced knowledge of SQL and data architecture.
Full-timeExpandApply NowActive JobUpdated 2 months ago - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in Cloud and Big Data platforms such as AWS, Snowflake, Hadoop, Hive, Pig, Apache Spark, etc. Masters in a related field, or Bachelors with 3+ years of experience in a related discipline (Computer Science, Operational Research, Physics, Mathematics, Neuroscience, Engineering, Econometrics, Statistics, Other Sciences etc.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
At Bodo, we are redefining what's possible with Python for analytics, data engineering, and AI. We've developed the world's first auto-parallelizing Python compiler, delivering HPC-level performance and efficiency for large-scale data processing.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Stream Processing: Implement stream processing applications using technologies such as Apache Kafka, Apache Flink, Apache Spark Streaming, or AWS Kinesis to process and analyze real-time data streams.
$210,000 a yearFull-timeExpandApply NowActive JobUpdated 4 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Python, Scala, Java) along with SQL and no-SQL database experience as well as Infrastructure as a Code (IAC, preferable Terraform) Ability to design solutions that can perform real-time, large-scale data processing in a distributed environment using Apache Spark using PySpark or other.
$248,700 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
We are innovating towards simple data ingestion, real-time stream processing, and a declarative framework and experience for ETL. In this role, you will lead product management for a core Data Engineering area.
ExpandApply NowActive JobUpdated 3 days ago
data engineering apache spark processing jobs in San Francisco, Boynton-beach, Florida
FEATURED BLOG POSTS
What is Employment Participation Rate
According to economists, there are four factors of production that go into creating higher quality goods at lower prices. These are
Structured vs Unstructured Interviews
The goal of an interview is to evaluate candidates based on their skills, personality, and knowledge. You want to choose the BEST candidate from your candidate pool, so the interview is something you can't mess up. As you begin planning your interview process, one of the major decisions you'll face is whether the interview should be a structured vs unstructured interview. So let's take a dive into the differences and sort out which circumstances warrant which interview process.
How to Describe Your Personality with Examples
Imagine you’re in an elevator with the CEO of your dream company and you get to talking. The conversation is going well and you start to imagine yourself working for their company when the CEO turns around and asks you “tell me a bit about yourself.” Would this catch you off guard or would you be able to give a clear and succinct description of who you are?
4 Ways to Make Your Job Posting More Inclusive
According to a Glassdoor survey,
How to Calculate Net Income
Understanding your finances can be daunting even if you’re good with numbers. Your net income, in particular, is a key metric for determining how well you’re doing financially and whether your current way of operating is sustainable or not.
To ATS or not to ATS
As hiring is becoming more analytical and data-driven, companies have found ways to incorporate technology to help hire and recruit more efficiently. ATS, also known as an applicant tracking system, has become one of the most widely adopted technological recruiting tools to date. In fact, according to data from Capterra:
6 Best Ways to End a Cover Letter with Examples
Including a cover letter with your resume is a great way to introduce yourself to the hiring manager, tell them why you’re the ideal fit for the role, and provide context about your personal situation. A strong cover letter will give you an advantage over other applicants. But it’s important that you structure it properly and write it powerfully so that it carries an impact. This article will discuss how to end a cover letter effectively so you catch the eye of a hiring manager and increase your odds of landing an interview. Read on to learn more.