- UpvoteDownvoteShare Job
- Suggest Revision
Experience using modern compute, data infrastructure and visualization tools, and services such as Kafka, Airflow, AWS S3, AWS EC2, DBT, Kubernetes, Terraform, Data Lakes, Data Warehouses, and Looker.
$239,000 - $300,000 a yearFull-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
AI/ML Platform Operations experience in an environment with challenging data and systems platform challenges - including large scale Kafka and Spark deployments (or their coralaries such as Pulsar, Flink, and/or Ray) as well as Workflow scheduling tools such as Apache Airflow, Dagster, or Apache Beam.
$241,000 - $362,000 a yearFull-timeExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with a workflow manager such as Airflow. Experience with large scale streaming platforms (e.g. Kafka, Kinesis) Experience with data warehouse platforms (e.g. Redshift, BigQuery, Databricks.
ExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with AWS ECS and/or Kubernetes. Good experience with infrastructure-as-code tools (e.g. Terraform, You will help develop and implement the next generation of our data pipeline to ensure visibility into our business as we scale toward the launch of an autonomous mobility service.
ExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with large scale processing frameworks (e.g. Spark, Hadoop, Python, and Java/Scala. Design, build, and maintain a platform used by Client teams to build large-scale data pipelines. The Data Team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data processing technologies such as Spark, Flink, Hive, Airflow, or Kafka. Experience with data processing technologies such as Spark, Flink, Hive, Airflow, or Kafka. All full-time employees are also eligible for equity compensation and for benefits.
$189,110 - $233,840Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience in building Event Driven Microservices using Kafka, Airflow. Experience in building Event Driven Microservices using Kafka, Airflow. Experience in majority of AWS Services (e.g., ECS/EKS, Lambda, RDS, SageMaker) and DevOps.
Full-timeExpandApply NowActive JobUpdated 2 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with Kafka, EMR, Airflow, Spark, Airflow, Hadoop or similar. Experience working with Kafka, EMR, Airflow, Spark, Airflow, Hadoop or similar. As an equal opportunity employer, Cardlytics is committed to diversity, equity, and inclusion.
$180,000 - $210,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with orchestration tools such as Apache Airflow or AWS step functions. Working experience with Kafka or AWS SQS. Experience with cloud technologies in AWS or GCP as well as container systems such as Docker or Kubernetes.
Full-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow. Experience with Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with streaming / data processing technologies such as Beam, Spark, Kafka, Airflow, HBase, Presto. Experience in stream / data processing technologies like Kafka, Spark, Google BigQuery, Google Dataflow, Presto, HBase.
ExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Our goal is to care for you while you care for our clients and get you paid the highest pay possible. You will help to build the pipeline that enables the Client to develop and scale with a data-first culture.
Full-timeExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Has experience building and optimizing data pipelines (Airflow, Kafka, Flink, CDC) and data warehouses (Snowflake, Redshift). Our team includes experts from Meta, Apple, Amazon, Google, Microsoft, Twitter, Roblox, Samsung, EA, Riot, Tinder, Intel, Twitch, and more.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Strong expertise in the big data ecosystem, including tools like Kafka, Spark, Apache Iceberg, Airflow, S3, data modeling, data warehouses, OLAP databases, etc. Strong expertise in the big data ecosystem, including tools like Kafka, Spark, Apache Iceberg, Airflow, S3, data modeling, data warehouses, OLAP databases, etc.
Full-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Large scale streaming platforms (e.g. Kafka, Kinesis) Experience with data warehouse platforms (e.g. Redshift, BigQuery, Databricks, etc.) Large scale streaming platforms (e.g. Kafka, Kinesis.
ExpandApply NowActive JobUpdated 28 days ago
airflow kafka jobs in San Mateo, CA
FEATURED BLOG POSTS
Explore Your Skill and Find the Best Way to Make Money From Home
When you just can’t stomach another drive-thru coffee on your morning commute, close your navigation app on your phone and search for easy ways to make money from home instead. With a computer and some niche skills, there are countless opportunities for you to earn a living from your couch. (Okay, fine, your home office.) Below, we’ll explore 30 different ways to make money from home, as well as a few “too-good-too-be-true" warning signs to know to keep you from booking the wrong remote gig.
Learn How to Respond to an Interview Request With Templates
Job interviews are an inevitable part of any job search. So, handling them well is key to building a fulfilling career. Regardless of whether you’re looking at a more junior role or strive for a role as a business executive, you need to maintain your professionalism every step of the way in order to stay in the game.
How to Write an Address Correctly: Explained with Examples
It's hard to imagine a scenario where a text or phone call just won't do these days. With communication at our fingertips, you may think learning how to write an address is a superfluous skill. But it's a skill that will come in handy when you need to fill out healthcare forms, ship a package, order food delivery, or even apply for new jobs.
What is Employment Participation Rate
According to economists, there are four factors of production that go into creating higher quality goods at lower prices. These are
How to Get Pay Stubs (From Previous Employee Also!)
Pay stubs are an important piece of document which shows your earnings in a given period, as well as any deductions made towards your health insurance or pension contributions. They’re also excellent for finding out how much your recent salary raise has bumped up your monthly net income.
How to Write a Job Description?
It might be tempting to overlook the importance of a well-written job description. After all, if you’ve posted job ads before and ended up with tons of resumes in hand, it’s easy to assume that this will always be the case, regardless of how your job ad reads. But, in reality, you really can’t take getting an influx of resumes for granted.
How to Get a W2 From Previous Employers
When tax time rolls around, the last thing you want to worry about is having to track down a W-2 from your former employer. Many times you won’t have to because the IRS requires companies to send these forms to all current and former employees who have earned more than $600 in the last year. Unfortunately, there are employers who don’t do what they’re supposed to. There are even times where something else may happen that prevents the W-2 from getting where it’s supposed to go.