- UpvoteDownvoteShare Job
- Suggest Revision
Develop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Lambda, Kafka, Airflow, Redshift, S3, Glue, and EMR. 10+ years of experience in data engineering on distributed frameworks such as Spark, Databricks, Kafka Streams, Hadoop etc.
$226,000 - $361,000 a yearFull-timeExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience using big data technologies (Snowflake, Airflow, Kubernetes, Docker, Helm, Spark, pySpark) Experience designing and building highly available, distributed systems of data extraction, ingestion, normalization and processing of large data sets in real time as well as batch, that will be used across engineering teams using orchestration frameworks like Airflow, KubeFlow or other pipeline tools.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming. Queer-Inclusive Benefits: Industry-leading gender-affirming offerings with up to 90% cost coverage, access to Included Health, monthly stipends for HRT, and more.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expert knowledge and experience in Databricks, Lake House, Structured Streaming, Kafka, Delta Lake, Delta Live table, Delta shareetc. Explore and build proof of concepts using open source NOSQL technologies such as HBase, DynamoDB, Cassandra and Distributed Stream Processing frameworks like Apache Spark, Kafka stream.
RemoteExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We are open to proficiency in a variety of technologies: SQL, Bash, Python, Java, Presto, Spark, AWS, DataOps, DevSecOps, data streaming like Kafka, RabbitMQ, data stacks like Airflow, Databricks, dbt, and data stores like Cassandra, Aurora, ZooKeeper.
ExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You have orchestrated and managed large scale data platforms such as Airflow, Kafka, or Jenkins. Our workforce management platform helps some of the fastest-growing, most innovative companies in the world—including Stripe, Etsy, and Robinhood—to schedule, forecast, and organize their support teams.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
We use tools like DBT, Airflow, Redshift, ElasticSearch, Atlan, and Retool to orchestrate data pipelines and define workflows. Experience working both real-time systems like Kinesis, Kafka, Flink, and batch data pipelines in Redshift, Presto, and Data Lakes.
$187,200 - $280,800 a yearFull-timeExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
You have a deep understanding of data modeling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop. and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The team uses a variety of tools, technologies, and languages to build software like Delta Lake, Hadoop, Kinetica, Solr, Spark, Kafka, Python, Java, Ruby, Scala, Airflow, Luigi, EMR, Databricks, etc.
ExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Including but not limited to Snowflake, BigQuery, Terraform, K8s, Cloud functions, Docker, Airflow, Jupyter, Kafka, Druid, Ansible. Including but not limited to Snowflake, BigQuery, Terraform, K8s, Cloud functions, Docker, Airflow, Jupyter, Kafka, Druid, Ansible.
ExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with distributed systems, Snowflake, Python, Airflow, Kafka, MongoDB, Redis, Datadog, Kubernetes, React, Ruby, Ruby on Rails. Proficiency in Python and experience with related technologies (Kafka, Airflow, etc.
$225,000 - $250,000 a yearFull-timeExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data Engineering: Apache Kafka, Airflow, Flink, Spark or equivalent technologies, Segment. Data Engineering: Apache Kafka, Airflow, Flink, Spark or equivalent technologies, Segment. Implement tax-loss harvesting to reduce capital gains taxes for cryptocurrency users.
RemoteExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data platform: Hadoop, Hbase, OpenSearch, Kafka, Spark, Flink, Go, Java, SQL, Databricks, Snowflake, BigQuery. Experience with big data and workflow management technologies like Hadoop, Spark, Redshift, Athena, Airflow, etc.
$145,000 - $190,000 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
For example, you will onboard new datasets from MongoDB/RDS/Kafka to Snowflake and Databricks, conduct impact analysis based on data lineage, and refactor data model for quality, reusability, performance and cost efficiency.
ExpandApply NowActive JobUpdated 19 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Harness the potential of big data technologies like Apache Presto, Apache Pinot, Flink, and Airflow. Craft high-quality software with meticulous attention to detail, utilizing technologies such as Python, React, MongoDB, Snowflake, and Kafka.
$144,000 - $237,000 a yearFull-timeExpandApply NowActive JobUpdated 3 months ago
airflow kafka jobs in San Francisco, CA
FEATURED BLOG POSTS
What is Seasonal Employment?
Depending on where you are in your career, you might have first-hand experience with seasonal employment. Seasonal employment can be a great way to expand your skill set and earn extra cash while helping businesses meet seasonal increases in demand.
How to Avoid a Bad Hire
"A new employee who doesn't meet the minimum performance, quality, and culture fit standards you set when you began sourcing and recruiting. Additionally, bad hires will immediately show signs of self-interest instead of an interest in their role and the company."
How to Ask for a Letter of Recommendation
When the job board you subscribe to finally posts your dream job, you may feel like the stars have aligned. But part of securing a position that matches your career plan is ensuring you address all the application basics. You know, the resume, the cover letter, the portfolio. It seems like you've got this in the bag — until you realize they want a letter of recommendation, too!
16 Tech Jobs You can Get Without a College Degree
You might think that if you don’t have a computer science, information technology, or related degree, then there’s absolutely no way you can break into the technology field and score a high-paying tech job. But this is a misconception. There are actually tons of tech jobs out there that don’t require a college degree. Instead, employers are more interested in the skills that you can offer. So, read on to learn more about how to land tech jobs without a degree.
What Are SMART Goals?
When it comes to achieving our goals, there’s a lot of noise to work through. A study by the University of Scranton has found that only 8% of people who set New Year’s resolutions actually achieve them. Our busy lives might be one reason for this. Another, even more important reason, is our approach to goal setting. Being too vague, too ambitious or simply unclear on the timeframe can set us up for failure.
The Best Remote Jobs: Where & How to Find Them
The Covid-19 pandemic hasn’t been easy on any of us, but if there’s one silver lining, it’s the fact that remote work has grown in popularity because of it. Companies that previously weren’t open to their employees working remotely were suddenly forced into allowing it. Since then, they've realized that much of their workforce is happier and more productive. Naturally, this has led to more remote job openings, which is great if you’re interested in this type of position. Read on to learn more about the best remote jobs and where to find them.
In-House vs Outsourcing Recruiting: Which is Better?
When looking at in-house vs outsourcing recruiting, it is important to nail down the benefits for each and whether those benefits outweigh the risks that follow.