- UpvoteDownvoteShare Job
- Suggest Revision
Experience in Hadoop, HDFS, Hive, Presto, REST/SOAP API, Spark2, Airflow is a plus. 6+ years’ experience working within the AWS Big Data/Hadoop Ecosystem (EMR, Glue and Athena) Experience in Hadoop, HDFS, Hive, Presto, REST/SOAP API, Spark2, Airflow is a plus.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in open source technologies like Elastic Search, Logstash, Kakfa, MongoDB, Hadoop, Spark, Trino/Presto, Hive, Airflow, Splunk. Expertise in open source technologies like Elastic Search, Logstash, Kakfa, MongoDB, Hadoop, Spark, Trino/Presto, Hive, Airflow, Splunk.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expert and Hands-On development in distributed computing environment using Hadoop, Scala, Spark and Apache Airflow. Familiarity with Snowflake or DataBricks a plus. Develop Data Pipelines using Scala and Spark EMR to move data into our consolidated data lake or data warehouse (Snowflake.
$142,800 - $195,000 a yearFull-timeExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Develop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Lambda, Kafka, Airflow, Redshift, S3, Glue, and EMR. 10+ years of experience in data engineering on distributed frameworks such as Spark, Databricks, Kafka Streams, Hadoop etc.
$226,000 - $361,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The team uses a variety of tools, technologies, and languages to build software like Delta Lake, Hadoop, Kinetica, Solr, Spark, Kafka, Python, Java, Ruby, Scala, Airflow, Luigi, EMR, Databricks, etc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Our backend is Java / Spring Boot microservices, built with Gradle, coupled with things like DynamoDB, Kinesis, AirFlow, Postgres, Planetscale, and Redis, hosted via AWS. Expertise in working with large data sets using distributed computing platforms such as Hadoop, Spark, or AWS services like EMR and S3.
$173,200 - $290,000 a yearExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in open-source technologies like HBase, Hadoop, Kafka, Spark, Presto, Hive, Airflow. Experience in open-source technologies like HBase, Hadoop, Kafka, Spark, Presto, Hive, Airflow.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Snowflake/Databricks/Hadoop training certificate is a plus. Leverage your Python, Airflow, and Looker/Superset expertise to scale our data pipelines and models. For example, you will onboard new datasets from MongoDB/RDS/Kafka to Snowflake and Databricks, conduct impact analysis based on data lineage, and refactor data model for quality, reusability, performance and cost efficiency.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with a variety of High-Performance computational frameworks (Spark, Hadoop, Elasticsearch, Kafka, AirFlow, etc. Implement SQL queries for RedShift, and/or a Hadoop job on EMR; and define and implement computational tasks on Spark and other High-Performance platforms.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
8+years of experience in data engineering on distributed frameworks such as Spark, Flink, Kafka Streams, Storm, Hadoop etc. Experience with ETL job orchestration, preferably with a feature-rich tool such as Airflow, Argo, AWS step functions, Luigi etc.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrated experience with big data tech stack: Hadoop/EMR, Spark, Kafka, Hive and Airflow. Demonstrated experience with big data tech stack: Hadoop/EMR, Spark, Kafka, Hive and Airflow.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Bonus if you have prior experience working with data engineers (e.g. engineers who use tools such as Airflow, Luigi, Jenkins, MapReduce, Pig, Spark, Hadoop, Hive, HBase, Greenplum, Vertica, etc.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with MapReduce frameworks (Apache Hadoop/Spark) or orchestration frameworks like Apache Beam/Apache Airflow/Google Dataflow. Experience with MapReduce frameworks (Apache Hadoop/Spark) or orchestration frameworks like Apache Beam/Apache Airflow/Google Dataflow.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Strong familiarity with Kafka, Flink, Spark, Hadoop, Iceberg, Airflow S3, Data Modeling, relational databases, columnar databases, & data serialization formats (e.g. Avro, Thrift, & Protobuf.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with MapReduce frameworks (Apache Hadoop/Spark) or orchestration frameworks (Apache Airflow/Apache Beam. Experience with MapReduce frameworks (Apache Hadoop/Spark) or orchestration frameworks (Apache Airflow/Apache Beam.
$109,000 - $190,000 a yearFull-timeExpandApply NowActive JobUpdated Today
airflow hadoop jobs in San Francisco, CA
FEATURED BLOG POSTS
Project Coordinator Resume Guide with Tips and Samples
Project coordinators fall within the field of project management, which tends to be a field with a lot of opportunity. In short, project coordinators differentiate themselves from project managers due to the responsibilities related to their work. While project managers have a hands-on approach for managing a team, project coordinators ensure the success of a project from the background. They handle administrative and organizational tasks related to delegation, establishing project objectives, or performing digital administrative tasks.
Land a Production Supervisor Job With These 5 Resume Tips
Have you been working as a team lead on a factory floor or in a manufacturing plant for several years? Do you consider yourself a leader who excels at managing and coaching others? Can you monitor and optimize production processes? Do you recognize the importance of employee safety and compliance? If you’re answering yes to all of these questions, then you’re definitely in the right place.
Paralegal Resume Templates, Examples, and Tips
A paralegal job is a great stepping stone to a legal career. As an expert in legal research, paralegals must be organized, strong writers, and a team player with others who require the assistance of the paralegal’s work. Sometimes known as legal assistants, paralegals are a critical part of a legal team’s work. Paralegals work across law firms, corporations, nonprofits, and government agencies.
Assistant Manager Resume Guide
It can be very challenging for many individuals to find a job in the current economy. As a result, the unemployment rate is only starting to decrease after being at its highest since the Great Depression. One of many reasons this is occurring is because this pandemic has encouraged people to quit their jobs to search for better working conditions, become entrepreneurs, or change careers.
The Ultimate Guide to Writing a Stellar Sales Manager Resume
Have you been working in sales for several years now and feel ready to move up the career ladder? Do you enjoy leading sales teams and developing strategies to drive company sales? Would you describe yourself as a strong communicator, negotiator, and closer? If so, then there’s a good chance that a sales manager position might be the ideal fit for you.
How to Successfully Make a Career Change in the New Year
The beginning of a new year is often a time for reflection and introspection. Millions of people use this time to come up with new resolutions to help them live happier and healthier lives. Pursuing our career ambitions is among the top five, right up there with exercising more and eating better.
The Ins and Outs of Building a Resume From a Bar Manager Job Description
Many people turn their noses up at bartending jobs, as they do for most jobs in the food service industry. Little do they know, bartenders possess a lot of unique skills. Even though these jobs can require little to no education, bartenders must go through extensive training or schooling. Additionally, the demand for these jobs is extremely high, and the career growth opportunities often bring bartenders into management positions after years of experience.