- UpvoteDownvoteShare Job
- Suggest Revision
Analytics Tools: Excel, Tableau, AWS, BigQuery, NoSQL,Hadoop, Spark, Airflow, Gurobi, JIRA, Stata, Git. Languages: R, Python (Pandas, Seaborn, Scikit-learn), SQL,Hive, Pig, Impala, Sqoop, Kafka, VBA, Shell.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience designing, building, and maintaining data pipelines using tools such as Azure Data Factory, Apache Kafka, Apache Airflow, AWS Glue, Google Cloud Dataflow, and similar technologies.
$130,000 - $160,000 a yearFull-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Our platform is ever evolving, but currently is a combination of SQL, Kafka, Flume, Spark, Scala, Java, Python, NoSQL (HBase, Cassandra and ScyllaDB), MPP RDBMS, Postgres, Hadoop, AWS, AirFlow, Docker, Kubernetes, and Elastic.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The team uses a variety of tools, technologies, and languages to build software like Delta Lake, Hadoop, Kinetica, Solr, Spark, Kafka, Python, Java, Ruby, Scala, Airflow, Luigi, EMR, Databricks, etc.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expert knowledge and experience in Databricks, Lake House, Structured Streaming, Kafka, Delta Lake, Delta Live table, Delta shareetc. Explore and build proof of concepts using open source NOSQL technologies such as HBase, DynamoDB, Cassandra and Distributed Stream Processing frameworks like Apache Spark, Kafka stream.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data Integration experience in tools like Amazon API Gateway, S3, SQS, Airflow, Apache Kafka, Lambda, Snowflake, etc. Hands-on experience implementing cloud-based data infrastructure and integration patterns using tools like Amazon API Gateway, S3, SQS, Airflow, Apache Kafka, Lambda, Snowflake, etc.
Full-timeExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed. Experience in Real Time Data Ingestion using GCP PubSub, Kafka, Spark or similar.
$130,000 - $150,000 a yearFull-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of Apache Airflow, Spark, Flink, Kafka/Kinesis, Snowflake, Hadoop, Hive. Knowledge of Apache Airflow, Spark, Flink, Kafka/Kinesis, Snowflake, Hadoop, Hive. This involves harnessing diverse and extensive data sources, including the blockchain, to grant millions of individuals access to cryptocurrency while simultaneously identifying and thwarting malicious entities.
ExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We use proprietary and open source technologies, Kafka, Spark, Iceberg, Airflow, Presto, etc. Proficiency in at-least one of the following programming languages - Python, Scala or Java. Experience in multi-threaded, concurrent programming and synchronization Cloud technology experience on platforms like AWS, Microsoft Azure, Google Cloud Experience developing Big Data applications using java, Spark, Kafka is a huge plus.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
ELT (Bigquery, dbt, Airflow, Kafka) You will be primarily developing Data Warehouse Solutions in BigQuery/Snowflake using technologies such as dbt, Airflow, Terraform. You will be primarily developing Data Warehouse Solutions in BigQuery/Snowflake using technologies such as dbt, Airflow, Terraform.
ExpandUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Technologies: Kafka, Airflow, Composer. M.S. or Ph. D. in a quantitative field (CS, EE, Statistics, Physics, Math, Computational Linguistics, Neuroscience, etc. Technologies: Kafka, Airflow, Composer.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Design and implement distributed data processing pipelines using Spark, Hive, Python, Airflow, and other tools and languages prevalent in the Hadoop ecosystem. Design and implement distributed data processing pipelines using Spark, Hive, Python, Airflow, and other tools and languages prevalent in the Hadoop ecosystem.
RemoteExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Keywords: GCP, Google Cloud Platform, BigQuery, Composer, SQL, Python, Data Engineering, Data Pipelines. Experience working with GCP technologies like BigQuery, Composer, GCS, DataStream, Dataflows. Capture, store and socialize data lineage and operational metadata.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experienced in using Big Data stack (Hadoop, Hive, Spark, Kafka, Airflow/OOZIE, BigQuery/Presto/Impala, etc.) Experienced in using Big Data stack (Hadoop, Hive, Spark, Kafka, Airflow/OOZIE, BigQuery/Presto/Impala, etc.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Good understanding of data pipeline design concepts, Hands-on experience with Postgres and Snowflake, Excellent coding skills in Python, Experience with Apache Airflow and Apache Spark tools, Knowledge of AWS, Experience with CI/CD tools and processes, Good communication skills.
ExpandUpdated Yesterday
airflow kafka jobs
FEATURED BLOG POSTS
5 Common Interview Mistakes
Everyone's interview process is unique in some form or fashion. Like most, your interview process is crafted so you can get the most information out of your candidates to increase hiring confidence and make the right hiring decisions. However, there are often small problems in interview processes that could ultimately affect the success of hiring decisions.
How to Get a W2 From Previous Employers
When tax time rolls around, the last thing you want to worry about is having to track down a W-2 from your former employer. Many times you won’t have to because the IRS requires companies to send these forms to all current and former employees who have earned more than $600 in the last year. Unfortunately, there are employers who don’t do what they’re supposed to. There are even times where something else may happen that prevents the W-2 from getting where it’s supposed to go.
How to Ask Someone to be a Reference + Email Templates
One part of the job-hunting process that frequently gets overlooked is putting together a list of good references. Most of the time we focus on creating the perfect resume, writing an awesome cover letter, and getting our hands on letters of recommendation. We think about what outfit we’ll wear to the job interview, how we’ll answer those tricky questions, and what our career plan looks like. But, in fact, having multiple references lined up who will speak favorably about you to a potential employer is critical to landing a job. This aspect of job searching really can’t be ignored.
Job Rejection Email Response with Examples
Glassdoor estimates that, on average, there are about 250 applicants for every job vacancy out there. If you’ve ever applied for a job, the odds are that you’ve received the dreaded job rejection email.
Structured vs Unstructured Interviews
The goal of an interview is to evaluate candidates based on their skills, personality, and knowledge. You want to choose the BEST candidate from your candidate pool, so the interview is something you can't mess up. As you begin planning your interview process, one of the major decisions you'll face is whether the interview should be a structured vs unstructured interview. So let's take a dive into the differences and sort out which circumstances warrant which interview process.
How to Describe Your Personality with Examples
Imagine you’re in an elevator with the CEO of your dream company and you get to talking. The conversation is going well and you start to imagine yourself working for their company when the CEO turns around and asks you “tell me a bit about yourself.” Would this catch you off guard or would you be able to give a clear and succinct description of who you are?
4 Ways to Make Your Job Posting More Inclusive
According to a Glassdoor survey,