- UpvoteDownvoteShare Job
- Suggest Revision
Expert knowledge and experience in Databricks, Lake House, Structured Streaming, Kafka, Delta Lake, Delta Live table, Delta shareetc. Explore and build proof of concepts using open source NOSQL technologies such as HBase, DynamoDB, Cassandra and Distributed Stream Processing frameworks like Apache Spark, Kafka stream.
RemoteExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Design and implement distributed data processing pipelines using Spark, Hive, Python, Airflow, and other tools and languages prevalent in the Hadoop ecosystem. Design and implement distributed data processing pipelines using Spark, Hive, Python, Airflow, and other tools and languages prevalent in the Hadoop ecosystem.
RemoteExpandApply NowActive JobUpdated 12 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Tech stack: Google cloud, HDFS, SPARK, Scala, Python (optional), Automic/Airflow, BigQuery, Kafka, API, Druid. Experience building complex near real time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability, and SLA adherence.
ExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
You have a deep understanding of data modeling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop. and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The Data Architect will use their skills and experience of technologies including Kubernetes, Kafka, Airflow, Linux, AWS and Python to spearhead the evolution and enhancement of their existing data infrastructure, as they scale up the adoption of their software as a medical device product.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Must have experience with: Informatica Data Management Cloud (IDMC) or PowerCenter, or axon, or IDQ (Informatica Data Quality) Nice to have experience with Databricks, Docker, and EKS. Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Includes Snowflake, Apache Airflow, AWS cloud infrastructure (e.g., Kinesis, Kubernetes/EKS, Lambda, Aurora RDS PostgreSQL), Python and Typescript. Experience building and managing production-grade data pipelines using tools such as Airflow, dbt, DataHub, MLFlow.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Candidates must be college graduates with broad technical knowledge encompassing as many of the following as possible: Python, C#, Java, Scala, Go, SQL, Pandas, Elasticsearch, Kibana, Snowflake, Docker, Kubernetes, Airflow, Argo, Spark and Hive. Some experience with visualization tools and Apache Kafka would be a plus as would some exposure to financial markets.
$150,000 - $200,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data Engineering: Kafka, Airflow, Flink, Spark or equivalent technologies. Data Engineering: Kafka, Airflow, Flink, Spark or equivalent technologies. CoinTracker makes cryptocurrency portfolio tracking and tax compliance simple.
RemoteExpandUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
The team uses a variety of tools, technologies, and languages to build software like Delta Lake, Hadoop, Kinetica, Solr, Spark, Kafka, Python, Java, Ruby, Scala, Airflow, Luigi, EMR, Databricks, etc.
$124,000 - $204,250 a yearExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Design, Develop, Modernize/Migrate pipelines to Databricks. As a Sr. Big Data Engineer, you will work with a variety of talented teammates and be a driving force in technical initiatives that will accelerate analytics at Client.
RemoteExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed. Experience in Real Time Data Ingestion using GCP PubSub, Kafka, Spark or similar.
ExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Work with technologies like AWS, SQL/NoSQL databases, Kafka, Airflow, and NVIDIA Triton, ensuring efficient and effective use of these tools. Proven experience in building and maintaining data pipelines (e.g., Airflow, Mage.ai, Dagster.
Full-timeExpandUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. Big Data Engineer. We’re looking to expand our Big Data Engineering team to keep pace.
RemoteExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with at least 3 of the technologies/tools mentioned here: HAProxy, Kafka, Big Data/ Hadoop, Presto, Spark, Airflow, Pinot, Druid, Opensearch, Gcp, Data Proc. Experience with at least 3 of the technologies/tools mentioned here: HAProxy, Kafka, Big Data/ Hadoop, Presto, Spark, Airflow, Pinot, Druid, Opensearch, Gcp, Data Proc.
Full-timeExpandApply NowActive JobUpdated Today
airflow kafka jobs
FEATURED BLOG POSTS
How to Ask for a Raise at Work
Here we go again; it’s time to talk money. Whether you’re one year in at a new company or approaching year five on the same team, learning how to ask for a raise should be part of your long-term career plan. These conversations are rarely fun (thanks to society, which has conditioned us to believe that money is taboo), but they are necessary if you want to, well, get paid what you’re worth. Trust us, there’s a lot of money on the table for taking. Below, we’ll discuss tips on timing, approach, and follow-up.
Technology in the Workplace: How to Improve your HR Function with AI
It’s safe to say that the last two years have brought fundamental changes to the way we work and do business. Companies have relied on technology in the workplace to digitize their services and build a remote-friendly infrastructure that could prepare them for the future.
How to Maximize Action Verbs in Your Resume
Writing a resume that stands out takes more than using keywords and savvy formatting. It’s not just about having an impressive list of accomplishments. It’s also about how you position them using action verbs and deliberate word choice. So if you are looking for a way to craft a resume that stands out and gets calls back? Start by sprucing up your resume with captivating action verbs.
What is Your Desired Job Title?
You’ve decided to look for a new job. So now comes the question — what is your desired job title? There are lots of considerations to think through when deciding on the right title for your next role.
4 Things to Consider When Building a Global Workforce
The rise of remote work has given employers a unique chance to rethink how they approach workforce management. This ranges from rethinking the size and design of their office space to updating their tech stack to accommodate different working styles. It has created new opportunities for companies of all sizes to expand their hiring pool and look for top talent on a global scale.
Operations Job Titles for Entry, Mid, and Senior-Level Positions
An operations team can take on many functions within a business. With wide-ranging responsibilities come wide-ranging job titles. This means that you have to be more vigilant in your job search. On one hand, the perfect job might be hidden under a title you might not expect. Meanwhile, operations titles that you’re used to looking at may mean something different at a given organization depending on their structure.
How To Request Accommodations at Work (According to Someone Who’s Done It)
Doing a job for eight hours a day, five days a week is exhausting for anyone. But for those with a disability or chronic pain, it can be especially taxing—something must change. Asking for reasonable accommodations at work can feel tricky, especially if you’re new to the job. Under the Americans with Disabilities Act (ADA), physical disabilities, health conditions, and symptoms of mental health are all valid workplace accommodations. When you request accommodations, it means that your condition is impacting your ability to perform at work.