- UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with Snowflake, Monte Carlo, RDS, DynamoDB, Kafka, Fivetran, dbt, Airflow, Docker, Kubernetes, EMR, Sagemaker, DataDog, PagerDuty, Atlan, Data Observability tools and Data Governance tools.
$235,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Extensive experience with Kafka, Spark, Redis, Flink, Trino/Presto, Hadoop in complex on-premise and hybrid data environments. Technical Leadership: Leverage your deep expertise in data technologies such as Kafka, Spark, Redis, Flink, Trino/Presto, and Hadoop to lead the architecture and development of our data systems, ensuring optimal performance, reliability, and scalability.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Backend: Ruby on Rails, GraphQL, Kafka. Over 5,500 companies, including Zoom, One Medical, Cartier, Microsoft, and Korn Ferry, use Productboard to understand what customers need, prioritize what to build next, and rally everyone around their roadmap.
Full-timeExpandApply NowActive JobUpdated 18 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with: Hadoop, Spark, Kafka, Scala, Python, R etc. Experience with CNN training and deep learning frameworks such as PyTorch, Tensorflow, Keras or similar. Experience working with: Hadoop, Spark, Kafka, Scala, Python, R etc.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Open Source Frameworks - Spring boot, Spring CoreMessaging frameworks such as Kafka, Tibco EMS or JMSOracle PL/SQL JavaScript and scripting frameworks (JQuery, AngularJS)Hands-on experience in test automation at various levels of testing (unit, component, integration and functional tests.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Technical Proficiency: Expertise in web and data technologies such as Kafka, HDFS, Spark, EMR, Open Table Formats, Snowflake, Hive, HBase, Scylla, Django, and FastAPI. Technical Proficiency: Expertise in web and data technologies such as Kafka, HDFS, Spark, EMR, Open Table Formats, Snowflake, Hive, HBase, Scylla, Django, and FastAPI.
$350,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hadoop, S3, AWS, Google Cloud etc. We are also the engine that drives a fully functional world class data warehouse on top of Hadoop, this means providing tools to define data cubes and syncing high load of data from a processing Hadoop to other systems using in-house built Applications.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of distributed computing technologies such as Apache Spark, Hadoop, or Dask, and experience with containerization and orchestration technologies such as Docker and Kubernetes. Knowledge of distributed computing technologies such as Apache Spark, Hadoop, or Dask, and experience with containerization and orchestration technologies such as Docker and Kubernetes.
$230,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Broader knowledge of large dataset processing pipelines and distributed computing architectures (Apache Beam/Airflow, Spark/Hadoop architectures) Broader knowledge of large dataset processing pipelines and distributed computing architectures (Apache Beam/Airflow, Spark/Hadoop architectures.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Preferred qualificationsHave experience in Java, Scala (Spark), or RubyExperiences with big-data technologies such as Spark, Presto, Kafka, and Flink, and OLAP preferredNote that It’s not expected that any single candidate would have expertise across all of these areas.
$269,200Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Kafka and streaming data processing. Hands-on experience with Kafka, Flink, Spark, or Pulsar. Kafka is a big part of how our systems communicate. Architect, design, and implement a scalable and highly available Streaming Ingest Platform based on Kubernetes, mostly Java with some java script, Go, Rust, React, PostgreSQL and Redis.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop, and own robust, scalable data processing and data integration pipelines using Python, dbt, Kafka, Airflow, PySpark, SparkSQL, and REST API endpoints to ingest data from various external data sources to Data Lake. Develop testing frameworks and monitoring to improve data quality, observability, pipeline reliability, and performance Orchestrate sophisticated data flow patterns across a variety of disparate tooling.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Must have: Strong knowledge of Spark, Hadoop, or Cloudera. Knowledge of one of the major business intelligence vendors, such as Tableau, Power BI, Quick Sight, Qlik, Sisense, Domo, or Looker. Must have: Strong knowledge of Spark, Hadoop, or Cloudera.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Required : Overall 10+ years of experience in Technology with 3+ years of experience in Microservices (Java / Spring Boot), any NoSQL DB (Mongo, Cassandra, or equivalent), RDBMS (Oracle, MySQL or equivalent), Cloud (Azure, Google Cloud Platform or AWS), 1+ year(s) of experience in Kafka event processing, 2+ years of experience in Front End like ReactJS, Angular or equivalent, 1+ year of experience in iOS / Android app development.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Required Skills & Experience 3+ years of Data Engineering experience Software development background SQL NoSQL Database experience Python AWS (EMR, RDS, Redshift, Kinesis) Hadoop or Spark Desired Skills & Experience Masters degree or higher in Computer Science or related field.
$145,000 - $175,000Full-timeRemoteExpandApply NowActive JobUpdated Today
hadoop kafka jobs Company: Diverse Lynx in San Francisco, CA
FEATURED BLOG POSTS
What is Career Cushioning?
Is your organization prepared for “career cushioning”?
Growing Discontent: Employees Wouldn't Wish Their Jobs on Their Worst Enemy
The start of a new year, and most people are already busy setting personal and professional goals. What’s on the top of the list for a growing number of working people is making an exit from the job they currently have. Why?
How to Gracefully Quit a Job You Just Started
You’ve just started learning the ropes at your new job, and you've gotten to know your colleagues. But you’re already thinking about quitting. Maybe you were deciding between to job offers and realized that you’ve made the wrong choice. Or, a change in your personal circumstances means that you have to quit.
How to Professionally Reschedule a Job Interview Without Destroying Your Chances
You’ve practiced answering common interview questions and refined your “greatest weakness.’ Nothing can stop you until BAM! The flu hits your household. Or you ran over a nail and popped a tire en route to the interview. When you need to pivot, there’s a good, better, and best way to reschedule a job interview. Here’s how to do it professionally, so you can nail the gig when the timing is right.
What is a W-9 and How to Fill One Out
When you began working for yourself, you probably didn’t account for the tax reporting work that will fall on your shoulders each year. If you’re a freelancer, independent contractor, or business owner, filing your taxes is not as simple as uploading your W-2 form into some online tax preparation software. Most self-employed people need to complete a W-9 as a step for accurately reporting their earnings to the IRS. Below, you can learn how to fill out a W-9 and when to submit it.
Tightening the HR budget in 2023
With the state of the economy still uncertain, 2023 is expected to be approached with much anticipation. Human Resource leaders have many concerns, including how they will manage to accomplish their goals with budget belts already getting snug. Let’s look at some of the factors that the new year is projected to bring for HR and how to prioritize budgets to reach human capital objectives.
A Comprehensive Guide to Becoming a Better Conversationalist
Have you ever stood awkwardly next to someone at a party because you didn’t know what to say to them? How about at a networking event or on a first date? You're not alone if you’ve ever experienced this uncomfortable silence. Many people struggle to master the art of being a great conversationalist.