- UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with one or more Hadoop technologies (Hive, Impala, Spark SQL, Presto). Architect, design, and build a big data infrastructure platform, primarily based on Hadoop technologies on the Azure cloud platform, ensuring that the data lake meets specific minimum availability and security thresholds.
$250ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
You have familiarity with ML and NLP tools (TensorFlow, spaCy, scikit-learn), you drive the architecture of the systems, and you are comfortable interfacing with data pipelines and data stores such as MySQL, DynamoDB, and Kafka.
$250ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
This platform supports numerous open standards (SQL, HTML5, REST, and more), open-source solutions (such as Kubernetes, Hadoop, Spark and Kafka) and a wide variety of programming languages, databases, tools and integration frameworks.
$200ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with a variety of High-Performance computational frameworks (Spark, Hadoop, Elasticsearch, Kafka, AirFlow, etc. Implement SQL queries for RedShift, and/or a Hadoop job on EMR; and define and implement computational tasks on Spark and other High-Performance platforms.
$150ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data tools: Hadoop, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend etc. In this capacity, the Senior Data Engineer designs and develops systems for the maintenance of the business’s data warehouse, ETL processes, and business intelligence.
$150Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data analysis and statistical visualization tools such as matplotlib and seaborn Good knowledge of big data such as Spark, Hadoop, Kafka, Hive, and ElasticSearch Strong communication, collaboration, and analytical skills We believe in People FirstWe firmly believe that working in a culture focused on diversity, equity, and inclusion spurs innovation, creates healthy and high-performing teams, and delivers superior customer experiences.
$100,000 - $130,000Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Build scalable data pipelines using Spark, Airflow, AWS data services (Redshift, Athena, EMR), Apache projects (Spark, Flink, Hive, and Kafka) Atlassian is looking for a Data Engineer to join our Data Engineering Team. You will build top-notch data solutions and applications that inspire important decisions across the organization.
$150ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
You should be experienced working with streaming platforms such as Azure EventHub, Apache Kafka, Apache Flink or Amazon Kinesis. Have 4+ years in stream infrastructure engineering maintaining Kafka, Azure EventHub, AWS Kinesis, etc.
$200Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Kafka + Spark Streaming. We are reimagining billing and invoicing for this era of hybrid pricing in software. As an early engineer at Orb, you'll help to build the technical foundations of a critical product that needs to be reliable and accurate at scale.
RemoteExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in developing data-intensive applications (Apache Spark, Hadoop, Hive). As a software engineer, you will work coactively with the best in ML and data systems, building the foundation for understanding unstructured image and video data.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data Processing: Strong understanding of data processing frameworks like Apache Spark, Apache Flink, Apache Beam, or Hadoop MapReduce. Streaming Data: Knowledge of stream processing frameworks like Apache Kafka or Apache Pulsar is valuable for handling real-time data streams.
$200ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
In the role of Principal Partner Engineer, you will report to the Sr. Director, Partner Engineering. As a Partner Engineer, you'll lead deployments, optimize implementations, and handle integrations to build successful, long-term partnerships.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data Engineering - You have firsthand experience with database performance tuning, cloud storage and processing technologies (e.g. Redshift, S3, Glue, Lambda, Databricks, DBT), workflow orchestration (e.g. Dagster, Airflow), distributed computing (e.g. Spark, EMR), message queues and streams (e.g. Kafka, Kinesis.
$80,000 - $220,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
We are open to proficiency in a variety of technologies: SQL, Bash, Python, Java, Presto, Spark, AWS, DataOps, DevSecOps, data streaming like Kafka, RabbitMQ, data stacks like Airflow, Databricks, dbt, and data stores like Cassandra, Aurora, ZooKeeper.
$250ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
PostgreSQL, Redis, Kafka, Maven, Jenkins. Participate in strategic planning and decision-making at the project and department levels, influencing the direction of our software and technology stack.
ExpandApply NowActive JobUpdated 6 days ago
hadoop kafka jobs Title: principal software engineer Company: Panalgo in San Francisco, CA
FEATURED BLOG POSTS
How to Call Out of Work
No matter how happy we are with our jobs, there are days when we feel overwhelmed and want to call out of work. No, don't feel guilty. It's expected because we're humans, and we can't control the uncertainties of life. But the problem lies in how to call out of work without seeming uncommitted to work, especially if you seldom get work-free days.
What is Seasonal Employment?
Depending on where you are in your career, you might have first-hand experience with seasonal employment. Seasonal employment can be a great way to expand your skill set and earn extra cash while helping businesses meet seasonal increases in demand.
How to Avoid a Bad Hire
"A new employee who doesn't meet the minimum performance, quality, and culture fit standards you set when you began sourcing and recruiting. Additionally, bad hires will immediately show signs of self-interest instead of an interest in their role and the company."
How to Ask for a Letter of Recommendation
When the job board you subscribe to finally posts your dream job, you may feel like the stars have aligned. But part of securing a position that matches your career plan is ensuring you address all the application basics. You know, the resume, the cover letter, the portfolio. It seems like you've got this in the bag — until you realize they want a letter of recommendation, too!
16 Tech Jobs You can Get Without a College Degree
You might think that if you don’t have a computer science, information technology, or related degree, then there’s absolutely no way you can break into the technology field and score a high-paying tech job. But this is a misconception. There are actually tons of tech jobs out there that don’t require a college degree. Instead, employers are more interested in the skills that you can offer. So, read on to learn more about how to land tech jobs without a degree.
What Are SMART Goals?
When it comes to achieving our goals, there’s a lot of noise to work through. A study by the University of Scranton has found that only 8% of people who set New Year’s resolutions actually achieve them. Our busy lives might be one reason for this. Another, even more important reason, is our approach to goal setting. Being too vague, too ambitious or simply unclear on the timeframe can set us up for failure.
In-House vs Outsourcing Recruiting: Which is Better?
When looking at in-house vs outsourcing recruiting, it is important to nail down the benefits for each and whether those benefits outweigh the risks that follow.