- UpvoteDownvoteShare Job
- Suggest Revision
Must have: Strong knowledge of Spark, Hadoop, or Cloudera. Job Description Data Engineer (SS&C Technologies, Inc.; San Francisco, CA): The Data Engineer will: Create a leading cloud platform with the latest big data, cloud native and machine learning technologies.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Streaming Platforms: Kafka + Spark Streaming. We are reimagining billing and invoicing for this era of hybrid pricing in software. As an Infrastructure Engineer at Orb, you will be responsible for designing and maintaining product features that require deeply understanding reliable and scalable systems.
$231,000 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in different databases, data storage concepts, and data infrastructure like Hadoop, Kafka, etc. Hands-on experience with Protobuf, Kafka, Flink, BigQuery, Druid, Feast, Kubeflow, Ray, Vertex or KServe, Experience with Terraform, ArgoCD, Github Actions, and similar tools used for CI/CD.
$289,100 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in Big Data, Hadoop, Spark, HDFS, Hive, HBase, Kafka, Impala, Spark, and AWS, EMR. " Hands-on experience with a variety of big data (Hadoop / Cloudera, Cloud, etc.) " Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.
$100 an hourExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Backend development in Python/Django, Go, SQL, AWS, Java, Kafka, and Kubernetes, as well as building pipelines/integrations between internal applications to external applications like Salesforce, Segment, Databricks, AWS, and Kubernetes.
$260,000 a yearInternExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Have previously built real-time and batch data pipelines using tooling such as Airflow, Spark, Kafka, S3, Fivetran, Census, etc. We’re continuing to invest heavily in building the best creator tools with the best team in the creator economy, and are looking for a Software Engineer to support our mission.
Full-timeExpandApply NowActive JobUpdated 24 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The Datastores team is focused on running our platform's mission critical datastores (think ElasticSearch, Kafka, MongoDB, MySQL, etc). As a Principal Site Reliability you will focus on innovating and providing strong technical vision as well as work with the team to build reliable, scalable and highly available datastores on a constantly growing multi-region scale platform.
$314,200 a yearFull-timeExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
What you’ll do: You will have the opportunity to build and elaborate: - Kafka-based stream processing applications - Web applications with a variety of tech (Python/Django, Java, Node.js/React) - API-focused services (GraphQL and REST) - Google Cloud solutions using BigQuery, Composer, Hive, etc.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Principal Engineer is an individual contributor role that requires a proven track record of success and technical depth and maturity as a software developer. As a Principal Engineer in Oracle Cloud Infrastructure, you will have the opportunity solve challenging technical problems and function as a lead developer in the development, delivery and operation of cloud services that will enable animation, film and game development studios to migrate their entire production pipeline to the cloud.
$223,500 a yearFull-timeExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Required Skills & Experience 3+ years of Data Engineering experience Software development background SQL NoSQL Database experience Python AWS (EMR, RDS, Redshift, Kinesis) Hadoop or Spark Desired Skills & Experience Masters degree or higher in Computer Science or related field.
$145,000 - $175,000Full-timeRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Broader knowledge of large dataset processing pipelines and distributed computing architectures (Apache Beam/Airflow, Spark/Hadoop architectures) Solid software engineering skills for prototyping.
Full-timeExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience developing Production systems using Kotlin and Kafka. Optimize key pieces of Grindr's platform using tools like Redis, Postgres, and Kafka on AWS services. 7+ years of experience as a Software Engineer developing critical portions of working on Backend Systems (Service APIs, Data Processing, Messaging Services.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Active user or contributor to one or more infrastructure software such as Snowflake, CockroachDB, Oracle RDBMS, Google BigQuery, Spanner, Redshift, Aurora, Cosmos DB, MySQL, PostgreSQL, Hudi, Delta Lake, Iceberg, Ray, Spark, Flink, Kafka, Redis, ElasticSearch, etc.
Full-timeExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Distributed data processing and analytics systems – e.g. BigQuery, Snowflake, Hadoop, Spark. 2+ years of experience focused on data-intensive data and analytics software products. This role is for a product-minded engineer who thrives in building data-intensive systems.
Full-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in Kubernetes, Helm, operators, Prometheus, Kafka, Elasticsearch, Kong API gateway, etc. Utilize Fluentd, Kafka, and Elasticsearch for logging and analytics, ensuring comprehensive visibility into our systems.
Full-timeExpandApply NowActive JobUpdated 18 days ago
hadoop kafka jobs Title: principal software engineer Company: Panalgo in San Francisco, CA
FEATURED BLOG POSTS
Making the Move to Salary Transparency
The salary transparency trend continues. Last year, Colorado passed its Equal Pay Transparency Rules, which required employers to include compensation in job postings, notify employees about promotional opportunities, and record job descriptions and wage records. Soon after, states like Washington, Nevada, Maryland, and Rhode Island followed suit.
Brand Reputation 101
People's initial perception of your organization is also known as your brand reputation. Your brand rep either encourages or discourages people from engaging with your company. This means the way people view your company will affect sales and even recruiting efforts.
Recruiting in a Tight Market
As a recruiter or employer, you know how much the economy affects your recruitment and retention efforts. You aren't just in competition with companies in your industry, but you are also fighting against inflation, recession, unemployment rates, and so much more.
How to Build a Candidate Persona
A candidate persona is a semi-fictional representation of your ideal candidate. Building a candidate persona is one of the best methods employers use to ensure their sourcing, recruiting, and hiring processes are focused. Knowing exactly what you're looking for streamlines everything and helps increase hiring confidence. So here's how to create a candidate persona and how to use it.
How to Get Into The Trades: Step-by-Step Guide
Getting a trade job can be a great career move if you like variety and prefer to learn on the job instead of in an academic setting. A trade job can offer security and be a lucrative career path as the demand for skilled trade workers continues to grow.
How do Good Interviewers Prepare for Interviews?
Just like candidates take the time to research you and your company, you should take the time to prepare for the interview. Preparing for the interview doesn't just reflect well on your employer brand and create a better candidate experience. Preparation also helps prevent bad hiring decisions. Bad hiring decisions are usually a result of poor execution during the hiring process. However, going into an interview fully prepared and ready to evaluate candidates will help avoid bad hires. So, here are 6 interview preparation tips for employers.
Should I Hire for Potential Over Experience?
The workforce is shifting every day. In fact, research from the World Economic Forum (WEF) shows over half of employees around the world will need to upskill or reskill by 2025. The rapid rise of digital literacy, automation, and new technologies will quickly supersede businesses that don't train ahead of the curve. With the dire need to invest in training, it's evident that hiring someone with experience isn't that much different than hiring someone without it.