- UpvoteDownvoteShare Job
- Suggest Revision
Tech stack experience - Our tech stack includes Typescript/Javascript on the frontend, Golang in the backend, a job queuing system with Kafka, PostgreSQL as our database and cloud hosting with GCP. Experience with Golang and GCP is a bonus.
$250,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Open Source Frameworks - Spring boot, Spring CoreMessaging frameworks such as Kafka, Tibco EMS or JMSOracle PL/SQL JavaScript and scripting frameworks (JQuery, AngularJS)Hands-on experience in test automation at various levels of testing (unit, component, integration and functional tests.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Technical Proficiency: Expertise in web and data technologies such as Kafka, HDFS, Spark, EMR, Open Table Formats, Snowflake, Hive, HBase, Scylla, Django, and FastAPI. The Principal Architect will lead the development and maintenance of the architectural vision for the company's software systems, providing technical oversight and strategic insight into their evolution.
$350,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with: Hadoop, Spark, Kafka, Scala, Python, R etc. Expertise in standard software engineering methodology, e.g. unit testing, test automation, continuous integration, code reviews, design documentation.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Kafka and streaming data processing. Principal Software Engineer- Java/Cloud (Remote-USA) Principal Software Engineer Your opportunity. Hands-on experience with Kafka, Flink, Spark, or Pulsar.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of distributed computing technologies such as Apache Spark, Hadoop, or Dask, and experience with containerization and orchestration technologies such as Docker and Kubernetes. Working closely with cross-functional teams of data scientists, software engineers, and DevOps specialists, you'll ensure the reliability, scalability, and efficiency of our machine learning systems.
$230,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Preferred qualificationsHave experience in Java, Scala (Spark), or RubyExperiences with big-data technologies such as Spark, Presto, Kafka, and Flink, and OLAP preferredNote that It’s not expected that any single candidate would have expertise across all of these areas.
$269,200Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Extensive experience with Kafka, Spark, Redis, Flink, Trino/Presto, Hadoop in complex on-premise and hybrid data environments. Technical Leadership: Leverage your deep expertise in data technologies such as Kafka, Spark, Redis, Flink, Trino/Presto, and Hadoop to lead the architecture and development of our data systems, ensuring optimal performance, reliability, and scalability.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop, and own robust, scalable data processing and data integration pipelines using Python, dbt, Kafka, Airflow, PySpark, SparkSQL, and REST API endpoints to ingest data from various external data sources to Data Lake. Develop testing frameworks and monitoring to improve data quality, observability, pipeline reliability, and performance Orchestrate sophisticated data flow patterns across a variety of disparate tooling.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Must have: Strong knowledge of Spark, Hadoop, or Cloudera. Strong software engineering best practices with git and version control systems. Knowledge of one of the major business intelligence vendors, such as Tableau, Power BI, Quick Sight, Qlik, Sisense, Domo, or Looker.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Required Skills & Experience 3+ years of Data Engineering experience Software development background SQL NoSQL Database experience Python AWS (EMR, RDS, Redshift, Kinesis) Hadoop or Spark Desired Skills & Experience Masters degree or higher in Computer Science or related field.
$145,000 - $175,000Full-timeRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Insightful experience with big data technologies like Hadoop, real-time processing frameworks (e.g., Apache Spark), and advanced knowledge of SQL and data architecture. Hands-on experience working with technologies like Spark for data processing, ETLs for data pipelines and queueing systems (Kafka, RabbitMQ.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience building multi-tenant, virtualized infrastructure and/or working on open source software/contributions to open source Redis/memcached/Cassandra/PSQL a strong plus. Build enhancements, new components, new services, within an existing software architecture and suggest improvements to the architecture, operational practices, scalability, resiliency.
$223,500ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with deploying models to production and building ML pipelines (Docker, CI/CD/CT) Experience with Time Series and NLP problems Solid Knowledge of Supervised and Unsupervised Machine Learning Models Knowledge of Feature Engineering, Data Wrangling/Cleaning Knowledge of Jupyter notebooks and big data environments/training (Spark, Hadoop, etc.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data technologies such as Hadoop, Spark, or Kafka. Job Title: AI Software Engineer (Mid-Level) Location: San Francisco, CA Required Clearance : Secret Salary: Competitive We are seeking a talented and motivated Mid-Level AI Software Engineer to join our AI team.
ExpandApply NowActive JobUpdated Today
hadoop kafka jobs Title: principal software Company: Panalgo in San Francisco, CA
FEATURED BLOG POSTS
How to Conduct a Performance Review (With Examples)
In a world where the smallest mistake can cost your business tens of thousands in lost revenue, your talent is key to keeping your edge on the market and driving growth. However, managing a workforce of any size can be a challenge. Employees come with their own particular skill set, ambitions and flaws. So, it can be difficult to uncover their individual drivers. Not to mention the challenges brought on by the hybrid and remote working models where in-person interactions have become few and far between.
How to Recruit Passive Candidates
Learning to recruit passive candidates is a different ballgame than recruiting active ones. While an active candidate is someone who is currently looking for a new job, a passive candidate tends to be the opposite. Passive candidates are either already working or not looking to work. So, instead of these candidates coming to you, you'll have to find them and reach out to them first.
How to Effectively Recruit Employees
Today, hiring and retaining talent looks much different than it did only two or three years ago. Financial instability and the strain on our mental health brought on by the pandemic has made everyone more wary and selective of their workplace and employer. Whereas in the past people might have prioritized promotions and financial reward, today they look at other factors such as workplace flexibility, personal fulfillment and values alignment.
How Many Hours is Part-Time vs. Full-Time Work?
Growing up you watched your parents shuffle to and from the office, held hostage to their 9 to 5. If jammed-packed schedules and deadlines sound frightening, you might consider pivoting your search to part-time jobs. In fact, even employers have shifted their preference, selecting more people open to the idea of flexible working hours.
How to Make a Job Offer More Competitive
Money alone makes it hard to attract and retain top-notch candidates, especially when you are competing with larger businesses and corporations in your industry. So, instead of focusing on money, figure out how to make a job offer more competitive when you can't offer more money.
5 Ways to Stretch Your Hiring Budget
Many businesses across the country have adjusted business operations to make it through the pandemic. After a period of hardship, many business owners, like yourself, are ready to start recruiting and rebuilding a bigger, more skilled workforce - only now you have to do it with a smaller hiring budget.
How to Ask for a Raise at Work
Here we go again; it’s time to talk money. Whether you’re one year in at a new company or approaching year five on the same team, learning how to ask for a raise should be part of your long-term career plan. These conversations are rarely fun (thanks to society, which has conditioned us to believe that money is taboo), but they are necessary if you want to, well, get paid what you’re worth. Trust us, there’s a lot of money on the table for taking. Below, we’ll discuss tips on timing, approach, and follow-up.