- UpvoteDownvoteShare Job
- Suggest Revision
Experience with cloud data processing and analytics services such as AWS Glue, Google Dataflow, Apache Spark on cloud platforms, or Azure Data Lake Analytics. Implement data processing and transformation workflows using cloud-native services such as AWS Glue, Google Dataflow, or Azure Data Factory.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scale (Kafka, S3, databases/CDC.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
As an IC and team lead, build and maintain data pipelines using Google BigQuery, Dataflow, and other distributed processing tools. The Staff Data Engineer, Data Science will work directly with Data Scientists, Autonomous Vehicle (AV) engineers, Product Managers and leadership to develop data pipelines that extract key insights from our massive real-world and simulation data.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data storage and processing using technologies like Redshift, S3, AWS Glue, Lake Formation, dbt, Airbyte, Fivetran, Spark, Athena, Kafka, Trino, Snowflake, Databricks, GraphQL.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Background in Data Engineering, 5+ years of experience building and maintaining scalable data infrastructure, including distributed processing solutions (e.g. Spark), cloud-based data lakes and warehouses (e.g. Databricks, Snowflake, BigQuery), workflow management (e.g. Airflow, Luigi), and data transformation tools (e.g. DBT.
$159,400 - $210,900 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
We are searching for a person with a Data Processing or Data Engineering profile, willing to work with live client datasets, and to test, benchmark, and showcase our brand-new stream data processing technology.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You will work with great technologies such as Snowflake, Airflow, and dbt to enable the efficient processing and analysis of large volumes of data. Experience with streaming data processing frameworks (e.g., Apache Kafka, Apache Flink.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Have hands-on experience with event-driven architecture and streaming data processing frameworks like Kafka, Spark, Flink. Build data pipelines for ingesting, processing, and routing events using Kafka, Spark streaming and other technologies.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong programming skills in languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Flink. Data Processing Frameworks: Lead the implementation and optimization of data processing frameworks and technologies, such as Apache Hadoop, Apache Spark, and Apache Flink, to enable efficient data processing and analysis.
$200,000 - $300,000 a yearFull-timeExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Develop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Lambda, Kafka, Databricks, Airflow, Redshift, S3, Glue, and EMR. Strong experience in writing complex SQL and ETL development with experience processing large data sets.
$147,000 - $235,000 a yearFull-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You have experience of running data processing pipelines in production using distributed data processing frameworks like Apache Spark or Flink. Experienced in working within diverse teams of engineers, data scientists, and analysts to implement and maintain high-performance data-processing and data integration systems on top of data lake architecture.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of cloud services (GCP BigQuery, dbt) and understanding of how to leverage them for data processing and storage solutions. Proficiency in big data technologies and frameworks such as DBT, Airflow, etc., to handle large-scale data processing and analysis.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with modern data storage and processing technologies (i.e. BigQuery SQL, Airflow, and DBT or similar) Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
ExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Develop and automate large-scale, high-performance distributed data processing systems (batch/ streaming) to drive Airwallex business growth and improve the product experience. Whether your strength is in data modeling or data processing, we want to talk to you.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with cloud-based data storage and processing solutions (AWS, GCP, Azure, etc.) Optimize data processing and storage solutions to improve performance and reduce costs.
ExpandApply NowActive JobUpdated 8 days ago
data processing jobs Title: data engineer in San Francisco, CA
FEATURED BLOG POSTS
Why Are Internships Important & How Can You Get One?
Internships are for college students or people who have just completed their degree. If you are a student or recent grad, you may be wondering how to land an internship. If you've never had one, you may even wonder if you need one. After all, didn’t you work in that call center while also doing exams? Or perhaps you’ve bartended your first year in college?
Why is Networking Important & How to Network Effectively
Even if you’ve worked hard to earn a degree from an impressive school, landing your dream job might still come down to who you know – otherwise known as networking. Lots of qualified candidates might apply for a job, but the person who gets it might very well be so-and-so’s sibling, friend, or kid. Sometimes the only way to get your foot in the door is to know someone.
Why Do Recruiters Ghost and What Can You Do About It?
Once you’ve finally mustered up the courage to find another job, leaning into the job hunt can feel scary and overwhelming. So, it does nothing to help your confidence when your outbox is full of unanswered follow-ups and interview requests. You thought that ghosting only happens on dating apps—so why do recruiters ghost, too? Recruiter ghosting is not an effective recruiting strategy, but sometimes it’s inevitable. How can you overcome such an unfortunate new career trend? Read on.
Internal Hiring Best Practices
Each companies hiring strategy is based on a set of rules that defines the ideal candidate. Many companies utilize internal and external hiring to ensure they have skilled, experienced workers. If you work in recruiting, maximizing your internal hiring strategies could be the key to retaining employees and simplifying your hiring process.
Why is it so Hard to Get a Job After College
For many, it was easy finding a job while in college. But after job hunting for weeks, you may wonder why it is so hard to get a job after college. After all, you’ve put a lot of time and effort into getting your degree. But don’t get discouraged. The University of Washington found that 53% of graduates are either unemployed or working a job that doesn’t require a degree. Other studies also show that landing your first job can take between 3 and 6 months. So, getting your first job takes time.
Why Leadership Is So Important in Your Career
There are plenty of baseball players worldwide, but only a select few will master the sport enough to play in the World Series. Similarly, you’ll meet hundreds of “managers” throughout your professional career. Still, only a few will cement themselves as true leaders in your mind. This is why leadership is important—the most influential leaders leave a mark. They inspire.
Making the Move to Salary Transparency
The salary transparency trend continues. Last year, Colorado passed its Equal Pay Transparency Rules, which required employers to include compensation in job postings, notify employees about promotional opportunities, and record job descriptions and wage records. Soon after, states like Washington, Nevada, Maryland, and Rhode Island followed suit.