- UpvoteDownvoteShare Job
- Suggest Revision
Minimum 3 years of experience in building and managing high-performing teams in a remote setup, with a focus on operating large-scale data pipelines leveraging technologies such as Scala, Spark, ML, Protocol Buffers, Kafka, Airflow and Elasticsearch.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on and implementation centric DataOps expertise across several Azure tools and servicesProven experience as a data engineer or similar role, with a focus on cloud-based data engineering and ETL processes.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in data pipeline technologies such as Apache Kafka, Apache NiFi, Apache Airflow, or similar. 5+ years of experience in data engineering, with a focus on designing, building, and optimizing data pipeline solutions.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data movement (real-time replication or ETL/ELT), multiple clouds (AWS, Azure Google, Alibaba), cloud analytics destinations (Snowflake, Databricks, Kafka, RDS, Synapse, BigQuery, etc.
$160,000 - $200,000 a yearFull-timeExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with streaming architectures, in particular Kafka. As a Lead Software Engineer on this team, you will be helping to address our two main challenges: keeping up with the ever-increasing amount of data gathered by our agents, and making this information more actionable for our customers.
Full-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Our Datalake team plays a crucial role in streaming, accessing, and securely sharing vast amounts of data with both internal and external stakeholders through Kafka and Snowflake. We are seeking an experienced and dynamic Engineering Manager to lead our Datalake Team. The ideal candidate will be a strategic thinker with a strong technical background, capable of overseeing the development and optimization of our data warehouse and related products.
$225,000 - $250,000 a yearFull-timeExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Learn about Big Data architecture via technologies such as AWS, DataBricks and Kafka. Report to the Engineering Manager of Banking - Data Engineering. Stay up to date with emerging technologies, best practices, and industry trends in data engineering and software development.
ExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with some data technologies like DuckDB, Parquet, Delta Lake, Iceberg, Spark, Kafka, BigQuery, dbt, FiveTran, Tableau, Superset, Looker, Power BI, Airflow, Dagster, ClickHouse, Snowflake, Databricks, Google BigQuery, Redshift, Prefect, Jupyter notebooks, etc.
ExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Work closely with other data engineering teams to integrate schema registry and establish data lineage for all data domains. 2+ years of experience with data streaming technologies like Spark (AWS Glue), Flink, Storm, Kinesis, and/or Kafka.
ExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data platform: Hadoop, Hbase, OpenSearch, Kafka, Spark, Flink, Go, Java, SQL, Databricks, Snowflake, BigQuery. The Data Platform team is responsible for ingestion of tens of thousands of events per second, data Lakehousing (Databricks), OLTP stores (Hbase, OpenSearch) and APIs. The customers of the Data Platform are the internal business units who use it for data engineering, AI/ML, and Business Intelligence.
$145,000 - $190,000 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience designing and building highly available, distributed systems of data extraction, ingestion, normalization and processing of large data sets in real time as well as batch, that will be used across engineering teams using orchestration frameworks like Airflow, KubeFlow or other pipeline tools.
ExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data Processing - experience with building and maintaining large-scale and/or real-time complex data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper. is required by a respected and well-funded start-up in San Francisco in the cloud data security space to work in product engineering and deliver a massive scale platform reliably, securely.
ExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
10+ years of experience in data engineering on distributed frameworks such as Spark, Databricks, Kafka Streams, Hadoop etc. Develop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Lambda, Kafka, Airflow, Redshift, S3, Glue, and EMR.
$226,000 - $361,000 a yearFull-timeExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience developing and operating large-scale data pipelines demonstrating knowledge with technologies, such as Airflow, Luigi, Spark, Kafka, ElasticSearch, Cassandra, RDBMS and SQL. An advanced degree in computer science, data science, machine learning, artificial intelligence, operations research, engineering, or related quantitative discipline.
ExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Leverage big data technologies like Apache Presto, Apache Pinot, Flink, and Airflow. Develop high-quality software with attention to detail using tech stacks like Python, React, MongoDB, Snowflake and Kafka.
ExpandApply NowActive JobUpdated 5 days ago
data engineering kafka jobs in San Francisco, CA
FEATURED BLOG POSTS
How to Re-apply for Your Old Job Professionally
Have you recently started a new job only to find that you miss your old one? Maybe you didn’t realize how good you had it, and now you regret leaving. Don’t worry. You’re not the first person to feel this way, and you might even be able to return to your old job if you play your cards right.
Looking for New Candidates?
Before the turn of the century, recruiters could put their "help wanted" ads in the newspaper, and applications would pour in. Since then, recruiting has turned a new page. The use of the internet and other technologies allows recruiters to broaden their candidate pool for the simple reason being
Decline a Job Offer Professionally: When to Rescind
Your job search has finally paid off! After countless job applications, numerous emails, and several interviews, the hiring manager and other stakeholders have decided that you’re the right person for the job! All you have to do now is accept the offer and walk into the sunset, right?
Resume Job Description Samples - 8 Tips to Follow
When looking for a job, your resume becomes a crucial element. From making a great first impression to showcasing all your achievements and potential, your resume has to portray your professional story in minutes.
Internship Cover Letter Tips with Examples
Until now, college has been about learning, absorbing, and experiencing. It’s not until you become eligible for an internship that things start getting real—real-world experiences using real-life scenarios. Applying for internships takes time, and there’s no college course on “how to apply for jobs.” (We’d sign up immediately if there was, though!) But here's a spoiler alert: most internships require a cover letter. And while this may seem like a burden, it’s actually a blessing.
5 Practical Ways to Remove Bias from your Hiring Process
Many employers think their hiring process is perfect. However, research shows that the hiring processes are generally impartial and unfair, especially if you are part of certain demographics. Women, people of color, people with disabilities, or even people in lower socioeconomic status are more likely to be subject to implicit bias. As diversity and employer branding become major aspects of business, it is important that employers take the lead to identify and remove bias from the hiring process. So, here are 5 practical ways to get you started.
Tips to Get Your First Job Confidently
Whether you’re a recent graduate or you still have a few exams left, you may be itching to put your polished leather shoes on and join the workforce. After all, your first job is an entryway into the professional life you’d lead for the decades to come.