- UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake. Databricks Certified Developer or Databricks Certified Data Engineer certification.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Live Table Structured streaming, Kafka, Event Hub, Apache Spark. 2+ years of experience in Apache Spark (PySpark / Spark SQL) Data Engineer (Streaming Platforms.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience solving Big Data batch and real-time data processing problems, with large-scale analytics and data processing engines such as Apache Spark and Databricks. Knowledge of Python data science tools, such as SciKit, Numpy, TensorFlow, Jupyter.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
This implies, among others, writing software in Scala/Java, building data pipelines (Apache Spark, Apache Kafka), integrating with third-party applications, and interacting with cloud APIs (AWS, Azure, CloudFormation, Terraform.
$182,400 - $247,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks. Experience withPython Expertise with Apache Spark (Java, Scala, and/or Python-based.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
They do streaming analytics and they emphasize on Live Table Structured streaming, Kafka, Event Hub, Apache Spark. Role: Data Engineer (Streaming Platforms ) Experience with large scale streaming platforms (e.g. Kafka, Event Hub, Databricks Live Table / Structured Streaming), processing frameworks (e.g. Spark, Databricks) and storage engines - stream analytics.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience scaling production systems running Big Data tools like Spark, Hadoop, Apache Druid, Looker. Experience with at least 3 of the technologies/tools mentioned here: HAProxy, Kafka, Big Data/ Hadoop, Presto, Spark, Airflow, Pinot, Druid, Opensearch, Gcp, Data Proc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Python, Apache Airflow, Apache Spark, PostgreSQL, Presto SQL, Snowflake SQL. Lead Software Engineer, Full Stack (Enterprise Data) Enterprise Data is hiring a Lead Software Engineer.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design and Build Big Data platforms using Hortonworks, Cloudera CDH, Apache Hadoop as a Data Storage and processing systems using Apache Spark and Presto Analytics Engine.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop, and maintain data pipelines using GCP services like Dataflow, Dataproc, and Pub/Sub, in addition to developing and implementing data ingestion and transformation processes using tools like Apache Beam and Apache Spark.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Apache Airflow and Apache Spark; Spark performance turning. Experience with Healthcare data, e.g., clinical trial data, electronic medical records, and insurance claims; or Bioscience’s data, e.g., protein or small molecule data, or bioinformatics; or Biopharmaceutical manufacturing.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark : Develop the de facto open source standard framework for big data. Founded by the original creators of Apache Spark™, Delta Lake and MLflow, Databricks is on a mission to help data teams solve the world's toughest problems.
$192,000 - $260,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Minimum of 5 years of hands-on skills in Python, Apache Spark, Hive, Cassandra, Snowflake, Elastic, Lucene, DataBricks, Hadoop, Redshift, Scala, Java, or other relevant technologies in data engineering.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Below are some example projects:Apache Spark: Develop the de facto open source standard framework for big data.
$192,000 - $260,000 a yearFull-timeExpandApply NowActive JobUpdated Today
apache spark data engineer jobs
FEATURED BLOG POSTS
Why is it so Hard to Get a Job After College
For many, it was easy finding a job while in college. But after job hunting for weeks, you may wonder why it is so hard to get a job after college. After all, you’ve put a lot of time and effort into getting your degree. But don’t get discouraged. The University of Washington found that 53% of graduates are either unemployed or working a job that doesn’t require a degree. Other studies also show that landing your first job can take between 3 and 6 months. So, getting your first job takes time.
Why Leadership Is So Important in Your Career
There are plenty of baseball players worldwide, but only a select few will master the sport enough to play in the World Series. Similarly, you’ll meet hundreds of “managers” throughout your professional career. Still, only a few will cement themselves as true leaders in your mind. This is why leadership is important—the most influential leaders leave a mark. They inspire.
Making the Move to Salary Transparency
The salary transparency trend continues. Last year, Colorado passed its Equal Pay Transparency Rules, which required employers to include compensation in job postings, notify employees about promotional opportunities, and record job descriptions and wage records. Soon after, states like Washington, Nevada, Maryland, and Rhode Island followed suit.
Brand Reputation 101
People's initial perception of your organization is also known as your brand reputation. Your brand rep either encourages or discourages people from engaging with your company. This means the way people view your company will affect sales and even recruiting efforts.
Recruiting in a Tight Market
As a recruiter or employer, you know how much the economy affects your recruitment and retention efforts. You aren't just in competition with companies in your industry, but you are also fighting against inflation, recession, unemployment rates, and so much more.
How to Build a Candidate Persona
A candidate persona is a semi-fictional representation of your ideal candidate. Building a candidate persona is one of the best methods employers use to ensure their sourcing, recruiting, and hiring processes are focused. Knowing exactly what you're looking for streamlines everything and helps increase hiring confidence. So here's how to create a candidate persona and how to use it.
How to Get Into The Trades: Step-by-Step Guide
Getting a trade job can be a great career move if you like variety and prefer to learn on the job instead of in an academic setting. A trade job can offer security and be a lucrative career path as the demand for skilled trade workers continues to grow.