- UpvoteDownvoteShare Job
- Suggest Revision
Design, build and maintain large, complex data processing pipelines using Apache Spark on Databricks in Azure to meet enterprise requirements for reporting and analytics. 3+ years of experience with Azure: ADF, ADLS Gen 2, Azure Synapse, Databricks, Streamsets or equivalent technologies, 3+ years of experience in working with SQL databases, Transaction replication and Change data capture technologies.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with big data technologies such as Apache Spark is a plus. The ideal candidate will have a strong background in data engineering and be proficient in using the ELK (elastic, kibana, logstash) stack and Databricks for data processing and analytics.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide - including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Preferred Skills:- Previous experience as a software engineer, applied mathematician, or in roles involving DevOps, MLOps, Databricks, and Apache Spark is highly regarded. Preferred Skills:- Previous experience as a software engineer, applied mathematician, or in roles involving DevOps, MLOps, Databricks, and Apache Spark is highly regarded.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Minimum of 5 years of hands-on skills in Python, Apache Spark, Hive, Cassandra, Snowflake, Elastic, Lucene, DataBricks, Hadoop, Redshift, Scala, Java, or other relevant technologies in data engineering.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with the Hadoop ecosystem and related tooling (Spark, HDFS, Databricks). Comfort with Apache Airflow. Experience with online game service APIs, particularly Xbox Live, Sony NP, Steam, and Epic Games.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience using Databricks or Apache Spark (i.e., PySpark, SparkR, or Scala) and understanding best practices. Hands-on experience using Databricks or Apache Spark (i.e., PySpark, SparkR, or Scala) and understanding best practices.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience in data engineering, with a strong background in Apache Spark and cloud-based databases such as Snowflake. We are seeking a highly experienced Senior Data Engineer with a deep understanding of PySpark using Databricks or AWS Glue or AWS EMR and cloud-based databases such as Snowflake.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Founded by the original creators of Apache Spark, Delta Lake and MLflow, Databricks is on a mission to help data teams solve the worlds toughest problems. You will be in a customer-facing role, working with and supporting Solution Architects, that requires hands-on production experience with Apache Spark and expertise in other data technologies.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Spectrum Conductor or Databricks with Apache Spark. Strong understanding of core Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBase, Kudu, Sqoop, and Oozie.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expert and Hands-On development in distributed computing environment using Hadoop, Scala, Spark and Apache Airflow. Familiarity with Snowflake or DataBricks a plus. Develop Data Pipelines using Scala and Spark EMR to move data into our consolidated data lake or data warehouse (Snowflake.
$142,800 - $195,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Degree (Masters preferred) in Computer Science, Information Systems, Data Science, or related field and 7+ years of experience in data engineering, or an equivalent combination of education and experience.
$142,800 - $195,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Utilize tools like Airflow for workflow management and Kubernetes for container orchestration to ensure seamless deployment, scaling, and management of data processing applications. Expertise in workflow management tools like Airflow and container orchestration systems such as Kubernetes.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
AWS (Redshift, Aurora, Glue), Google (BigQuery), MongoDB, Cassandra, Snowflake, Teradata, Oracle Exadata, IBM Netezza, SAP (HANA, BW), Apache Hadoop & Spark, MapR, Cloudera/Hortonworks, etc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with distributed computing frameworks, such as Apache Hadoop and Apache Spark. Proficiency in Microsoft Azure cloud services, including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake, etc.
$120,000 a yearExpandApply NowActive JobUpdated Today
databricks apache spark jobs
FEATURED BLOG POSTS
Looking for New Candidates?
Before the turn of the century, recruiters could put their "help wanted" ads in the newspaper, and applications would pour in. Since then, recruiting has turned a new page. The use of the internet and other technologies allows recruiters to broaden their candidate pool for the simple reason being
Decline a Job Offer Professionally: When to Rescind
Your job search has finally paid off! After countless job applications, numerous emails, and several interviews, the hiring manager and other stakeholders have decided that you’re the right person for the job! All you have to do now is accept the offer and walk into the sunset, right?
Resume Job Description Samples - 8 Tips to Follow
When looking for a job, your resume becomes a crucial element. From making a great first impression to showcasing all your achievements and potential, your resume has to portray your professional story in minutes.
Internship Cover Letter Tips with Examples
Until now, college has been about learning, absorbing, and experiencing. It’s not until you become eligible for an internship that things start getting real—real-world experiences using real-life scenarios. Applying for internships takes time, and there’s no college course on “how to apply for jobs.” (We’d sign up immediately if there was, though!) But here's a spoiler alert: most internships require a cover letter. And while this may seem like a burden, it’s actually a blessing.
5 Practical Ways to Remove Bias from your Hiring Process
Many employers think their hiring process is perfect. However, research shows that the hiring processes are generally impartial and unfair, especially if you are part of certain demographics. Women, people of color, people with disabilities, or even people in lower socioeconomic status are more likely to be subject to implicit bias. As diversity and employer branding become major aspects of business, it is important that employers take the lead to identify and remove bias from the hiring process. So, here are 5 practical ways to get you started.
Tips to Get Your First Job Confidently
Whether you’re a recent graduate or you still have a few exams left, you may be itching to put your polished leather shoes on and join the workforce. After all, your first job is an entryway into the professional life you’d lead for the decades to come.
Tips for a Good Character Reference Letter with Examples
Hiring managers love a resume laden with relevant skills and qualifications. Hard skills specific to the role, like SEO strategy or Java programming languages, are easy to qualify using achievements or facts and figures. But how exactly can they verify personality traits, work ethic, relationship management skills, or curious nature during an interview when they barely know you?