- UpvoteDownvoteShare Job
- Suggest Revision
6 years of experience must include: Apache Spark, Hive, Kafka; Scala, Python; Abinitio, Oracle; Cloud technologies: ORAAS, IBM S3 (Simple Storage Service); Intellij, Eclipse, SQL Developer, Arcadia, Tectia, Tableau, Hue, Jenkins, Sonar; OpenShift, Unravel, Cloudera Manager; and Red Hat Enterprise Linux 8, Tibco.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data. 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
$120 - $130 a yearFull-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge, Skills and Experience Google Cloud Platform (GCP) or AWS Scala, sbt, cats Airflow, Kubernetes Google Dataflow/Beam or Spark, SQL, BigQuery or similar data warehouse Key Responsibilities Serve as a Senior member of the team by contributing to the architecture, design, and implementation of EMS systems Mentor junior engineers and enable their growth Lead and drive technical projects.
Full-timeRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience in data engineering with Databricks and Spark. We are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark.
Full-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
What makes you stand out: Strong understanding of entity resolution, streaming technologies, and ELT/ETL frameworksExperience with web scraping and crowdsourcing technologiesExperience with Databricks and optimizing Spark clusters.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience in developing scalable data pipeline using technologies like Kafka, Databricks, Spark and Scala applying ETL and ELT concepts. Experience in implementing data lake systems using cloud native technologies such as S3, Redshift, EMR, Hive, Presto, Spark.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL). Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.
Full-timeExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Lead Software Engineer Backend (Python, SQL, ETL, Spark, AWS) Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.
InternExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI.
InternExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Good knowledge of database management and SQL, Informatica, Hadoop/Spark, and ETL tools. Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
$150,000 - $180,000 a yearFull-timeExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
3+ years of experience with the Distributed data/similar ecosystem (Spark, Hive, Druid, Presto) and streaming technologies such as Kafka/Flink. 3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP.
$170,600 - $255,800 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Should be an expert in ETL/Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and real-time data integration. Hands-on experience on major components of the Hadoop ecosystem such as Spark, HDFS, Hive, Sqoop, Kafka, and Streaming is a must.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Ability to understand data models and identify ETL optimization opportunities. Exposure to ETL tools is mandate. Knowledge of modern cloud native data warehouses i.e., AWS Redshift, Snowflake or Azure Synapse Analytics.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Pure Big Data sr developers on AWS Cloud : design build pipelines ( batch & streaming) in Apache Spark, AWS Glue, EMR , Kafka, Airflow etc. These resources will develop the pipeline based on the reverse engineering information provided by the Sr ETL developer.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master’s degree in Computer Science or related field and 3 years' experience in software engineeringPrimary Location.
Full-timeExpandApply NowActive JobUpdated Today
spark etl jobs in Weehawken, NJ
FEATURED BLOG POSTS
To ATS or not to ATS
As hiring is becoming more analytical and data-driven, companies have found ways to incorporate technology to help hire and recruit more efficiently. ATS, also known as an applicant tracking system, has become one of the most widely adopted technological recruiting tools to date. In fact, according to data from Capterra:
6 Best Ways to End a Cover Letter with Examples
Including a cover letter with your resume is a great way to introduce yourself to the hiring manager, tell them why you’re the ideal fit for the role, and provide context about your personal situation. A strong cover letter will give you an advantage over other applicants. But it’s important that you structure it properly and write it powerfully so that it carries an impact. This article will discuss how to end a cover letter effectively so you catch the eye of a hiring manager and increase your odds of landing an interview. Read on to learn more.
How to Write a Follow-Up Email for a Job Application?
Most times, we have to do more than submit a "sugar-coated" resume to land our dream jobs. Going the extra mile to follow up on your job application can increase your chances of employment. Additionally, it may even help you get confirmation sooner on whether you are seriously being considered for the job or not.
How to Hire Remote Workers
Remote work used to be a thing of the future. However, with social, economic, and cultural events taking place across the country, it has now evolved into something that both job searchers AND companies are benefiting from. Remote work is multifaceted and can come in handy in a variety of situations. So, to help your small business take advantage of all of remote work's benefits, here is a short guide on how to hire remote workers.
How to Address a Cover Letter With Examples
It’s easy to get caught up in focusing on your resume – how it looks, what it says, and whether it’s going to land you a job interview. Because there is a big focus on building the perfect resume, job searchers often overlook the importance of a high-quality cover letter. Your cover letter plays a huge role in your first impression. It humanizes you and provides context for your resume.
How to Call Out of Work
No matter how happy we are with our jobs, there are days when we feel overwhelmed and want to call out of work. No, don't feel guilty. It's expected because we're humans, and we can't control the uncertainties of life. But the problem lies in how to call out of work without seeming uncommitted to work, especially if you seldom get work-free days.
What is Seasonal Employment?
Depending on where you are in your career, you might have first-hand experience with seasonal employment. Seasonal employment can be a great way to expand your skill set and earn extra cash while helping businesses meet seasonal increases in demand.