- UpvoteDownvoteShare Job
- Suggest Revision
Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Google Cloud DataFlow, Azure Data Factory, Spark, Spark Streaming, etc.
$99,000 - $148,000 a yearFull-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of big data platforms such as Apache Spark, Hadoop, Apache Fink or AWS engineering. Strong understanding of data lake architecture, data modeling, ETL processes, data governance, and data analytics in a banking environment.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in Snowflake data modeling, ELT using snowpipe, implementing stored procedures and standard DWH and ETL concepts. Expertise in designing ETL frameworks with several years of hands on experience in implementing several aspects of data pipelines including ingestion, transformation, data quality checks, monitoring, alerts, notifications etc.
Full-timeExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Senior Software Engineer Backend (Python, SQL, ETL, Spark, AWS) Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.
ExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience running heavy workloads on a distributed computing cluster (especially EMR or Databricks), leveraging technologies like Spark to work with large datasets preferred. Explore data from various sources within TTD and prototype ETL pipelines to collect them for model training.
Full-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with cloud and big data technologies to extract and analyze data (Snowflake, S3, Redshift, Athena, Hive, BigQuery, Spark, etc). Experience building ETL pipelines (e.g. Airflow, DBT) and productionalizing models a strong plus.
$135,100 - $196,100 a yearExpandApply NowActive JobUpdated 10 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data. 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
ExpandApply NowActive JobUpdated 10 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The team uses a variety of tools, technologies, and languages to build software like Delta Lake, Hadoop, Kinetica, Solr, Spark, Kafka, Python, Java, Ruby, Scala, Airflow, Luigi, EMR, Databricks, etc.
ExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Day to day you’ll be building modeling data to feed analytical reports and data science models, optimizing and creating new ETL pipelines, or building data models in Looker or Qlik Sense. Familiarity with additional transformation platforms like Apache Spark and Beam.
Full-timeExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with data engineering concepts and technologies (e.g., ETL, Data Pipeline, Spark, Flink) Experience with ETL tools or data integration platforms is a plus (e.g., Databricks.
ExpandUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
6 years of experience must include: Apache Spark, Hive, Kafka; Scala, Python; Abinitio, Oracle; Cloud technologies: ORAAS, IBM S3 (Simple Storage Service); Intellij, Eclipse, SQL Developer, Arcadia, Tectia, Tableau, Hue, Jenkins, Sonar; OpenShift, Unravel, Cloudera Manager; and Red Hat Enterprise Linux 8, Tibco.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with Kafka, Flink, Spark frameworks with validated understanding of at least one job scheduling tool: Airflow, Celery, AWS Step functions. We use many open source technologies, including: Spark, Flink, Hudi, Airflow.
ExpandApply NowActive JobUpdated 12 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience and deep understanding of DA technology stack (e.g. Business Intelligence, Predictive Analytics, Hadoop/Spark Data lakes, Columnar Data Warehouses, Data Streaming, ETL and Data governance.
Full-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
NET, API Management, ETL tools (e.g. Informatica, Azure Data Framework, Databricks), Spark (Scala/Python), CSS, HTML5, AngularJS, Maven, Java Spring, designing and implementation of SQL and NoSQL databases.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You’ve built and maintained an ETL pipeline using a data warehouse like BigQuery or Redshift. Experience working with streaming and batch data processing tools like Apache Beam, Spark, Flink, etc.
RemoteExpandApply NowActive JobUpdated 12 days ago
spark etl jobs in Fort Lee, NJ
FEATURED BLOG POSTS
How Long Do Background Checks Take for Pre-Employment
Many jobs require a background check. For some companies, this is a matter of company policy. In other jobs, such as finance, childcare, and security, the government often requires background checks. While there are varying levels of intensity, for most people, a background check is nothing to worry about. In fact, the biggest question is often how long does a background check take? Here’s what job seekers and applicants need to know about background checks before they apply to new jobs.
The Best Remote Jobs: Where & How to Find Them
The Covid-19 pandemic hasn’t been easy on any of us, but if there’s one silver lining, it’s the fact that remote work has grown in popularity because of it. Companies that previously weren’t open to their employees working remotely were suddenly forced into allowing it. Since then, they've realized that much of their workforce is happier and more productive. Naturally, this has led to more remote job openings, which is great if you’re interested in this type of position. Read on to learn more about the best remote jobs and where to find them.
In-House vs Outsourcing Recruiting: Which is Better?
When looking at in-house vs outsourcing recruiting, it is important to nail down the benefits for each and whether those benefits outweigh the risks that follow.
How to Write a Short Bio
First impressions can be tricky. When meeting someone in person, it’s likely you have an elevator speech. These short, practiced introductions can help you share more about who you are, what you do for work and other facts about you. While this works well in a live, in-person context, there are many cases where professionals “meet” someone via written form - like social media, a resume, or published work. In these cases, your bio works as your first impression. So, here’s a step-by-step guide on how to write a short bio.
How to Conduct a Performance Review (With Examples)
In a world where the smallest mistake can cost your business tens of thousands in lost revenue, your talent is key to keeping your edge on the market and driving growth. However, managing a workforce of any size can be a challenge. Employees come with their own particular skill set, ambitions and flaws. So, it can be difficult to uncover their individual drivers. Not to mention the challenges brought on by the hybrid and remote working models where in-person interactions have become few and far between.
How to Effectively Recruit Employees
Today, hiring and retaining talent looks much different than it did only two or three years ago. Financial instability and the strain on our mental health brought on by the pandemic has made everyone more wary and selective of their workplace and employer. Whereas in the past people might have prioritized promotions and financial reward, today they look at other factors such as workplace flexibility, personal fulfillment and values alignment.
How Many Hours is Part-Time vs. Full-Time Work?
Growing up you watched your parents shuffle to and from the office, held hostage to their 9 to 5. If jammed-packed schedules and deadlines sound frightening, you might consider pivoting your search to part-time jobs. In fact, even employers have shifted their preference, selecting more people open to the idea of flexible working hours.