- UpvoteDownvoteShare Job
- Suggest Revision
4+ years of Spark experience using Scala/Python for ETL pipelines. Document database designs and ETL processes. Proficiency in AWS services like Kinesis, S3, RedShift, DMS, Athena.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
6 years of experience must include: Apache Spark, Hive, Kafka; Scala, Python; Abinitio, Oracle; Cloud technologies: ORAAS, IBM S3 (Simple Storage Service); Intellij, Eclipse, SQL Developer, Arcadia, Tectia, Tableau, Hue, Jenkins, Sonar; OpenShift, Unravel, Cloudera Manager; and Red Hat Enterprise Linux 8, Tibco.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of Data Engineering practices and tools, such as Spark, Snowflake, ETL concepts, etc. Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
$136,038 - $199,870 a yearFull-timeExpandApply NowActive JobUpdated 16 days ago - UpvoteDownvoteShare Job
- Suggest Revision
DataScience #MachineLearning #ExperimentalDesign #AI #Python #PyTorch #Tensorflow #Algorithms #MLModeling #DataEngineering #DataWrangling #ETL #DataMatching #DeepLearning #LargeLanguageModel #GenerativeAI #InsuranceIndustry #BigData #Hadoop #Spark #CloudComputing #Agile #DataVisualization #Tableau #QlikView #D3js.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Skills: Python, FastAPI, Django, SQL, CI/CD, Azure DevOps, GitLab, Travis, Jenkins, Data Analysis, Data Science, AI, (py)Spark, ELT/ETL Frameworks, Web Scraping, Crowdsourcing, Databricks, Optimizing Spark Clusters, PowerBI, Tableau.
Full-timeExpandApply NowActive JobUpdated 19 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with two or more of the following areas including Oracle 11g, Oracle Exadata, traditional data marts, Hadoop, Data bricks, Snowflake, Data Stage, ETL, Tableau, QlikView, AI/ML techniques, Core Java, Impala, Hive etc.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong knowledge of leading data platforms such as Azure Data Fabric, Apache Spark, Kafka, Databricks, etc. Design and implement modern solutions for data processing, storage and analysis, including real-time streaming, batch ETL, data lake, data warehouse, lakehouse, mesh, etc.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The ideal candidate will have extensive experience with AWS Glue, Spark, Python, and Snowflake, with a strong background in data engineering, ETL processes, and data warehousing. TITLE: Data Engineer - AWS Glue, Spark, Python, Snowflake.
$130,000 - $165,000 a yearExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You’ve built and maintained an ETL pipeline using a data warehouse like BigQuery or Redshift. Experience working with streaming and batch data processing tools like Apache Beam, Spark, Flink, etc.
RemoteExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
NET, API Management, ETL tools (e.g. Informatica, Azure Data Framework, Databricks), Spark (Scala/Python), CSS, HTML5, AngularJS, Maven, Java Spring, designing and implementation of SQL and NoSQL databases.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience building enterprise scale data pipelines on Cloud Data Platforms using Spark and Databricks for ETL/ELT, data products, or Machine Learning; Azure preferred. Experience building enterprise scale data pipelines on Cloud Data Platforms using Spark and Databricks for ETL/ELT, data products, or Machine Learning; Azure preferred.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Own all things data - including our ETL processes, reporting APIs, and internal dashboards. We are looking for a Data Engineer to join our machine learning and data science team. Familiarity with AWS or Google Cloud big data products.
RemoteExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with Kafka, Flink, Spark frameworks with validated understanding of at least one job scheduling tool: Airflow, Celery, AWS Step functions. We use many open source technologies, including: Spark, Flink, Hudi, Airflow.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We’d love to see that you’ve worked with big data systems (Spark, Kafka, Flink, S3, AirFlow) Have experience with ETL pipelines, both streaming and batch. We’d love to see that you’ve worked with big data systems (Spark, Kafka, Flink, S3, AirFlow.
ExpandApply NowActive JobUpdated 11 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data technologies such as Hadoop, Spark, Kafka, etc. Experience in data architecture, data quality, metadata management, ETL, analytics, reporting, and database administration.
ExpandApply NowActive JobUpdated 6 days ago
spark etl jobs in Fort Lee, NJ
FEATURED BLOG POSTS
How to Get Into The Trades: Step-by-Step Guide
Getting a trade job can be a great career move if you like variety and prefer to learn on the job instead of in an academic setting. A trade job can offer security and be a lucrative career path as the demand for skilled trade workers continues to grow.
How do Good Interviewers Prepare for Interviews?
Just like candidates take the time to research you and your company, you should take the time to prepare for the interview. Preparing for the interview doesn't just reflect well on your employer brand and create a better candidate experience. Preparation also helps prevent bad hiring decisions. Bad hiring decisions are usually a result of poor execution during the hiring process. However, going into an interview fully prepared and ready to evaluate candidates will help avoid bad hires. So, here are 6 interview preparation tips for employers.
Should I Hire for Potential Over Experience?
The workforce is shifting every day. In fact, research from the World Economic Forum (WEF) shows over half of employees around the world will need to upskill or reskill by 2025. The rapid rise of digital literacy, automation, and new technologies will quickly supersede businesses that don't train ahead of the curve. With the dire need to invest in training, it's evident that hiring someone with experience isn't that much different than hiring someone without it.
How to Respond to a Recruiter Through Email? (Tips & Examples)
Rather than wading through an endless list of open roles, wouldn’t it be nice if relevant job opportunities come to you?
How to Reject a Candidate Professionally
When deciding on how to reject a candidate, your first question may be
How Does Salary Pay Work? (Compared to Hourly Pay)
At the bottom of each job advertisement, companies label a role as salaried or hourly. Both methods will get you paid (yay), but each in very different ways. So, it's essential to figure out how does salary pay work? While employees paid by the hour are paid based on how long they work, employers pay salaried employees a fixed amount.
The Quiet Quitting Phenomenon
The term, quiet quitting, was coined in 2009, but only now is it gaining traction as young Millennials and Gen Z workers are experiencing record levels of burnout. With the pandemic and the state of the economy, young employees are feeling the pressure. So, quiet quitting comes into effect when that pressure is exasperated by work stress and no managerial support.