- UpvoteDownvoteShare Job
- Suggest Revision
3+ years of Spark experience using Scala/Python for ETL pipelines. Document database designs and ETL processes. Proficiency in AWS services like Kinesis, S3, RedShift, DMS, Athena.
$140,000 - $170,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Understanding of ETL, data warehousing, and advanced data modeling tools (e.g., R, Python, SAS, Spark, AWS) Understanding of ETL, data warehousing, and advanced data modeling tools (e.g., R, Python, SAS, Spark, AWS.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in leveraging SQL, programming language like Python and ETL tools like Databricks. Must Have Technical/Functional Skills Apache Spark, Scala/ Python and PySpark. Expertise in leveraging SQL, programming language like Python and ETL tools like Databricks.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on practical experience in developing spark based Frameworks for end to end ETL, ELT & reporting solutions using key components like Spark SQL & Spark Streaming, React and BI tools.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong experience in big data technologies like AWS EMR, AWS EKS, Apache Spark. Design ETL jobs for optimal execution in AWS cloud environment. We are looking for big data developers for ETL project in our enterprise Transparency Services group.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Based out of US Some experience in insurance domain/ data is must Programming Languages - SQL, Python Technologies - laas (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure Devops.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Senior Software Engineer Backend (Python, SQL, ETL, Spark, AWS) Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.
InternExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Design and develop ETL pipeline for collecting, validating and transforming data according to the specification. Reduce processing time and cost of ETL workloads. 5+ years of experience in ETL projects.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Should be an expert in ETL/Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and real-time data integration. Hands-on experience on major components of the Hadoop ecosystem such as Spark, HDFS, Hive, Sqoop, Kafka, and Streaming is a must.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We were the first team to introduce Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess and Spark for ETL, at Bloomberg for designing this new data intensive platform that is the hub of financial datasets.
$160,000 - $240,000 a yearFull-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong knowledge of Apache Spark and Databricks architecture. Collaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, ETL processes, and analytical pipelines on the Databricks platform.
$120,000 - $140,000 a yearFull-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL). Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Must have in-depth and strong technical knowledge on Hive, Spark, Kafka, Streaming, SQL, Hadoop platform, and Python. Should be Expert in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server, and GitHub.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
1 years of Spark experience(Spark Streaming is a plus) – building out ETL pipelines, strong understanding of complex SQL. familiarity with AWS cloud services: EC2, EMR, RDS, Redshift, Lambda, Kinesis.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in data engineering technologies and tools, such as SQL, Python, ETL frameworks, data integration platforms, and data warehousing solutions. Familiarity with big data technologies (e.g., Hadoop, Spark) and cloud platforms - AWS, Azure.
Full-timeExpandApply NowActive JobUpdated 25 days ago
spark etl jobs in Rutherford, NJ
FEATURED BLOG POSTS
How to Call Out of Work
No matter how happy we are with our jobs, there are days when we feel overwhelmed and want to call out of work. No, don't feel guilty. It's expected because we're humans, and we can't control the uncertainties of life. But the problem lies in how to call out of work without seeming uncommitted to work, especially if you seldom get work-free days.
What is Seasonal Employment?
Depending on where you are in your career, you might have first-hand experience with seasonal employment. Seasonal employment can be a great way to expand your skill set and earn extra cash while helping businesses meet seasonal increases in demand.
How to Avoid a Bad Hire
"A new employee who doesn't meet the minimum performance, quality, and culture fit standards you set when you began sourcing and recruiting. Additionally, bad hires will immediately show signs of self-interest instead of an interest in their role and the company."
How to Ask for a Letter of Recommendation
When the job board you subscribe to finally posts your dream job, you may feel like the stars have aligned. But part of securing a position that matches your career plan is ensuring you address all the application basics. You know, the resume, the cover letter, the portfolio. It seems like you've got this in the bag — until you realize they want a letter of recommendation, too!
16 Tech Jobs You can Get Without a College Degree
You might think that if you don’t have a computer science, information technology, or related degree, then there’s absolutely no way you can break into the technology field and score a high-paying tech job. But this is a misconception. There are actually tons of tech jobs out there that don’t require a college degree. Instead, employers are more interested in the skills that you can offer. So, read on to learn more about how to land tech jobs without a degree.
What Are SMART Goals?
When it comes to achieving our goals, there’s a lot of noise to work through. A study by the University of Scranton has found that only 8% of people who set New Year’s resolutions actually achieve them. Our busy lives might be one reason for this. Another, even more important reason, is our approach to goal setting. Being too vague, too ambitious or simply unclear on the timeframe can set us up for failure.
In-House vs Outsourcing Recruiting: Which is Better?
When looking at in-house vs outsourcing recruiting, it is important to nail down the benefits for each and whether those benefits outweigh the risks that follow.