- UpvoteDownvoteShare Job
- Suggest Revision
AWS Data Pipeline, Apache Airflow, Argo. Storm, Spark-Structured-Streaming, Kafka. Hadoop, Spark, Kafka. Strong understanding of in-memory processing and data formats ( Avro, Parquet, Json.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in PySpark, Apache Spark, and related big data technologies for data processing, analysis, and integration. Designation: Spark Data Onboarding Engineer.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience with data engineering tools and languages such as Apache Spark, Python, Java.· 5+ years of engineering experience with strong focus on data engineering· 5+ years of Python, SQL, and MLOPS best practices· 5+ years of experience in Azure or GCPPreferred Qualifications· Excellent problem-solving and analytical skills.
$267,800Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Good experience in Apache Spark. Be comfortable navigating the following technology stack: Scala, Spark, java, Golang, Python3, scripting (Bash/Python), Hadoop, SQL, S3 etc. You might have a background as ‘ back end ’ or ‘data’ engineer , either way we are looking for smart engineers who can be super agile, move fast and have an eye for detail.
Full-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Prior experience using distributed streaming & messaging platforms such as Apache Kafka, RabbitMQ and data processing framework such as Apache Flink, Apache Spark is a plus.
Full-timeExpandApply NowActive JobUpdated 19 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong familiarity (and ample hands-on experience) with the Apache Hadoop ecosystem: Spark, Kafka, Hive/Iceberg/Delta Lake, Presto/Trino, Pinot, etc. As a leader in data platform, you will contribute to the full spectrum of our systems, including query processing, scalable pipeline builds with largely Apache-based ingestion, materialized view, transformation and data storage frameworks, and tools/applications that make data available to thousands of users and hundreds of internal systems.
Full-timeRemoteExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Apply DataOps Principles: Embrace a DataOps mindset and utilize modern data engineering tools and frameworks like Apache Airflow, Apache Spark, or similar, to create scalable and efficient data pipelines and architectures.
$140,000 a yearFull-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Must Have – AWS Services, SQL, Python, Apache Spark, Data Bricks or Snowflake, DBT. One of my Client is looking Sr. Data Engineer let me know if you would like to move forward with the below position, so that we can have the ball rolling.
Full-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expert knowledge of data integration and ETL tools (e.g., dbt, Apache NiFi, Talend, Informatica, Azure Data Factory, Prefect). Strong familiarity with big data technologies (e.g., Hadoop, Spark, Kafka, Delta Lake, Iceberg, Arrow, Data Fusion.
$314,000 a yearFull-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with big data operations including, but not limited-to- AWS S3, AWS DMS, AWS SQS, Luigi, AWS EKS, Apache Spark, AWS Glue. Experience with operating/maintaining message streaming solutions like AWS SQS, Apache Kafka etc.
$176,000 a yearFull-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data Processing: Apache Beam (Java), Apache Spark (Python), Airflow. Proficiency with distributed data processing frameworks like Apache Beam, Spark, or similar technologies.
$149,600 a yearFull-timeExpandApply NowActive JobUpdated 30 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with additional transformation platforms like Apache Spark and Beam. Familiarity with ETL orchestration tools like Apache Airflow and Google Dataflow. Day to day you’ll be building modeling data to feed analytical reports and data science models, optimizing and creating new ETL pipelines, or building data models in Looker or Qlik Sense.
$219,000Full-timeExpandApply NowActive JobUpdated 21 days ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of relevant professional experience in building AWS big data pipelines using Apache Spark. Hands-on experience in pipeline orchestration tools, like Apache Airflow.
$140,000 a yearFull-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks. Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3.
$195,700 a yearFull-timeExpandApply NowActive JobUpdated 12 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Ideally 3+ years of hand-on experience in distributed processing using Databricks, Apache Python/Spark, Kafka & leveraging Airflow scheduler/executor framework. leverage Airflow to build complex branching Data Driven pipelines and leverage Databricks to build the spark layer of data pipelines.
Full-timeExpandApply NowActive JobUpdated 1 month ago
apache spark jobs Title: data engineer in Ridgefield Park, NJ
FEATURED BLOG POSTS
How do Employers Verify Education?
At any stage in your professional journey, you may come across an employer or a recruiter who asks to verify your educational credentials. This shouldn’t come as a surprise as 30% of candidates admitted to lying on their resumes, yet 79% of them never get caught. In fact, 85% of employers in the US who conduct background checks find that candidates have lied on their resumes or job applications.
How to Be More Articulate and Speak More Clearly
Have you ever had those moments when you're talking to someone and have no idea what they are saying? The best response you can muster up is a simple head nod or blind agreeance?
How to Ask for a Higher Starting Salary
Maybe you think you’ve finally found your dream job. Everything about it is perfect, except… the salary. Unfortunately, it just isn’t where you want it to be. So, should you give up and move on? Given all the effort you’ve already invested, it’s probably wise to try and negotiate a better salary before you do.
How to Pass a Personality Test with Flying Colors
Whether you’re applying for your first job or looking to move up the career ladder, personality tests aren’t usually the first thing we think about. But surprisingly, they can have a massive impact on how our future employers perceive us. In fact, a 2017 study by the Society for Human Resource Management (SHRM) has found that 32% of U.S. employers use personality tests when hiring for senior management positions, and 28% use them for middle management positions. Personality tests are also used for hourly workers and contractors, though less frequently.
10 Practical and Effective Strategies to Persuade Anyone of Anything
Learning how to persuade people is like a key that can unlock any door. Acing the interview for the job of your dreams. Getting the best deal on a new car. Closing a sale with a skeptical customer. All of these wins require a level of persuasiveness.
A Potential TikTok Ban?!
As you may already know, there has been a lot of talk lately about the possibility of a TikTok ban. While this has not yet come to fruition, it's important to consider the implications this could have for businesses and recruiters who rely on TikTok as a platform to market their brand, recruit new talent, and connect with their audience.