- UpvoteDownvoteShare Job
- Suggest Revision
In this role, you will help architect and implement our ML strategy and data processing pipelines using Redshift, Apache Airflow, Apache Spark, and AWS SageMaker. Leverage Apache Spark for large-scale data processing and analytics.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Must be proficient in SQL and understand different data modeling techniques using Big Data frameworks such as Presto/Snowflake/Databricks. The FreeWheel Data Processing and Data Warehouse team is responsible for creating and managing the frameworks for large scale ETL using modern frameworks such as DBT and Spark.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Must have proven experience in Apache Spark. Designs and builds data processing pipeline using cutting edge AWS services, 3rd party open-source/commercial software, and internally developed software to ingest, process, and deliver data at scale.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Our team leverages cutting-edge open-source technologies such as Apache Spark, Flink, Kafka, Airflow, Delta Lake, and Iceberg to build and maintain a scalable, high-quality data ingestion framework.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Bonus if those were open-sourced big data processing frameworks using technologies like Spark, Airflow, Kafka, Flink, Iceberg, Deltalake. Cutting-Edge Technology: Work with advanced open-source technologies such as Apache Spark, Flink, Kafka, Airflow, Delta Lake, and Iceberg.
$140,100 - $210,100 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Big Data & Streaming: 2+ years using big data and/or streaming technologies (e.g. Apache Spark, Apache Kafka, Apache Flink) Data: Good understanding of data & data processing tools (e.g. Spark, Kafka, SQL), of relational database technologies and of analytics databases (e.g. Redshift, Vertica, Snowflake.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Strong knowledge of big data technologies and frameworks, such as Apache Hadoop, Apache Spark, Apache Kafka, Apache Hive, or Apache Flink. Knowledge and/or experience working within the Hadoop or other big data distributed ecosystem.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop and deliver scalable, robust and highly re-usable components using technologies such as Python, Java, AWS serverless (Lambda, Glue), Apache Spark, Apache Kafka and REST.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
2-4 years direct experience in Data Engineering with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents) Data streaming systems: Storm, Spark-Streaming, etc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of big data technologies such as Apache Spark, Hadoop, or Kafka. Design and implement scalable data pipelines using AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Develop data pipelines / APIs using Python, SQL, Spark and GCP Methods. Develop Python scripts in AWS or GCP to perform batch processing using predefined API's to read/write batch processing data into Big Query or Aurora.
$144,560 - $155,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in programming languages such as Python or Java, and experience in data processing frameworks (e.g., Apache Spark, Kafka). Strong proficiency in data pipeline and ETL design, with hands-on experience in tools like Apache Airflow, Apache NiFi, or similar.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrated experience deploying data solutions using a modern data engineering stack composed of data lake, dimensional data warehouse and Apache Spark-based compute platform, preferred.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with data engineering concepts and tools such as data pipelines, ETL processes, SQL, and big data technologies (e.g., Apache Spark, Hadoop). We are seeking a skilled Sr. Martech Software Engineer with expertise in marketing technology platforms (CRM or CDP) such as Adobe Experience Platform (AEP) or similar (e.g. Salesforce, Dynamics, etc), coupled with strong skills in building custom solutions on AWS, proficiency in API development using languages like Python or Java, and some experience in data engineering.
ExpandApply NowActive JobUpdated Today
big data mining apache spark jobs Title: data scientist in Phenix-city, Alabama
FEATURED BLOG POSTS
Explore Your Skill and Find the Best Way to Make Money From Home
When you just can’t stomach another drive-thru coffee on your morning commute, close your navigation app on your phone and search for easy ways to make money from home instead. With a computer and some niche skills, there are countless opportunities for you to earn a living from your couch. (Okay, fine, your home office.) Below, we’ll explore 30 different ways to make money from home, as well as a few “too-good-too-be-true" warning signs to know to keep you from booking the wrong remote gig.
Learn How to Respond to an Interview Request With Templates
Job interviews are an inevitable part of any job search. So, handling them well is key to building a fulfilling career. Regardless of whether you’re looking at a more junior role or strive for a role as a business executive, you need to maintain your professionalism every step of the way in order to stay in the game.
How to Write an Address Correctly: Explained with Examples
It's hard to imagine a scenario where a text or phone call just won't do these days. With communication at our fingertips, you may think learning how to write an address is a superfluous skill. But it's a skill that will come in handy when you need to fill out healthcare forms, ship a package, order food delivery, or even apply for new jobs.
What is Employment Participation Rate
According to economists, there are four factors of production that go into creating higher quality goods at lower prices. These are
How to Get Pay Stubs (From Previous Employee Also!)
Pay stubs are an important piece of document which shows your earnings in a given period, as well as any deductions made towards your health insurance or pension contributions. They’re also excellent for finding out how much your recent salary raise has bumped up your monthly net income.
How to Write a Job Description?
It might be tempting to overlook the importance of a well-written job description. After all, if you’ve posted job ads before and ended up with tons of resumes in hand, it’s easy to assume that this will always be the case, regardless of how your job ad reads. But, in reality, you really can’t take getting an influx of resumes for granted.
How to Get a W2 From Previous Employers
When tax time rolls around, the last thing you want to worry about is having to track down a W-2 from your former employer. Many times you won’t have to because the IRS requires companies to send these forms to all current and former employees who have earned more than $600 in the last year. Unfortunately, there are employers who don’t do what they’re supposed to. There are even times where something else may happen that prevents the W-2 from getting where it’s supposed to go.