- UpvoteDownvoteShare Job
- Suggest Revision
At least 4 years of experience in data engineering working with Big Data Technologies: Apache Spark, Pyspark, Hadoop, and DataBricks with delta lake. Acquire data from a variety of different sources, getting it in the right formats, assuring that it adheres to data quality standards, and assuring that users can get that data quickly.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Angular, PySpark, Hadoop, Spark, Hive, Kafka, HBase, Elasticsearch, OpenSearch, Apache, and programming languages such as Java, and Python. Experience in writing spark streaming jobs (producers/consumers) using AWS MSK- Kafka or AWS Kinesis.
$125,000 - $160,000Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Leverage AWS cloud services like S3, Kinesis, Redshift, EMR, Glue, Lambda, and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics.
ExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in programming languages such as Python or Java, and experience in data processing frameworks (e.g., Apache Spark, Kafka). Strong proficiency in data pipeline and ETL design, with hands-on experience in tools like Apache Airflow, Apache NiFi, or similar.
RemoteExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
3+ years of experience in batch and streaming ETL using Spark, Python, Scala, Snowflake, or Databricks for Data Engineering or Machine Learning workloads. Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking, and matching.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Manage and optimize Apache Spark pools for high-performance data processing tasks. Minimum 3 years' experience working with Cloud technologies such as Synapse pipelines, Azure Data Factory (ADF), ADLS, Azure Databricks, Spark, Azure Synapse, and other modern data ETL/ELT technologies.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Works in tandem with business analysts, data architect and data/BI engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The FreeWheel Data Processing and Data Warehouse team is responsible for creating and managing the frameworks for large scale ETL using modern frameworks such as DBT and Spark. Must have proven experience in Apache Spark.
$96,706.14 - $226,655.02 a yearFull-timeRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrate experience with high-level languages and frameworks such as R, Python, Perl, Ruby, Scala, Apache Spark, Storm. Partnering with data engineers on data quality assessment, data cleansing and data analytics.
$104,000 - $150,000 a yearTemporaryRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Strong proficiency in Java Stack programming with expertise in the Spring Boot framework, Apache / Tomcat, Apache Maven, Apache Spark, API Concepts and Methodologies, API Security, Camunda, Cloud Automation, Cloud Computing, Cybersecurity, Data Engineering, Database Design (Physical), DevOps, Java and Related Technology, JavaScript, Linux.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Strong expertise in Apache Spark, Delta Lake, and other Databricks components for data processing and analytics. Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in data engineering tools such as Apache Spark, HDFS, and Erwin Data. Work with advanced technologies such as Apache Spark, Database, EO/IR systems, Erwin Data, HDFS, AB Testing, Analytics, AWS Technologies, and others.
$47.5 - $65 an hourExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Utilize skills in Apache Cassandra, Apache Kafka, Apache Pig, Apache Spark, Database, Algorithm Implementation, Analytics, Apache Hadoop, API Development, AWS Technologies.
$180,000 - $200,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with some of the following: Kubernetes, Docker, Helm Charts, Hadoop, Cloudera, Hortonworks, Apache Storm, Apache Spark, HBase, YARN, map-reduce, big-data analytics, semantic-web (RDF, OWL), Hive, Elastic Search, MS SQL Server Big Data, and graph-databases.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with big data technologies (e.g., Hadoop, Spark, and Hive) as well as ETL tools (e.g., Apache Nifi, Talend, Apache Airflow) and real-time data processing technologies such as Apache Kafka are essential.
$172,000 - $197,000 a yearFull-timeExpandApply NowActive JobUpdated Today
apache spark data quality jobs Title: data engineer Company: Costrategix in Parkville, Maryland
FEATURED BLOG POSTS
How To Make $100K a Year – No BS Strategies & Advice
If you’re like most of us, you’d love to be wealthier. Having more money would alleviate stress. It would make it easier to pay your bills and buy nicer things. Maybe it’d allow you to spend more time with your kids and go on more vacations. You’re not alone if you wish you could somehow earn a more significant income.
How to Write a Recommendation Letter for a Student
When a student applies for their first job or for their next academic degree, they don’t have much experience to showcase their skills and personal qualities. Hiring managers and admissions officers, therefore, often look at recommendation letters as a way to go beyond the student’s GPA and learn more about the student’s skills and personal qualities.
How To Answer “Why Do You Want to Be a Supervisor” in an Interview
Anyone who has worked in a supervisor role knows how challenging yet rewarding it is. But chances are if you're trying to become a supervisor, you'll be forced to answer:
What is Career Cushioning?
Is your organization prepared for “career cushioning”?
Growing Discontent: Employees Wouldn't Wish Their Jobs on Their Worst Enemy
The start of a new year, and most people are already busy setting personal and professional goals. What’s on the top of the list for a growing number of working people is making an exit from the job they currently have. Why?
How to Gracefully Quit a Job You Just Started
You’ve just started learning the ropes at your new job, and you've gotten to know your colleagues. But you’re already thinking about quitting. Maybe you were deciding between to job offers and realized that you’ve made the wrong choice. Or, a change in your personal circumstances means that you have to quit.
How to Professionally Reschedule a Job Interview Without Destroying Your Chances
You’ve practiced answering common interview questions and refined your “greatest weakness.’ Nothing can stop you until BAM! The flu hits your household. Or you ran over a nail and popped a tire en route to the interview. When you need to pivot, there’s a good, better, and best way to reschedule a job interview. Here’s how to do it professionally, so you can nail the gig when the timing is right.