- UpvoteDownvoteShare Job
- Suggest Revision
5+ years working experience with key open source big-data projects as a contributor or committer including Apache Spark, Apache Flink, Trino, Apache Kafka, Apache Hive, Apache Arrow, Apache Hadoop, Delta Lake, Apache Iceberg.
$250Full-timeExpandApply NowActive JobUpdated 6+ months ago - UpvoteDownvoteShare Job
- Suggest Revision
You will work with the open source community to accelerate Apache Spark with GPUs for data science. Apache Spark is the most popular data processing engine in data centers.
$268,000 - $414,000 a yearFull-timeExpandApply NowActive JobUpdated 6+ months ago - UpvoteDownvoteShare Job
- Suggest Revision
Design, implement, and maintain complex ETL pipelines using tools such as Apache Spark, Apache Airflow, and AWS Glue for both batch and near real-time data processing. Expert knowledge of distributed data processing frameworks like Apache Spark, Hadoop, or Flink.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Apache Kafka, Apache Flink, Apache Spark, Trino (Presto), Apache Airflow/Dagster, Apache Superset, AWS S3, Snowflake, Amplitude, CDP (e.g. Segment.com) The adjacent areas of major focus are Machine Learning Infrastructure and workflow, Experimentation Platform, Knowledge Graphs and various Data Science and Analytics related tooling.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
At least 4 years of experience in data engineering working with Big Data Technologies: Apache Spark, Pyspark, Hadoop, and DataBricks with delta lake. Requires a minimum of a bachelor's or foreign equivalent degree in Management Information Systems, Computer Science and Engineering, or a related field plus 4 years of experience as a software developer, data engineer, or related occupation.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Big Data: managing Hadoop clusters (all included services), troubleshooting cluster operation issues, migrating Hadoop workloads, architecting solutions on Hadoop, experience with NoSQL data stores like Cassandra and HBase, building batch/streaming ETL pipelines with frameworks such as Spark, Spark Streaming and Apache Beam, and working with messaging systems like Pub/Sub, Kafka and RabbitMQ.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
6+ years of software development experience with Python, PySpark, Apache Spark and Kafka. Good experience on designing and developing data pipelines for data ingestion and transformation using Spark.
$85,800 - $209,100 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in programming languages such as Python or Java, and experience in data processing frameworks (e.g., Apache Spark, Kafka) Strong proficiency in data pipeline and ETL design, with hands-on experience in tools like Apache Airflow, Apache NiFi, or similar.
$110,000 - $140,000 a yearFull-timeRemoteExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Leverage AWS cloud services like S3, Kinesis, Redshift, EMR, Glue, Lambda, and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics.
ExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Manage and optimize Apache Spark pools for high-performance data processing tasks. Minimum 3 years' experience working with Cloud technologies such as Synapse pipelines, Azure Data Factory (ADF), ADLS, Azure Databricks, Spark, Azure Synapse, and other modern data ETL/ELT technologies.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Angular, PySpark, Hadoop, Spark, Hive, Kafka, HBase, Elasticsearch, OpenSearch, Apache, and programming languages such as Java, and Python. Experience in writing spark streaming jobs (producers/consumers) using AWS MSK- Kafka or AWS Kinesis.
$125,000 - $160,000Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience using Apache Spark (PySpark or Scala). As a Principal Data Engineer, you will work within the Informatics team and contribute to Tendo's strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related data from various sources.
$97,750 - $132,250 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in distributed data processing frameworks such as Apache Spark, Flink or Similar. Cricut® is looking for a Senior Big Data Engineer to join our Data Platform team supporting the future of AI/ML. The ideal candidate will design, build, and integrate data from various resources, and manage big data pipelines that are easily accessible with optimized performance of Cricut®'s big data ecosystem.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Designs, develops, and implements ETL/ELT processes using Azure Data Factory, Synapse pipelines, Databricks Notebooks, Event Hub to build integrations from Saas sources such as Service Now, Workday, Dynamics CRM, and Eloqua.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
3+ years of experience in batch and streaming ETL using Spark, Python, Scala, Snowflake, or Databricks for Data Engineering or Machine Learning workloads. We are looking for a Senior Data engineer.
ExpandApply NowActive JobUpdated Yesterday
apache spark data jobs Title: data engineer Company: Costrategix in Parkville, Maryland
FEATURED BLOG POSTS
How to Address a Cover Letter With Examples
It’s easy to get caught up in focusing on your resume – how it looks, what it says, and whether it’s going to land you a job interview. Because there is a big focus on building the perfect resume, job searchers often overlook the importance of a high-quality cover letter. Your cover letter plays a huge role in your first impression. It humanizes you and provides context for your resume.
How to Call Out of Work
No matter how happy we are with our jobs, there are days when we feel overwhelmed and want to call out of work. No, don't feel guilty. It's expected because we're humans, and we can't control the uncertainties of life. But the problem lies in how to call out of work without seeming uncommitted to work, especially if you seldom get work-free days.
What is Seasonal Employment?
Depending on where you are in your career, you might have first-hand experience with seasonal employment. Seasonal employment can be a great way to expand your skill set and earn extra cash while helping businesses meet seasonal increases in demand.
How to Avoid a Bad Hire
"A new employee who doesn't meet the minimum performance, quality, and culture fit standards you set when you began sourcing and recruiting. Additionally, bad hires will immediately show signs of self-interest instead of an interest in their role and the company."
How to Ask for a Letter of Recommendation
When the job board you subscribe to finally posts your dream job, you may feel like the stars have aligned. But part of securing a position that matches your career plan is ensuring you address all the application basics. You know, the resume, the cover letter, the portfolio. It seems like you've got this in the bag — until you realize they want a letter of recommendation, too!
What Are SMART Goals?
When it comes to achieving our goals, there’s a lot of noise to work through. A study by the University of Scranton has found that only 8% of people who set New Year’s resolutions actually achieve them. Our busy lives might be one reason for this. Another, even more important reason, is our approach to goal setting. Being too vague, too ambitious or simply unclear on the timeframe can set us up for failure.
In-House vs Outsourcing Recruiting: Which is Better?
When looking at in-house vs outsourcing recruiting, it is important to nail down the benefits for each and whether those benefits outweigh the risks that follow.