- UpvoteDownvoteShare Job
- Suggest Revision
We use Airflow and Spark for ETL, as well as do some stream processing (Kafka Streams and Spark at the moment). When relevant we extract specific domains to Services currently using Java, Kotlin and GoLang.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with data integration tools (e.g. Apache Spark, Apache Kafka) Manage the transformation of large daily batch data volumes in the cloud using Apache Spark, EMR, and Glue, ensuring streamlined processing and cost savings.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Big Data tools and ETL frameworks (Hadoop, Hive, Presto, Spark, Scala, Apache Airflow, etc.) Experience with Big Data tools and ETL frameworks (Hadoop, Hive, Presto, Spark, Scala, Apache Airflow, etc.
Starting at $159,000 a yearExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in big data processing technologies like Amazon EMR to run Apache Spark, Apache Hive and Presto. Architect, build and optimize data processing infrastructure and platform for a wide range of use cases, including Client, ETL, reporting, and analytics.
ExpandApply NowActive JobUpdated 2 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with ETL tools, e.g. Spark, Hadoop, and performance tuning. Within our ETL foundation team, we are looking for a senior Java software engineer, who develops and implements new features and algorithms to improve the efficiency and performance of our core ETL platforms.
Full-timeExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
AWS Expertise – Kinesis, Glue (Spark), EMR, S3, Lambda, and Athena. A Sr. Data Engineer is proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Minimum 4 years of experience with ETL/ELT design and development using tools like Talend, Informatica, AWS Glue, Oracle Data Integrator (ODI) or equivalent. Minimum 2 years of experience with large-scale data processing platforms such as Spark, EMR, and/or HPC computing experience with e.g. Apache Aurora, Slurm.
$156,240 - $190,960 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Sound knowledge of ETL practices preferably spark in Data Bricks cloud big data technologies like AWS, Google, Microsoft, or Cloudera. Sound knowledge of ETL practices preferably spark in Data Bricks cloud big data technologies like AWS, Google, Microsoft, or Cloudera.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We're the first to introduce Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess and Spark for ETL, at Bloomberg for designing this new Data Intensive Platform that is the hub of financial datasets.
$160,000 - $240,000 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Seeking an experienced, results-oriented, mission-driven Full Stack Software Engineer with specialized focus on Data Engineering to perform data model design, data formatting, and ETL development optimized for efficient storage, access, and computation in support of national security objectives.
Full-timeExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data warehouse and big data technologies such as Azure Synapse Analytics, Azure Data Lake Storage, Spark, Kafka, Databricks, Azure Logic Apps, Azure Function apps, Azure Cognitive Services, and Containers.
Full-timeExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop and support ETL pipelines in Azure ADF, Spark, and Apache NiFi. Experience with one or more ETL platforms: ADF, NiFi, Alteryx, SSIS. Troubleshoot and resolve application, platform, network, and ETL pipeline failures.
Full-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Must have knowledge of and experience with Big Data technologies, Amazon Web Services (AWS), Azure, Amazon Redshift, HADOOP, NOSQL, Apache Kafka, Spark, Cassandr. Manage and use tools in the cloud data warehouse development and deployment such as ETL tools, data quality and cleansing tools, query/reporting tools, OLAP, data mining, etc.
ExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Big Data(Spark, Scala) SQL - Hive, Teradata, Spark SQL. We have Contract for Big data/ ETL Engineer f or our client Philadelphia, PA. Please let me know if you or any of your friends would be interested in this position.
ExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
3+ Experience working with Big Data technology and cloud such as Hadoop , Spark, Hive, Microsoft Azure. Design & Implement Extract, Transform, and Load (ETL) solutions utilizing SSIS. ETL design and development knowledge using the Microsoft BI tool set, preferably SSIS.
Full-timeRemoteExpandApply NowActive JobUpdated 6 days ago
spark etl jobs
FEATURED BLOG POSTS
How to Build a Supervisor Resume
Writing a great supervisor resume doesn't have to be rocket science. All you need to do is figure out what the company requires and how best to appeal to their needs. In other words, see the resume as your “key” into any organization of choice.
How to Write a Property Manager Resume
Property management experts have a variety of responsibilities, such as ensuring the safety and durability of commercial and residential buildings. During recruitment for such a position, recruiters assess your skills first-hand. This begins with how well you organize and tailor your property management resume. In other words, they can't afford to bring you onboard if your resume does not impress them.
Finally! Answers to 9 Job Search Questions You've Been Wondering About
There’s no college course on how to job search effectively. If schools offered “Job Searching: 101,” we wouldn’t have to write this article. Unfortunately, there’s nothing straightforward about a job hunt, and researching the best job searching methods is basically limited to sourcing peer advice and internet articles. Don’t worry; we’ve got your back. Here are definitive answers to the most common questions you’ve been dying to ask.
How to Successfully Make a Career Change in the New Year
The beginning of a new year is often a time for reflection and introspection. Millions of people use this time to come up with new resolutions to help them live happier and healthier lives. Pursuing our career ambitions is among the top five, right up there with exercising more and eating better.
How to Write a Chief Operating Officer Resume + Sample
Are you looking to become the Chief Operating Officer in your company of choice? Do you want to create a compelling COO resume that will earn you the job? This article is for you.
Spotting the Details to Build a Construction Project Manager Resume
So you’re ready to become a Construction Project Manager! To achieve this goal, you need to find the right role and write the best resume you can to show a prospective employer that you’re a great fit.
6 Tips to Create a Management Consulting Resume + Sample
So, you want to land a job as a management consultant? Well, here is a management consultant resume sample and some tips below. This will help you create a mind-blowing resume that will keep you in the spotlight during recruitment.