- UpvoteDownvoteShare Job
- Suggest Revision
Required Scala, Spark, Hadoop Kafka, Redis, NoSQL, Akka Java or Python ETL pipeline development High throughput data volume Why work here? Required Scala, Spark, Hadoop Kafka, Redis, NoSQL, Akka Java or Python ETL pipeline development High throughput data volume Why work here.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
We develop the Scala code base used by our low-latency, high-throughput, reliable backend APIs and ETL processes to support a growing feature set. Work with technologies such as Kafka, Spark, and other tools relevant to our data platform.
$185,000 - $210,000 a yearExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
3+ years of experience with the Distributed data/similar ecosystem (Spark, Hive, Druid, Presto) and streaming technologies such as Kafka/Flink. 3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP.
$170,600 - $255,800 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Must have experience with the following: AWS, Python, Snowflake, Market Data, ETL Best Practices, Unix, MS Sql Server, Tableau, Spark, data at scale. Must have experience with the following: AWS, Python, Snowflake, Market Data, ETL Best Practices, Unix, MS Sql Server, Tableau, Spark, data at scale.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
We were the first team to introduce Kafka, Avro,pany-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess and Spark for ETL, at Bloomberg for designing this new data intensive platform that is the hub of financial datasets.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience running heavy workloads on a distributed computing cluster (especially EMR or Databricks), leveraging technologies like Spark to work with large datasets preferred. Explore data from various sources within TTD and prototype ETL pipelines to collect them for model training.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Responsibilities Data Pipeline Development: Design, develop, and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse using Python and Azure Serverless compute resources.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience in a technical role leveraging SQL, Python, Java and/or Spark to build, operate and maintain data analytics solutions. Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools.
$147,000 - $204,750Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Exposure to ETL/ELT technologies such as Airflow, Argo, Dagster, Spark, and Hive. Experience with various data storage and manipulation tools including SQL, Pandas, Elasticsearch & Kibana, and Snowflake.
$100,000 - $200,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Principal Software Engineer, CTS Engineering, FactSet Research Systems Inc., New York, NY: Manages a team of software engineers or projects within CTS Engineering. Minimum Requirements: Bachelor's degree, or higher, or foreign equivalent, in Computer Science, Computer Engineering or related technical field and at least 7 years of software engineering experience.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
And Data Quality Testing with Basic ETL testing. Experience in Bigdata Technologies - such as Hadoop, HDFS, Spark. and Data Quality Testing with Basic ETL testing. Experience in Airflow Data Pipeline and Big Data testing.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Data Engineer having 6-10 year experience in ETL, Data Ingestion and implementation of data warehousing and Data Lake solutions. Strong PySpark/Python programming experience - Partitioning, parallel distributed computation and spark cluster concepts.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Google Cloud DataFlow, Azure Data Factory, Spark, Spark Streaming, etc.
$70 - $80 an hourExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark or similar technologies. Authoritative in ETL optimization, designing, coding, and tuning big data processes using. Experience with Big Data technologies such as Hive/Spark.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
ETL Developer With Python, Py-Spark, Data Nudging, Data Modeling. This is Ravi Kiran from Echo IT Solutions INC. We are looking for the position of ETL Developer at NYC, NY- Onsite.
Full-timeExpandApply NowActive JobUpdated Yesterday
spark etl jobs in Fort Lee, NJ
FEATURED BLOG POSTS
The Quiet Quitting Phenomenon
The term, quiet quitting, was coined in 2009, but only now is it gaining traction as young Millennials and Gen Z workers are experiencing record levels of burnout. With the pandemic and the state of the economy, young employees are feeling the pressure. So, quiet quitting comes into effect when that pressure is exasperated by work stress and no managerial support.
How Does Salary Range Work (With Examples)
What are your salary expectations? Do you know? Establishing a salary that compensates you fairly and keeps you happy at work can feel like taking a shot in the dark. And employers sure don’t make learning budgets easy!
Guide to Hiring a Teenager
Teenagers are full of life. They bring energy and adaptability that may be hard to get from older workers, but does that mean that hiring teens is beneficial? Well, it depends. As you debate whether or not you should integrate teenagers into your workforce, there are some things that you should know first.
10 Best Tips to Find a Job When Relocating
Are you planning to move? That’s great news, but now you might wonder what that means for your job. Some people are lucky – they can relocate and keep working the same position as always, just remotely. For others, however, this isn’t an option. They must search for and land a job in their soon-to-be new city. This can be intimidating, given that getting a new job even under normal circumstances can be challenging. Now you’ll have to overcome additional hurdles. This article provides valuable tips on how to find a job in another state. Because it can be done! Read on to learn how.
How to Re-apply for Your Old Job Professionally
Have you recently started a new job only to find that you miss your old one? Maybe you didn’t realize how good you had it, and now you regret leaving. Don’t worry. You’re not the first person to feel this way, and you might even be able to return to your old job if you play your cards right.
Looking for New Candidates?
Before the turn of the century, recruiters could put their "help wanted" ads in the newspaper, and applications would pour in. Since then, recruiting has turned a new page. The use of the internet and other technologies allows recruiters to broaden their candidate pool for the simple reason being
Decline a Job Offer Professionally: When to Rescind
Your job search has finally paid off! After countless job applications, numerous emails, and several interviews, the hiring manager and other stakeholders have decided that you’re the right person for the job! All you have to do now is accept the offer and walk into the sunset, right?