- UpvoteDownvoteShare Job
- Suggest Revision
O Programming Language: Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting. Use programming languages including but not limited to Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting.
$156,500 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrated experience in building, tuning data pipelines on Spark, Cloud native tools like Azure Data Factory, Databricks and ETL tools. More than 10+ years of relevant experience in data engineering tools like Azure Data pipelines , Azure Data factory, Azure Data Lake Storage, Databricks.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience in data engineering with Databricks and Spark. Role: Sr. Databricks Engineer (Databricks + Spark + Azure)Location: New York / Iselin NJ / Charlotte NC (100% Onsite from Day 1 from any of these locations) Responsibilities.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience using Big Data frameworks and platforms (e.g., Hadoop, Spark, Databricks), databases (e.g., RedShift, Snowflake) for complex data assembly and transformation. Experience using Big Data frameworks and platforms (e.g., Hadoop, Spark, Databricks), databases (e.g., RedShift, Snowflake) for complex data assembly and transformation.
Full-timeExpandApply NowActive JobUpdated 19 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Deep knowledge of Big Data technologies such as Spark and Cloud ETL tools like Databricks, with a focus on scalability and real-time processing capabilities. Understanding of Big Data technologies and frameworks, including Spark and Cloud ETL tools such as Databricks.
Full-timeExpandUpdated 22 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expertise with Python Language and Apache Spark. AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. Should have a deep understanding of AWS Services (Redshift, Glue, Lambda, Athena, S3, EC2), Visual Studio, SQL Server, SSIS, Matillion; Python.
Full-timeExpandUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Snowflake/BigQuery, Google Dataproc/Databricks or any big data frameworks on Spark. Experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions, Pub/Sub, Kafka, Spark Streaming etc.
$247,200 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design and develop high availability and low latency production ready software using web, cloud and distributed technologies including Apache Hadoop, Apache Spark, Apache Kafka, Apache Hive, Microservices, and CI/CD cloud deployment.
Full-timeExpandApply NowActive JobUpdated 21 days ago - UpvoteDownvoteShare Job
- Suggest Revision
HDFS, Spark/PySpark, YARN, Hive, Hbase, Impala, Zookeeper, Sqoop, Oozie, Drill, Flume, Spark/PySpark, Solr and Avro, AWS, Amazon EC2, S3, Azure Databricks. HDFS, Spark/PySpark, YARN, Hive, Hbase, Impala, Zookeeper, Sqoop, Oozie, Drill, Flume, Spark/PySpark, Solr and Avro, AWS, Amazon EC2, S3, Azure Databricks.
$120,000 a yearFull-timeExpandUpdated 22 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with one or more SQL-on-Hadoop technology (HIVE, Presto, Spark SQL, Databricks) and Hadoop ecosystem. Experience with cloud data services such as Redshift, Relational database services (RDS), Snowflake and Databricks.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow. Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow. ResponsibilitiesYou will assist with on-call rotations as a Live-Ops Incident Commander to help categorize and track real time data incidents, loop in engineering resources as needed to ensure a timely resolution to data issues.
ExpandUpdated 22 days ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience in data engineering, preferably with Databricks and Spark. - Strategic Contributions: Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data technologies such as Hadoop, Spark, and Kafka, and cloud-based data platforms such as Amazon Redshift, Google BigQuery, or Azure Synapse Analytics. Experience with big data technologies such as Hadoop, Spark, and Kafka, and cloud-based data platforms such as Amazon Redshift, Google BigQuery, or Azure Synapse Analytics.
$263,408 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with cloud computing platforms (, AWS, Azure, GCP) and cloud native computingProficiency in programming languages like Python, Java, Scala, C#, SQLExpertise in big data technologies such as Hadoop, Spark, Kafka, and NoSQL databasesKnowledge of data modeling, ETL processes, and data warehousing conceptsExceptional problem-solving abilities and teamwork skills.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with distributed computing systems and/or cloud infrastructures (e.g. Spark, Hadoop, YARN, Kubernetes, AWS, etc.) Experience coding with Java, Go and/or web technologies (e.g. HTML, CSS, JavaScript, Python/Ruby, Django/Flask/Ruby on Rails, etc.
$140,000 a yearFull-timeExpandApply NowActive JobUpdated 3 days ago
spark job in New York, NY
FEATURED BLOG POSTS
How to Decline a Job Offer You Already Accepted
When you think about it, turning down a job offer is not the worst position you could be in. If you’ve been lucky enough to consider multiple job offers, well, then you’re lucky enough.
How to Recruit and Retain Gen Z Employees
As Boomers and the oldest Gen X are exiting the workforce, younger Millennials and Gen Z are flowing in. While the younger generations seem to be completely different than the older generations, many care about some of the same things- financial security, working conditions, etc. However, due to social and cultural differences in the era that Gen Z has grown up in, they have concerns that were never even workplace topics of discussion 20 years ago.
Explore Your Skill and Find the Best Way to Make Money From Home
When you just can’t stomach another drive-thru coffee on your morning commute, close your navigation app on your phone and search for easy ways to make money from home instead. With a computer and some niche skills, there are countless opportunities for you to earn a living from your couch. (Okay, fine, your home office.) Below, we’ll explore 30 different ways to make money from home, as well as a few “too-good-too-be-true" warning signs to know to keep you from booking the wrong remote gig.
Learn How to Respond to an Interview Request With Templates
Job interviews are an inevitable part of any job search. So, handling them well is key to building a fulfilling career. Regardless of whether you’re looking at a more junior role or strive for a role as a business executive, you need to maintain your professionalism every step of the way in order to stay in the game.
How to Write an Address Correctly: Explained with Examples
It's hard to imagine a scenario where a text or phone call just won't do these days. With communication at our fingertips, you may think learning how to write an address is a superfluous skill. But it's a skill that will come in handy when you need to fill out healthcare forms, ship a package, order food delivery, or even apply for new jobs.
What is Employment Participation Rate
According to economists, there are four factors of production that go into creating higher quality goods at lower prices. These are
How to Get Pay Stubs (From Previous Employee Also!)
Pay stubs are an important piece of document which shows your earnings in a given period, as well as any deductions made towards your health insurance or pension contributions. They’re also excellent for finding out how much your recent salary raise has bumped up your monthly net income.