- UpvoteDownvoteShare Job
- Suggest Revision
Real-Time Analytics: Spark, Kinesis Data Streams. o Programming Language: Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting. Use programming languages including but not limited to Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting.
$156,500 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
AWS (Redshift, Aurora, Glue), Google (BigQuery), MongoDB, Cassandra, Snowflake, Teradata, Oracle Exadata, IBM Netezza, SAP (HANA, BW), Apache Hadoop & Spark, MapR, Cloudera/Hortonworks, etc. Expertise in two or more data estate workloads like Microsoft’s Data & AI Platform (Azure Synapse Analytics, Azure Databricks, CosmosDB, Azure SQL, HDInsight, etc.
$237,500 a yearFull-timeExpandApply NowActive JobUpdated 19 days ago - UpvoteDownvoteShare Job
- Suggest Revision
HDFS, Spark/PySpark, YARN, Hive, Hbase, Impala, Zookeeper, Sqoop, Oozie, Drill, Flume, Spark/PySpark, Solr and Avro, AWS, Amazon EC2, S3, Azure Databricks. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.
$120,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience in data engineering with Databricks and Spark. Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow. ResponsibilitiesYou will assist with on-call rotations as a Live-Ops Incident Commander to help categorize and track real time data incidents, loop in engineering resources as needed to ensure a timely resolution to data issues.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs. Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with data processing and storage technologies: Spark, Airflow, Luigi, Elasticsearch, Redis, DynamoDB, Presto/Athena, etc. Experience working on high-traffic, data-intensive products and services.
$200,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Minimum 3 years’ experience working with Cloud technologies such as Synapse pipelines, Azure Data Factory (ADF), ADLS, Azure Databricks, Spark, Azure Synapse, and other modern data ETL/ELT technologies.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The ideal candidate will have a robust understanding of big data processing, experience with Apache Spark, and a proven track record in Python programming. Strong experience with Apache Spark and its components (Spark SQL, Streaming, MLlib, GraphX) using PySpark.
$130,000 a yearFull-timeExpandApply NowActive JobUpdated 27 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Qualifications Strong technical accomplishments in SQL and data analysis skillsExperience with data transformation orchestration tools like dbt or DataformStrong business intuition and ability to understand complex business systemsFamiliarity with additional transformation platforms like Apache Spark and BeamExperience with MPP databases such as BigQuery, Redshift, or Snowflake.
$205,500Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Extensive hands-on experience implementing data migration and data processing using AWS services: VPC/SG, EC2, S3, AutoScaling, CloudFormation, Lake Formation, DMS, Kinesis, Kafka, Nifi, CDC processing Redshift, Snowflake, RDS, Aurora, Neptune, DynamoDB, CloudTrail, CloudWatch, Docker, Lambda, Spark, Glue, Sage Maker, AI/ML, API GW, etc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of Dagster, BigQuery, Vertex AI, GCP, Terraform, Spark, Kubernetes. Perform in-depth exploratory data analysis to scope ML opportunities, identify potential issues in the data, and lay the groundwork for model design, training & evaluation strategies.
$250,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
This includes leveraging python and ANSI SQL to build data pipelines and quality tools using Spark, Databricks DLT pipelines, and other methods on the Databricks platform. 3-5 years As a technical data engineering experience specifically focusing on automation and quality using python and spark based technologies to process and automate data.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience building data pipelines using Spark/Airflow. Our products focus on data and analytics in structured finance (CMBS), collateralized loan obligations (CLO), commercial real estate (CRE), and banking & lending.
Full-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on Testing experience with DataBricks using Spark SQL or Databricks API, parquet files and Data Lake. Take2 is IMMEDIATELY HIRING a 100% remote Automation Tester (Data focused) for our client.
ExpandApply NowActive JobUpdated Today
spark data jobs in New York, NY
FEATURED BLOG POSTS
How To Answer “Why Do You Want to Be a Supervisor” in an Interview
Anyone who has worked in a supervisor role knows how challenging yet rewarding it is. But chances are if you're trying to become a supervisor, you'll be forced to answer:
What is Career Cushioning?
Is your organization prepared for “career cushioning”?
How to Gracefully Quit a Job You Just Started
You’ve just started learning the ropes at your new job, and you've gotten to know your colleagues. But you’re already thinking about quitting. Maybe you were deciding between to job offers and realized that you’ve made the wrong choice. Or, a change in your personal circumstances means that you have to quit.
Minimizing Candidate Renegs During the Hiring and Onboarding Process
Candidates reneging on job offers or during the onboarding process can be a frustrating experience for any recruiter. In a talent-driven job market, it’s common for candidates to have more than one job offer to consider. It becomes a race against time to see which organization can offer the best career experience, compensation, and circumstances that secure the right employees.
10 Reasons to Be on Time at Work
Being punctual at work may not be something you’ve given much thought to, but it’s the foundation for building a successful career. All of your technical or job-specific skills will be in vain if your peers and superiors can’t trust you to show up on time and do the work. In fact, Simon Sinek once famously said that
10 Importancies of Setting Realistic Goals
We’ve all heard how important it is to set professional and personal goals. Developing and establishing goals keeps us motivated and moving forward in life. But not all goals are created equal. If you’re chasing goals that are too lofty, you’ll end up disappointed when you cannot reach them. Setting goals that are achievable and measurable is the key to success.
Email Etiquette Principles - Why is it Important
Why is email etiquette important? Let's imagine you're hiring for a new role, and you’ve just received the email below.