- UpvoteDownvoteShare Job
- Suggest Revision
Strong knowledge of Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib, as Databricks is built on Spark. Strong knowledge of Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib, as Databricks is built on Spark.
ExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Direct hands on experience with highly scalable data pipelines using BigData technologies (Spark, Hive, Airflow, DBT, Parquet / ORC, Kafka / Streaming, etc) Distributed Compute: Spark/Databricks.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Extensive experience with Azure Databricks, Apache Spark, and Big Data technologies. · Databricks Certified Associate Developer for Apache Spark. Extensive experience with Azure Databricks, Apache Spark, and Big Data technologies.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data technologies: e.g., Databricks, MapReduce, HDFS, Hive, Spark, Sqoop. Experience with streaming technologies: e.g., Kafka, Kafka Connect, Kinesis, Beam, Flink, Spark. Integrate data platform infrastructure with other systems fostering seamless collaboration among teams e.g. system integration with Fivetran, Monte Carlo, Salesforce Data Cloud, Tableau, Looker, Teradata, Bigquery.
$212,450 a yearFull-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
O Programming Language: Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting. Use programming languages including but not limited to Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift. Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
ExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, build & deploy the data pipelines using EMR, EMR studio, Databricks, Spark, Pyspark and Shell Scripting. Must have 5+ years of experience in EMR, Databricks, Spark, pyspark programming, Jupyter notebook and shell scripting.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design and develop high availability and low latency production ready software using web, cloud and distributed technologies including Apache Hadoop, Apache Spark, Apache Kafka, Apache Hive, Microservices, and CI/CD cloud deployment.
$195,000 a yearFull-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Collaborate with team members in the design and build of our Cloud based AI/ML data platform solutions, which includes Databricks Spark, Weaviate Vector Databases, and supporting our hosted Cloud GPU Compute services running containerized PyTorch on large scale Kubernetes.
$238,000 a yearFull-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Spectrum Conductor or Databricks with Apache Spark. Strong understanding of core Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBase, Kudu, Sqoop, and Oozie.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with additional transformation platforms like Apache Spark and Beam. Expertise in visualization technologies like Looker, Tableau, or Qlik Sense. Experience with MPP databases such as BigQuery, Redshift, or We use BigQuery here at Mailchimp.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with the full Cloudera CDH/CDP distribution to install, configure and monitor all services in the Cloudera stack. Experience with multiple large-scale Enterprise Hadoop or Big Data, Data Bricks, Cloudera, HD Insights, or other environments focused on operations, design, capacity planning, cluster setup, security, performance tuning, and monitoring.
ExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
HDFS, Spark/PySpark, YARN, Hive, Hbase, Impala, Zookeeper, Sqoop, Oozie, Drill, Flume, Spark/PySpark, Solr and Avro, AWS, Amazon EC2, S3, Azure Databricks. HDFS, Spark/PySpark, YARN, Hive, Hbase, Impala, Zookeeper, Sqoop, Oozie, Drill, Flume, Spark/PySpark, Solr and Avro, AWS, Amazon EC2, S3, Azure Databricks.
$120,000 a yearFull-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Deep expertise in tools such as Spark, Airflow, Presto/Hive, Spark, or any other streaming technologies to process incredible volumes of data, Looker, Tableau or other reporting tools. Deep expertise in tools such as Spark, Airflow, Presto/Hive, Spark, or any other streaming technologies to process incredible volumes of data, Looker, Tableau or other reporting tools.
$230,000 a yearFull-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Databricks/Spark & Python hands-on development skills a must. Must have technical “Hands-on” experience in implementation of data solutions and related downstream systems like data lake using technologies like Informatica IICS, Databricks Python, ADF, Snowflake and other Azure Databases.
Full-timeExpandUpdated Today
spark job in New York, NY
FEATURED BLOG POSTS
How to Make a Job Offer More Competitive
Money alone makes it hard to attract and retain top-notch candidates, especially when you are competing with larger businesses and corporations in your industry. So, instead of focusing on money, figure out how to make a job offer more competitive when you can't offer more money.
5 Ways to Stretch Your Hiring Budget
Many businesses across the country have adjusted business operations to make it through the pandemic. After a period of hardship, many business owners, like yourself, are ready to start recruiting and rebuilding a bigger, more skilled workforce - only now you have to do it with a smaller hiring budget.
How to Ask for a Raise at Work
Here we go again; it’s time to talk money. Whether you’re one year in at a new company or approaching year five on the same team, learning how to ask for a raise should be part of your long-term career plan. These conversations are rarely fun (thanks to society, which has conditioned us to believe that money is taboo), but they are necessary if you want to, well, get paid what you’re worth. Trust us, there’s a lot of money on the table for taking. Below, we’ll discuss tips on timing, approach, and follow-up.
Technology in the Workplace: How to Improve your HR Function with AI
It’s safe to say that the last two years have brought fundamental changes to the way we work and do business. Companies have relied on technology in the workplace to digitize their services and build a remote-friendly infrastructure that could prepare them for the future.
How to Maximize Action Verbs in Your Resume
Writing a resume that stands out takes more than using keywords and savvy formatting. It’s not just about having an impressive list of accomplishments. It’s also about how you position them using action verbs and deliberate word choice. So if you are looking for a way to craft a resume that stands out and gets calls back? Start by sprucing up your resume with captivating action verbs.
What is Your Desired Job Title?
You’ve decided to look for a new job. So now comes the question — what is your desired job title? There are lots of considerations to think through when deciding on the right title for your next role.
4 Things to Consider When Building a Global Workforce
The rise of remote work has given employers a unique chance to rethink how they approach workforce management. This ranges from rethinking the size and design of their office space to updating their tech stack to accommodate different working styles. It has created new opportunities for companies of all sizes to expand their hiring pool and look for top talent on a global scale.