- UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with additional data processing frameworks/tools like Apache Spark, dbt, or Kafka. - Data Processing: SQL, Apache Spark, dbt. - 5+ years of experience in software/data engineering, focusing on data pipeline development and orchestration.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
4+ Experience with technologies Apache Mesos, Marathon, or Apache Spark. At least 6 years of experience in DevOps Engineering (Internship experience does not apply) New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Software Engineer.
$201,400 a yearExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
O Programming Language: Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting. Use programming languages including but not limited to Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting.
$105,100 - $156,500 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Lead Software Engineer, Infrastructure. Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
$201,400 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Working with analytics and construction management software packages including Cora, Power BI, Primavera P6, Primavera Unifier, [redacted], Tableau; Construction Management, Materials Science, Materials Science and Engineering, Project Engineering & Management, Risk Management, Civil Engineering, Mechanical Engineering, Electrical Engineering, Industrial Engineering.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The ideal candidate will have a robust understanding of big data processing, experience with Apache Spark, and a proven track record in Python programming. Strong experience with Apache Spark and its components (Spark SQL, Streaming, MLlib, GraphX) using PySpark.
$120,000 - $130,000 a yearFull-timeExpandApply NowActive JobUpdated 12 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong understanding of data engineering concepts and experience with tools such as SQL, NoSQL databases, and data processing frameworks (e.g., Apache Spark). Proven experience as a Full Stack Developer with expertise in Java, Spring Boot, Python, JavaScript, and related frameworks (e.g., React, Angular, Node.js, Vue.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The Sr. Thermal engineer plays an active role in developing thermal components using 3D CAD software and advanced engineering analysis. The thermal engineer troubleshoots thermal and/or airflow issues in new and existing product lines using empirical data and commercial CFD software.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Management & support of Cloudera services including, but not limited to: HDFS, Hadoop, MapReduce, Hive/Impala, YARN, Solr, Kafka, Oozie & Spark using Cloudera Manager and command-line. Cloudera BDR (Backup Data Replication) for HDFS and Kafka replication (SRM Streams Replication Manager.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Contemporary and innovative approach: Develop novel solutions using modern platforms (e.g., Cloud based platforms like Azure, AWS, GCP), languages/technologies (e.g., Python, Spark, SQL, DBT), Orchestration (ADF, Airflow, Dagster) and tools (e.g., Power BI), with an ability to build IP into reusable software.
Full-timeExpandApply NowActive JobUpdated 16 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hudson River Trading (HRT) is seeking a lead software engineer with a specialization in performance engineering to optimize our high-performance and AI compute workloads. At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech.
$200,000 - $300,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Stantec is actively seeking eager, enthusiastic candidates for a full-time Principal Hydrologic, Hydraulic and Drainage Engineer position with our Water Resources & Engineering group in Northern California/Northern Nevada (can be based anywhere in the US as we have a diverse team from across the Country concentrating on work in the Western US.
$128,200 - $206,300 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Tech stack includes Airflow, Spark, Databricks, Delta Lake, Snowflake, Scala, Python. Expanding, scaling, and standardizing the core foundational principles through consistent observability, lineage, data quality, logging, and alerting across all engineering teams in the Data organization is imperative to the creation of a single pane of glass.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Big Data implementation using Open Source and NoSQL technologies such as Databricks, Spark, Spark Streaming, Kafka, Storm, Zeppelin, Scala, Software development, Hadoop Hive, Hadoop Map Reduce, Hadoop Clusters, Cosmos DB, Azure Data Lake Storage (ADLS.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Establish strong software engineering principles for development in Python on the Azure/Google Cloud Platform. Experience with Snowflake/BigQuery, Google Dataproc/Databricks or any big data frameworks on Spark.
$124,372.5 - $247,200 a yearFull-timeExpandApply NowActive JobUpdated Today
software engineering manager apache spark jobs Title: software manager in New York
FEATURED BLOG POSTS
Virtual Reality Job Interviews
With the advent of desktop computers, the arduous task of scouring through weekly job classifieds became a thing of the past. The mid-1990s brought about a new era where job seekers could easily search and apply for jobs online. The introduction of AOL's Instant Messaging feature provided an even faster means for employers and candidates to communicate and schedule interviews. As smartphones became more pervasive in the early 2000s, hiring managers increasingly used phone calls for screening and interviewing candidates. Despite this trend, over 80% of interviews still took place in person.
A Potential TikTok Ban?!
As you may already know, there has been a lot of talk lately about the possibility of a TikTok ban. While this has not yet come to fruition, it's important to consider the implications this could have for businesses and recruiters who rely on TikTok as a platform to market their brand, recruit new talent, and connect with their audience.
How to Write a Recommendation Letter for a Student
When a student applies for their first job or for their next academic degree, they don’t have much experience to showcase their skills and personal qualities. Hiring managers and admissions officers, therefore, often look at recommendation letters as a way to go beyond the student’s GPA and learn more about the student’s skills and personal qualities.
How To Answer “Why Do You Want to Be a Supervisor” in an Interview
Anyone who has worked in a supervisor role knows how challenging yet rewarding it is. But chances are if you're trying to become a supervisor, you'll be forced to answer:
Recruiting in a Recession: Hard Truths That Talent Acquisition Experts Must Accept
The summer had economists from around the globe embroiled in a debate about a possible recession coming in the next few years (or months). As of October 2022, the U.S. Labor Department data put the current inflation rate at 7.7%. The recent layoffs in the tech industry are just the first of what is soon to be a string of cutbacks by companies looking to save costs. For recruiters, this means freezes in hiring and fewer openings. It will also include the uphill task of finding the best candidates for them from the coming influx of recently laid-off job seekers. Now is probably a good time to brace for tough times in the next few years in the talent acquisition industry. To survive and thrive recruiting in a recession, here are some hard truths you will need to accept.
10 Reasons HR is Important to an Organization
"Nothing we do is more important than hiring and developing people."