- UpvoteDownvoteShare Job
- Suggest Revision
Strong understanding of data engineering concepts and experience with tools such as SQL, NoSQL databases, and data processing frameworks (e.g., Apache Spark.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with additional transformation platforms like Apache Spark and Beam. Day to day you’ll be building governed datasets to feed analytical reports and data science models, optimizing and creating new ETL pipelines, or building data models in Looker.
$152,500 - $205,500Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
O Programming Language: Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting. Use programming languages including but not limited to Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scripting.
$105,100 - $156,500 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The Data Capture team for the Data organization within the DE&ET organization is in search of a Lead Software Engineer. Expanding, scaling, and standardizing the core foundational principles through consistent observability, lineage, data quality, logging, and alerting across all engineering teams in the Data organization is imperative to the creation of a single pane of glass.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Your role as a Data Engineer: In this role you will be responsible for designing, developing, and maintaining data pipelines in support of data management functions such as data engineering, data integration and data quality and governance activities.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of IBM Master Data Management (MDM) implementation. ETL experience in development with the suite of tools from Informatica PowerCenter, IBM DataStage and B2B Data Transformation.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL, cloud, and 'big data' technologies.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms.
$110,000 - $120,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience in distributed data processing systems and framework (Hive, Redshift, Presto, Snowflake, Spark, etc) 5+ years relevant work experience in Analytics, Data Science or Software Engineering.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience working with Databricks environment for data processing and analysis. Utilize Databricks environment for data processing, analysis, and model development, ensuring efficient utilization of resources.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
You will assist with on-call rotations as a Live-Ops Incident Commander to help categorize and track real time data incidents, loop in engineering resources as needed to ensure a timely resolution to data issues.
$107,400 - $143,900 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
In HADOOP , you'll be given an introduction to BIG DATA, APACHE HADOOP, HADOOP ECOSYSTEM, CLOUDERA QUICKSTART VM along with core concepts of the Hadoop framework including MapReduce, HIVE, PIG, SQOOP, FLUME, HBASE, OOZIE.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience working with data technologies, such as Apache Spark, Kafka, dbt, and data warehouses, for handling large-scale datasets. Deep technical understanding of AI/ML, MLOps, and data engineering.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ years hands-on experience with related/complementary open source software platforms and languages (e.g. Java, Linux, Apache, Perl/Python/PHP, Chef, Scala) 5+ years hands-on experience with the Big Data stack (HDFS, SPARK, MapReduce, Hadoop, Sqoop, Pig, Hive, Hbase, Flume, Kafka.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Manage and optimize Apache Spark pools for high-performance data processing tasks. Minimum 3 years' experience working with Cloud technologies such as Synapse pipelines, Azure Data Factory (ADF), ADLS, Azure Databricks, Spark, Azure Synapse, and other modern data ETL/ELT technologies.
Full-timeExpandApply NowActive JobUpdated Today
software engineering data processing apache spark jobs Title: engineer in New York, NY
FEATURED BLOG POSTS
What Makes a Good Paid Time Off (PTO) Policy
The world of work has undergone some major transformation in recent years. From remote and flexible work to increased emphasis on employee benefits and wellbeing, companies nowadays have to be very intentional about their HR policies and how they approach talent acquisition.
Internal Recruiting: Benefits and 5 Internal Recruiting Methods to Consider
Internal and external recruiting are nearly the same thing. The biggest difference is where candidates are sourced. There are instances where external recruiting may be the best option. However, when you are presented with the opportunity to recruit internally, you should take full advantage of the different internal recruiting methods. Initially you will find that the hiring process gets a little bit easier. Then you'll notice all the other benefits that internal recruiting offers.
How to Answer the Interview Question: What is Your Communication Style?
As a job searcher, you probably have so many questions about job searching. However, once you've landed an interview, your excitement takes your questions to a whole new level. What will you wear? Will you know how to answer all the questions? Have you practiced giving nice firm handshakes?
What Makes a Company a Great Place to Work
After one too many after-hours emails, you’re on the hunt for a new gig. But what makes a company a great place to work? And how will you know when you find one? Finding a motivating, safe, and productive work environment is important for our mental and physical health. If you’re financially frustrated, creatively stuck, or just plain over it, it’s time to find a healthier workplace where you can flourish.
What Makes a Good Boss? The Top 12 Qualities & Attributes
Think back to the best boss you’ve ever had—does someone come to mind? We hope so! Okay, now think back to the worst boss you’ve ever had. I’m sure you can conjure up a few faces.
How to Recruit and Retain Gen Z Employees
As Boomers and the oldest Gen X are exiting the workforce, younger Millennials and Gen Z are flowing in. While the younger generations seem to be completely different than the older generations, many care about some of the same things- financial security, working conditions, etc. However, due to social and cultural differences in the era that Gen Z has grown up in, they have concerns that were never even workplace topics of discussion 20 years ago.
How Does Temp to Hire Work? Benefits, Concerns, & More
Whether you’re just starting out your career or are looking for the next opportunity, the job market has never been more burgeoning with opportunities. From flexible work options and freelancing gigs to seasonal and temp-to-hire work, people today are spoiled for choice when it comes to finding engaging and fulfilling work.