- UpvoteDownvoteShare Job
- Suggest Revision
Experience with data technologies: Hadoop, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend etc. The Sr. Data Engineer will join a Data Engineering Team focused on data architecture and development in an AWS / Snowflake environment.
Full-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data science, machine learning, optimization models, Master's degree in Machine Learning, Computer Science, Information Technology, Operations Research, Statistics, Applied Mathematics, Econometrics, Successful completion of one or more assessments in Python, Spark, Scala, or R, Using open source frameworks (for example, scikit learn, tensorflow, torch.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience with orchestration tools such as Airflow, Dagster, or Prefect, with big data tools such as Kafka & Spark, and with dbt. The Data Engineering Manager will support our data initiatives and will ensure an optimal data delivery architecture that is consistent throughout ongoing projects.
Full-timeExpandApply NowActive JobUpdated 18 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience using big data technologies (Snowflake, Airflow, Kubernetes, Docker, Helm, Spark, pySpark) Experience designing and building highly available, distributed systems of data extraction, ingestion, normalization and processing of large data sets in real time as well as batch, that will be used across engineering teams using orchestration frameworks like Airflow, KubeFlow or other pipeline tools.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Data Management: Primary Skills: PIG, Py-Spark Secondary Skills: NiFi, PressureWave. API: Provide the development, test, deploy, and sustainment of various Python based ReST end points, microservices, and data model management capabilities utilizing Django and Flask frameworks to interact with data models such as MariaDB, MongoDB, and PostgreSQL and send data upon request, in JSON format, to UI front ends.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Delivery experience in Data Engineering with Google Cloud Platform including Big Query, Dataflow, Cloud Data Fusion, Cloud Composer, Dataproc, Cloud Pubsub, Cloud Function etc. Understanding of cloud data engineering and integration concepts.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience in data engineering with Databricks and Spark. We are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Deep understanding of Apache Spark, Delta Lake, and related big data technologies, and proficiency in modern programming languages such as Python and Scala. Experience with Spark jobs for data processing, analysis, and machine learning tasks using Databricks.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience building a data platform, with experience in tooling and services such as Airflow, Spark, Flink, Beam, dbt, Dataflow, BigQuery, Tableau, Looker, or equivalent. Engineering Manager, Data Analyticsat Memora Health (View all jobs)Remote - U.S. Based.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience using modern containerization software including Docker, OpenShift and Kubernetes Experience with Snowflake, Microsoft Power BI, Splunk, Securonix, and CywareProficiency with automation tools such as Ansible, Chef or Puppet Project Management experience Industry related certifications such as PMP, GSLC, GISF, GSEC, CISSP Experience with big data tools: Hadoop, Spark, Kafka, etc.
$128,900 - $195,400 a yearFull-timeRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
In the process, the role will have the opportunity to act as a Data Advisory member for the Actuarial, Business Intelligence (BI), Data Science, and Data Engineering teams, as well as a collaborator and contributor to Enterprise Data Architecture.
$113,668 - $203,468 a yearFull-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data architecture or data engineering related certification strongly desired. Minimum 6 years of experience in a data integration (Cloud/Traditional) engineering related role required.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Your expertise in Apache Spark (Scala), Apache Airflow, AWS Glue, Python, Kubernetes, and Oracle will be crucial in ensuring efficient data processing, storage, and retrieval. Design, develop, and deploy robust data pipelines and workflows using Apache Spark (Scala) and Apache Airflow to support data processing and transformation activities.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Certifications in Tableau, Power BI, RStudio, Azure Data Engineering and Databricks ML. Experience working with Python, R, SQL, and Spark for Big Data Analytics. Experience with ML frameworks such as scikit-learn and Big Data feature engineering for ML.
$147,200 - $229,925 a yearExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
As a member of the Data and Analytics organization, you will be responsible for designing, building, and maintaining best-in-class data engineering pipelines aimed at driving best-in-class solutions primarily using Cloud platforms like GCP. You will collaborate with cross-functional teams, including data scientists, analysts, business SME's and software engineers, to ensure the efficient and reliable processing, storage, and retrieval of data.
Full-timeExpandApply NowActive JobUpdated Today
spark data engineering jobs
FEATURED BLOG POSTS
What is a W-9 and How to Fill One Out
When you began working for yourself, you probably didn’t account for the tax reporting work that will fall on your shoulders each year. If you’re a freelancer, independent contractor, or business owner, filing your taxes is not as simple as uploading your W-2 form into some online tax preparation software. Most self-employed people need to complete a W-9 as a step for accurately reporting their earnings to the IRS. Below, you can learn how to fill out a W-9 and when to submit it.
Tightening the HR budget in 2023
With the state of the economy still uncertain, 2023 is expected to be approached with much anticipation. Human Resource leaders have many concerns, including how they will manage to accomplish their goals with budget belts already getting snug. Let’s look at some of the factors that the new year is projected to bring for HR and how to prioritize budgets to reach human capital objectives.
A Comprehensive Guide to Becoming a Better Conversationalist
Have you ever stood awkwardly next to someone at a party because you didn’t know what to say to them? How about at a networking event or on a first date? You're not alone if you’ve ever experienced this uncomfortable silence. Many people struggle to master the art of being a great conversationalist.
Why is Non-Verbal Communication Really Important?
In a world where words and phrases rule daily communication, you may wonder why non-verbal communication is important. Whether you realize it or not, you communicate more with nonverbal actions than you do with verbal communication. When you interact with your peers, people are reading your body language, facial expressions, voice, and many other factors that help fill in blanks that words can't fill.
Making Hybrid Work More Efficient
Covid was a catalyst for change in the work environment. Keeping people safe and helathy was the initial goal for employers, but the unintended result was the considerable demand in remote work. Now, onsite work has been dramatically altered to remote work, which is now transforming into a combination of the two: hybrid work.
How Can HR Technology Help Retain Employees?
Human resources' rapid adoption of technology has led to new ways of streamlining human capital management. Based on the IEE Global Study, these technologies changed how HR handled recruitment and retention in 2022. This includes tech like
Why is Time Management Important? 10 Crucial Importances of Time Management
We’ve all been there before. What starts as a relaxing evening scroll quickly becomes a full-blown binge. You blink, and it’s midnight - throwing off your entire next day before it even starts. And at its worst, this indulgence might leave you feeling behind on things you planned to finish that night. This is why time management is important.