- UpvoteDownvoteShare Job
- Suggest Revision
Solid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storage. Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, using technologies such as Apache Spark, Hadoop, and Kafka.
$160,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Distinct experience in advanced probability, statistics, machine learning, big data processing, analytics, and pipelining using Spark is essential, as well as experience in deep learning, generative AI, LLMs, and NLP. This role involves developing data science solutions, mentoring and imparting knowledge about machine learning and data concepts and techniques, as well as driving adoption of standards, processes, and tools to achieve high operational efficiency.
$242,000 a yearFull-timeExpandApply NowActive JobUpdated 18 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in Python and SQL, with working experience in Apache Spark, Databricks, or other big data systems. Regularly interact with the team to reinforce machine learning and data concepts, and guide them in the creation of product features with Generative AI, NLP, deep learning, and classical machine learning techniques.
$242,000 a yearFull-timeExpandApply NowActive JobUpdated 15 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Microsoft Azure’s data services: You should have hands-on experience with various data services offered by Microsoft Azure, such as Azure Machine Learning, Azure Databricks, and Azure Data Factory.
Full-timeExpandApply NowActive JobUpdated 17 days ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ years working experience with key open source big-data projects as a contributor or committer including Apache Spark, Apache Flink, Trino, Apache Kafka, Apache Hive, Apache Arrow, Apache Hadoop, Delta Lake, Apache Iceberg.
$419,750 a yearFull-timeExpandApply NowActive JobUpdated 6+ months ago - UpvoteDownvoteShare Job
- Suggest Revision
ML | AI | Machine Learning | DevOps | Data & Analytics | Infrastructure | CI/CD | Terraform | Gitlab | Azure Devops | AWS | Azure | DataBricks | Ansible | Apache Spark | Kafka | Kubernetes | Docker | Linux.
$250,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with Databricks platform and Apache Spark. DataBricks Architect with Apache, Spark, Python, ETL. In-depth knowledge of Apache Spark and its ecosystem.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrated expertise in machine learning, deep learning, and NLP, with a strong portfolio in large language models like GPT-3, BERT, and RAG.Advanced proficiency in Python, with hands-on experience in ML libraries and frameworks such as TensorFlow and PyTorch.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands on Experience working with AWS services including Glue, S3, EKS, Data Pipeline, Step functions and establishing connectivity to AWS services like RDS from Informatica, data stage, Apache Spark.
$168,000 a yearFull-timeExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Design, implement, and maintain complex ETL pipelines using tools such as Apache Spark, Apache Airflow, and AWS Glue for both batch and near real-time data processing. Expert knowledge of distributed data processing frameworks like Apache Spark, Hadoop, or Flink.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Expert-level knowledge of data frameworks, data lakes and open-source projects such as Apache Spark, MLflow, and Delta Lake. Advanced technical certifications: AWS Certified Cloud Practitioner, Solutions Architect, Certified Developer, or SysOps Administrator certifications; RHEL RHCSA/RHCE; AWS Certified Data Analytics, DASCA Big Data Engineering and Analytics preferred.
Full-timeExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience working in data warehousing, data engineering and building machine learning models for solving complex problems using AWS services (7+ years.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
As a lead big data engineer at Booz Allen, you’ll use your expertise to lead data engineering activities on some of the industry's most mission-driven projects. Ever-expanding technology like IoT, machine learning, and artificial intelligence means more structured and unstructured data is available today than ever before.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Responsible for utilizing big data technologies (e.g., Apache Hive, Apache, Pig, Apache Spark, MapReduce, Hadoop, and MongoDB) and knowledge of data science models to analyze large amounts of data and create valuable insights for supporting the mission.
Full-timeExpandApply NowActive JobUpdated 16 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., Azure, Snowflake, AWS, GCP) Certification in relevant technologies (e.g., AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer Associate.
$185,000 a yearFull-timeExpandApply NowActive JobUpdated 3 months ago
machine learning big data apache spark hands on jobs Title: data engineer
FEATURED BLOG POSTS
Why College Students Should Work While in College?
College is a special part of our lives. It’s a time when we prepare for our dream job while creating some of the most memorable moments in life. That said, college life can also be stressful. Not only do we have to spend long hours studying, writing and researching, but we also have to deal with increased tuition fees and living expenses.
5 Ways to Measure Candidate Experience
Your candidate experience is made up of 4 essential parts
How to Stall a Job Offer Politely
You did it! After several weeks of looking for a new job and undergoing grueling interviews, you finally have a job offer. Although this may be very exciting, accepting a job offer means that you’re making a long-term commitment to your future employer. So, even if you’re eager to leave your current job, this isn’t a decision you should take lightly.
How to Get a Job in a New City - Best Tips to Follow
When your dream job posts, will you be ready? What if that dream job was in a faraway city or a different continent…would you move for it? Most of us have dreamed about what it would be like to accept a job in a new place at one time or another. But when it comes to actually making a move, it’s usually the logistical details that give us pause. The key to job searching in a different location is to have a plan.
What is a Policy of Non-Retaliation & How to Create One
Your company probably has many policies in place – anti-discrimination policies, equal opportunity policies, ethics policies, and so on. However, it is important to re-evaluate whether you have a policy that covers every situation. Say for instance one of your employees submit a complaint in good faith to their supervisor. To their surprise, they are met with retaliation, such as demotion, defamation, or even termination.
When to Tell Your Boss You're Job Searching
The Bureau of Labor Statistics has found that individuals, on average, have 12.4 jobs throughout their working life. So regardless of where you are on the career ladder, it’s inevitable that at some point, you’ll begin looking for another job. That said, you might be wondering,
What Questions Can You Not Ask in an Interview?
It can be stressful to interview candidates to fill an open role at your company. Maybe your boss is on you to hire someone who’s absolutely perfect as soon as possible. Maybe you don’t have a ton of experience yet in conducting interviews. Whatever the case, there’s a lot to take under consideration when you’re the one in charge of interviewing. For instance, “What questions can you not ask in an interview?” may very well be running through your mind given its legal ramifications. Knowing exactly which interview questions are off-limits (and which are fine to ask) will boost your confidence as you continue to search for the ideal new hire.