- UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with data integration techniques, ETL frameworks (e.g., Apache Spark), and workflow management tools (e.g., Airflow). Experience with data engineering tools and frameworks such as Apache Airflow, Apache NiFi, Talend, etc.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Big Data & Streaming: 2+ years using big data and/or streaming technologies (e.g. Apache Spark, Apache Kafka, Apache Flink) Design, develop and deliver scalable, robust and highly re-usable components using technologies such as Python, Java, AWS serverless (Lambda, Glue), Apache Spark, Apache Kafka and REST.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Data: Good understanding of data & data processing tools (e.g. Spark, Kafka, SQL), of relational database technologies and of analytics databases (e.g. Redshift, Vertica, Snowflake) Spark, Kafka, SQL), of relational database technologies and of analytics databases (e.g. Redshift, Vertica, Snowflake.
ExpandUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in Apache Spark, including Spark Core, Spark SQL, and Spark Streaming. Use of tools like Apache Airflow, ADF, or Databricks to orchestrate and schedule data workflows.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We use Apache Airflow, Python, and Apache Spark for ETL. For streaming data, we use Apache Kafka managed by a vendor and use Kafka Connect, Kafka Streams, and Spark Streaming for stream processing.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark is a multi-language engine for data engineering, data science, and machine learning that lies at the core of our initiatives. 5+ years experience working in a related system, including ecosystem, Apache Spark and database internal, database systems, data processing or related domains.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
2+ years’ expertise in Databricks, Apache Spark, Snowflake and/or similar data processing frameworks. Databricks Expertise: Optimize data processing by using your expertise in Databricks, develop Spark-based solutions, and enhance data integration and analytics capabilities.
$150,900 - $222,200 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Similar Jobs (5) Senior Systems Software Engineer - Performance - Accelerated Apache Spark locations 2 Locations time type Full time posted on Posted 5 Days Ago Senior Systems Software Engineer, C.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You will work with an engineering team accelerating Apache Spark with GPUs using CUDA and open source libraries. Contributions to major open source projects such as Apache Spark, Apache Kyuubi, Apache Ranger, Apache Iceberg, and Delta Lake. Development experience of Apache Spark Data Sources and connectors.
$216,000 - $333,500 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Micro-batch streaming and continuous streaming process in Databricks for high latency, low latency and ultra-low latency of data accordingly by using inbuilt Apache spark modules. Strong hands-on expertise in building Data engineering solutions using Java, Apache Spark and Scala.
ExpandUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We use various open-source technologies (such as Apache Spark, Presto, Comet, Apache Airflow to name a few) to develop services for Adobe customers and partners. Plus, to be a Committer or PMC Member with the Apache Software Foundation on big data technologies: Apache Spark, Hadoop Stack, Kafka, Comet, Atlas, delta.
ExpandUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Optional Skills:Angular, Apache Hadoop, Apache Hadoop Administration, Apache Kafka, Apache Spark, Apache Storm, Big Data, Cloud Infrastructure, Docker (Software), Docker Swarm, Innovation, Internet of Things (IoT), JavaScript, Kubernetes, React.
$154,800 - $212,800 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
3+ years of experience scaling and operating distributed systems like big data processing engines (e.g., Apache Hadoop, Apache Spark), distributed file systems (e.g. HDFS, CEPH, S3, etc.
ExpandUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Ideally you have an in-depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark, Apache Flink, or Apache Storm.
ExpandApply NowActive JobUpdated Today
apache spark jobs
FEATURED BLOG POSTS
The Roadmap to Get Into Consulting
Consulting is a dynamic and challenging career field that offers many opportunities for people who enjoy problem-solving, strategy, and innovation. Believe it or not, consulting isn't necessarily a senior-level position. You can pursue a career in consulting as a recent graduate or a mid-career professional looking to switch careers. While pursuing a consulting career can be rewarding and fulfilling, it is challenging to break into because it is so competitive.
How To Decorate a Cubicle for Inspiration & Productivity
You know the negative reputation cubicles have – dull, dreary, gray. How can you possibly be expected to sit in one every day and be your naturally productive, enthusiastic, and upbeat self? The answer lies in decorating your cubicle so it sparks creativity and feels welcoming. While this might seem impossible given the bland canvas you have to work with, take heart because it’s totally doable!
How do Employers Verify Education?
At any stage in your professional journey, you may come across an employer or a recruiter who asks to verify your educational credentials. This shouldn’t come as a surprise as 30% of candidates admitted to lying on their resumes, yet 79% of them never get caught. In fact, 85% of employers in the US who conduct background checks find that candidates have lied on their resumes or job applications.
How to Be More Articulate and Speak More Clearly
Have you ever had those moments when you're talking to someone and have no idea what they are saying? The best response you can muster up is a simple head nod or blind agreeance?
How to Ask for a Higher Starting Salary
Maybe you think you’ve finally found your dream job. Everything about it is perfect, except… the salary. Unfortunately, it just isn’t where you want it to be. So, should you give up and move on? Given all the effort you’ve already invested, it’s probably wise to try and negotiate a better salary before you do.
How to Pass a Personality Test with Flying Colors
Whether you’re applying for your first job or looking to move up the career ladder, personality tests aren’t usually the first thing we think about. But surprisingly, they can have a massive impact on how our future employers perceive us. In fact, a 2017 study by the Society for Human Resource Management (SHRM) has found that 32% of U.S. employers use personality tests when hiring for senior management positions, and 28% use them for middle management positions. Personality tests are also used for hourly workers and contractors, though less frequently.
10 Practical and Effective Strategies to Persuade Anyone of Anything
Learning how to persuade people is like a key that can unlock any door. Acing the interview for the job of your dreams. Getting the best deal on a new car. Closing a sale with a skeptical customer. All of these wins require a level of persuasiveness.