- UpvoteDownvoteShare Job
- Suggest Revision
In this role, you will help architect and implement our ML strategy and data processing pipelines using Redshift, Apache Airflow, Apache Spark, and AWS SageMaker. Leverage Apache Spark for large-scale data processing and analytics.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Our team leverages cutting-edge open-source technologies such as Apache Spark, Flink, Kafka, Airflow, Delta Lake, and Iceberg to build and maintain a scalable, high-quality data ingestion framework.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Bonus if those were open-sourced big data processing frameworks using technologies like Spark, Airflow, Kafka, Flink, Iceberg, Deltalake. Cutting-Edge Technology: Work with advanced open-source technologies such as Apache Spark, Flink, Kafka, Airflow, Delta Lake, and Iceberg.
$140,100 - $210,100 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Big Data & Streaming: 2+ years using big data and/or streaming technologies (e.g. Apache Spark, Apache Kafka, Apache Flink) Data: Good understanding of data & data processing tools (e.g. Spark, Kafka, SQL), of relational database technologies and of analytics databases (e.g. Redshift, Vertica, Snowflake.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop and deliver scalable, robust and highly re-usable components using technologies such as Python, Java, AWS serverless (Lambda, Glue), Apache Spark, Apache Kafka and REST.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrated experience deploying data solutions using a modern data engineering stack composed of data lake, dimensional data warehouse and Apache Spark-based compute platform, preferred.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge in Kafka, Pig, MapReduce, HBase, Sqoop, Solr is a plus Willingness to do Certification in Databricks Certified Developer: Apache Spark 3. Strong experience with JUnit in writing test-cases and Experience in error logging and debugging Strong experience in Spark, Core Java, Unix scripting, SparkSQL, Hive. Experience on Open Source Frameworks Spring MVC, Spring (Core, DAO, ORM), Hibernate, Maven.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Develop data pipelines / APIs using Python, SQL, Spark and GCP Methods. Develop Python scripts in AWS or GCP to perform batch processing using predefined API's to read/write batch processing data into Big Query or Aurora.
$144,560 - $155,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of big data technologies such as Apache Spark, Hadoop, or Kafka. Design and implement scalable data pipelines using AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
2-4 years direct experience in Data Engineering with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents) Data streaming systems: Storm, Spark-Streaming, etc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in programming languages such as Python or Java, and experience in data processing frameworks (e.g., Apache Spark, Kafka). Strong proficiency in data pipeline and ETL design, with hands-on experience in tools like Apache Airflow, Apache NiFi, or similar.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency with server-side languages for structured data processing; Python, PySpark, Java, Apache Spark, and SparkSQL preferred. Familiarity with analytical tools for business intelligence and data science such as Power BI, Jupyter, and R Studio preferred.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
System Design and Architecture: Assist in the design and architect cloud infrastructure solutions using Apache Spark for distributed data processing and analytics. Experience using workflow runners including Github Action Runners, Jenkins Agents, Apache Airflow Workers, and Apache Spark.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Design, development, implementation, operations, and support of the Big Data real-time streaming pipelines in a secure and performant manner using Apache Flink, Apache Spark and Apache Kafka.
ExpandApply NowActive JobUpdated Today
big data apache spark jobs Company: Shein in Fernley, Nevada
FEATURED BLOG POSTS
How to Navigate Hiring Out of State
The job market has shifted significantly in recent years. The accelerated adoption of technology has not only pushed many companies into remote working arrangements but also increased the availability of supporting tools and technologies (i.e., video conferencing and collaboration software).
Building a Candidate Pipeline Through Internships
Building a candidate pipeline through a great internship program for local college students and recent graduates at local universities is a great and cost-effective way to attract and retain top talent. By offering meaningful and impactful work experiences, regular feedback, coaching, and mentorship, you can create a positive internship experience that will make your organization a sought-after destination for future employees. This not only benefits the organization in the short-term but also in the long-term, as you'll have a pool of well-trained and experienced candidates who may be interested in full-time employment once they graduate. Furthermore, building relationships with local universities and college students can increase brand awareness and build a positive reputation for your organization in the local community.
Hiring Transparency
Transparency in hiring refers to the open and honest communication and information sharing that takes place between employers and job candidates. It encompasses all aspects of the hiring process, from posting job descriptions to providing feedback on performance during and after the interview process. In today's job market, hiring transparency has become increasingly important for both employers and candidates alike.
Recruitment strategies that are weird, but actually workÂ
In the current candidate-driven job market, recruiters are looking for unique ways to attract talent. Some have resorted to even (dare we say it?) recruitment strategies on the border of weird and wacky. What can we learn from the unusual recruitment tactics that are being used and actually getting results? Here’s a rundown of some unique recruitment strategies that actually work.Â
How To Make $100K a Year – No BS Strategies & Advice
If you’re like most of us, you’d love to be wealthier. Having more money would alleviate stress. It would make it easier to pay your bills and buy nicer things. Maybe it’d allow you to spend more time with your kids and go on more vacations. You’re not alone if you wish you could somehow earn a more significant income.
How to Write a Recommendation Letter for a Student
When a student applies for their first job or for their next academic degree, they don’t have much experience to showcase their skills and personal qualities. Hiring managers and admissions officers, therefore, often look at recommendation letters as a way to go beyond the student’s GPA and learn more about the student’s skills and personal qualities.
How To Answer “Why Do You Want to Be a Supervisor” in an Interview
Anyone who has worked in a supervisor role knows how challenging yet rewarding it is. But chances are if you're trying to become a supervisor, you'll be forced to answer: