- UpvoteDownvoteShare Job
- Suggest Revision
Leverage Spark, Airflow, Apache Beam, Google Kubernetes Engine, BigQuery and other tools to build robust and efficient data pipelines. Deep experience with data frameworks and tools like Spark, Spark Streaming, Apache Beam, and Airflow.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Apache Spark, Databricks. BS, MS, or PhD degree in Computer Science, Data Science, Economics, Statistics, Computational Biology, BioInformatics, or equivalent experience.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Implement the data analysis pipelines using standard Big Data technologies (Spark, Airflow) Opportunity to expand your knowledge of data engineering tools and platforms using state-of-the-art tech stack.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide - including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow.
$250Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Some of the technologies you’ll be working with include Apache Spark, Apache Iceberg, Airflow, Terraform, Kafka, Azure EventHub, Clickhouse. You’ll manage the team that’s behind OpenAI’s data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The systems we support include our data warehouse, batch compute infrastructure, data orchestration system, data lake, ingestion systems, critical integrations, and more.
$150Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
As an Engineering Manager, you’ll be tasked with leading and managing a team of highly experienced Data Infrastructure experts to build, maintain, and iterate on our systems. In addition to Data Infrastructure experience, you are well versed with infrastructure tooling such as Terraform, worked with Kubernetes, and have a strong SRE skillset.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Preferred) Experience working with Apache Spark to process large-scale distributed datasets. 4+ years of hands-on industry data science experience, leveraging typical machine learning and data science tools including pandas, scikit-learn, gensim, nltk, and TensorFlow/PyTorch.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark : Develop the de facto open source standard framework for big data. Delta Pipelines : It's difficult to manage even a single data engineering pipeline.
$166,000 - $225,000 a yearFull-timeExpandApply NowActive JobUpdated 5 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake. Stay abreast of the latest advancements in Databricks and other relevant technologies to continually enhance data engineering practices.
$150ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
As the supply team's Engineering Manager , you will support our integrations with international credit bureaus, bank data providers, payroll systems, OCR systems, fraud systems, and other entities that power our platform (you can read more here.
$216,000 - $264,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The Beneficiary will take part in data engineering lifecycle activities utilizing AWS, EC2, EMR, RDS, Redshift, S3, a well as healthcare data, FHIR, HL7, X12, and CCDA. Design, implement, and document data visualization and analytics.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
You will work with technologies such as Spark, Airflow, dbt, and cloud services from GCP and AWS, while designing processes to ensure effective team operation and continuous improvement. Site Reliability Engineering: As an SRE at Anthropic, you will design and implement scalable solutions, collaborate with development teams to improve infrastructure reliability, and establish monitoring systems, SLOs, and SLIs. You will implement fault-tolerant design patterns, build automation tools, and participate in an on-call rotation.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Education - Bachelor's degree in Molecular Biology, Biology, Chemistry, Applied Mathematics, Physics, Electrical Engineering, Computational Biology, Biostatistics, Bioinformatics, Computer Science or related discipline; postgraduate degree (Master's, PhD) is highly preferred.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Ouster Inc. is seeking a digital hardware FPGA/ASIC design and verification engineering lead. Bachelors in Computer Engineering, Electrical Engineering, or related field. You should be a hands-on technically savvy individual with a proven track record in FPGA/ASIC design processes with exposure into embedded software development.
$190,000 - $250,000 a yearExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
The next phase of Unity focuses on universal objects, where all objects—customer-defined data, first-party developer data, or third-party developer data—should attain the status of first-class citizens.
ExpandApply NowActive JobUpdated Today
data engineering apache spark jobs Company: Komodo Health in San Francisco, Boynton-beach, Florida
FEATURED BLOG POSTS
Resume Job Description Samples - 8 Tips to Follow
When looking for a job, your resume becomes a crucial element. From making a great first impression to showcasing all your achievements and potential, your resume has to portray your professional story in minutes.
Internship Cover Letter Tips with Examples
Until now, college has been about learning, absorbing, and experiencing. It’s not until you become eligible for an internship that things start getting real—real-world experiences using real-life scenarios. Applying for internships takes time, and there’s no college course on “how to apply for jobs.” (We’d sign up immediately if there was, though!) But here's a spoiler alert: most internships require a cover letter. And while this may seem like a burden, it’s actually a blessing.
5 Practical Ways to Remove Bias from your Hiring Process
Many employers think their hiring process is perfect. However, research shows that the hiring processes are generally impartial and unfair, especially if you are part of certain demographics. Women, people of color, people with disabilities, or even people in lower socioeconomic status are more likely to be subject to implicit bias. As diversity and employer branding become major aspects of business, it is important that employers take the lead to identify and remove bias from the hiring process. So, here are 5 practical ways to get you started.
Tips to Get Your First Job Confidently
Whether you’re a recent graduate or you still have a few exams left, you may be itching to put your polished leather shoes on and join the workforce. After all, your first job is an entryway into the professional life you’d lead for the decades to come.
Tips for a Good Character Reference Letter with Examples
Hiring managers love a resume laden with relevant skills and qualifications. Hard skills specific to the role, like SEO strategy or Java programming languages, are easy to qualify using achievements or facts and figures. But how exactly can they verify personality traits, work ethic, relationship management skills, or curious nature during an interview when they barely know you?
How to Dress on the First Day of Work (Men & Women)
You did it! Out of hundreds of applicants and dozens of people interviewed, you’re the one who got a new job. Congrats! Now comes the question of how to dress on the first day of work.
Why College Students Should Work While in College?
College is a special part of our lives. It’s a time when we prepare for our dream job while creating some of the most memorable moments in life. That said, college life can also be stressful. Not only do we have to spend long hours studying, writing and researching, but we also have to deal with increased tuition fees and living expenses.