- UpvoteDownvoteShare Job
- Suggest Revision
Extensive hands-on experience implementing data migration and data processing using AWS services: VPC/SG, EC2, S3, Autoscaling, CloudFormation, Lake Formation, DMS, Kinesis, Kafka, Nifi, CDC processing Redshift, Snowflake, RDS, Aurora, Neptune, DynamoDB, CloudTrail, CloudWatch, Docker, Lambda, Spark, Glue, Sage Maker, AI/Client, API GW, etc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Spark MLlib: Machine learning library built on Apache Spark for distributed data processing. Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP): Cloud computing platforms offering AI services and scalable infrastructure.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data science, machine learning, optimization models, PhD in Machine Learning, Computer Science, Information Technology, Operations Research, Statistics, Applied Mathematics, Econometrics, Successful completion of one or more assessments in Python, Spark, Scala, or R, Using open source frameworks (for example, scikit learn, tensorflow, torch.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Pre-process and support queries using Hive, Impala, Spark, Presto and Pig. Design and implement data modeling using hive/presto, Hue and Erwin Data Modeler. Experience in writing complex SQL queries, and high-performance, reliable and maintainable code; Experience with Python development for data analysis and data modeling; Experience with Hadoop, including Hive, Spark, Impala, Pig, and Oozie; and Experience with AWS/Cloud components, including EC2, S3, and EMR.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow.
$220,400 - $297,400 a yearFull-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Data Integration tools like Spark/Databricks or equivalent. Develop and maintain ELT/ETL workflows using Python, SQL, and Spark to ensure data accuracy, completeness, and consistency.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, CA to a global organization with over 1500 employees. Cryptography, Kubernetes Security, Web Security, Governance, Privacy, Trust, Safety, Authentication, Identity Management, Access Control, Key Management, Inter-Service Authentication, Secure Application Frameworks, Detection & Response.
$220,400 - $297,400 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The team uses a variety of tools, technologies, and languages to build software like Delta Lake, Hadoop, Kinetica, Solr, Spark, Kafka, Python, Java, Ruby, Scala, Airflow, Luigi, EMR, Databricks, etc.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience in Real Time Data Ingestion using GCP PubSub, Kafka, Spark or similar. Keywords: GCP, Google Cloud Platform, BigQuery, Composer, SQL, Python, Data Engineering, Data Pipelines. Experience working with GCP technologies like BigQuery, Composer, GCS, DataStream, Dataflows.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Your expertise in Apache Spark (Scala), Apache Airflow, AWS Glue, Python, Kubernetes, and Oracle will be crucial in ensuring efficient data processing, storage, and retrieval. Design, develop, and deploy robust data pipelines and workflows using Apache Spark (Scala) and Apache Airflow to support data processing and transformation activities.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Azure cloud services, Databricks, Apache Spark, Delta Live Table, ML Flow, Unity Catalog. Leverage Databricks and Apache Spark for big data processing and to enable real-time streaming capabilities.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Spark, Spark Streaming, Databricks, Python. Spark Optimization and Advanced Spark Use Cases. As a leader in the Smart Home industry, we boast one of the largest IoT install bases, with innovative products consisting of cameras, locks, card readers, garage door openers, gates and more, all powered by ourmyQdigital ecosystem.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake. Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
1+ years of professional experience as a Spark Engineer, proficiency in Python or Scala, experience with Apache Spark technologies, strong experience with SQL databases, experience with Apache Hadoop, good knowledge of Apache Airflow, good knowledge of CI/CD tools, good knowledge of Linux, great communication skills, independence in decision-making, good English skills (B1 minimum.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
We use various open-source technologies (such as Apache Spark, Presto, Comet, Apache Airflow to name a few) to develop services for Adobe customers and partners. Plus, to be a Committer or PMC Member with the Apache Software Foundation on big data technologies: Apache Spark, Hadoop Stack, Kafka, Comet, Atlas, delta.
Full-timeExpandApply NowActive JobUpdated Today
udf spark jobs
FEATURED BLOG POSTS
How to Find a Job That Makes You Happy - 11 Concerning Facts
Do you ever feel like your life is like one of those rom-com movie scene openers? You know, the ones where the main character rolls out of bed, awakened by a casually upbeat theme song, sulks their way to the coffee pot, and then trudges toward their computer to begin yet another boring day at work?
How to Decline a Job Offer You Already Accepted
When you think about it, turning down a job offer is not the worst position you could be in. If you’ve been lucky enough to consider multiple job offers, well, then you’re lucky enough.
How to Practice Fair Chance Hiring for People With Criminal Records
Usually when you think of your dream hire, you think of someone who is respectful, trustworthy, reliable, and has sound judgment, right? As you envision your ideal candidate with these qualities, the last person you think of is someone with a criminal record.
6 Common Mistakes to Avoid When Employer Branding
Currently, job searchers are putting extra effort into researching employers. The information they find plays a major role in whether they will pursue an opportunity with you or look for jobs elsewhere. That is why it is now more important than ever to be proactive and intentional when showcasing your workforce and workplace culture. Having a well crafted employer branding strategy can help you strategize and influence your potential candidates so they see your business in the best light. But in order to do that, you should be aware of some of the most common mistakes that employers make.
What to Say When Terminating an Employee
Terminating an employee is an inevitable part of doing business. Whether you’re re-structuring your department or you’ve identified a few employees who’re not living up to your expectations, letting people go is necessary for keeping your workforce healthy and thriving.
How to Utilize Keywords for Your Job Ads
Before we give you the scoop on how to utilize keywords in job ads, it would be helpful if we defined what keywords are and why they are important. In simple terms,
What Makes a Good Paid Time Off (PTO) Policy
The world of work has undergone some major transformation in recent years. From remote and flexible work to increased emphasis on employee benefits and wellbeing, companies nowadays have to be very intentional about their HR policies and how they approach talent acquisition.