- UpvoteDownvoteShare Job
- Suggest Revision
8+ years of experience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads. 5+ years orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi.
ExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience in data engineering, with a strong background in Apache Spark and cloud-based databases such as Snowflake. Utilize tools like Airflow for workflow management and Kubernetes for container orchestration to ensure seamless deployment, scaling, and management of data processing applications.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Python, Apache Airflow, Apache Spark, PostgreSQL, Presto SQL, Snowflake SQL, Confluence, JIRAAmazon Web Services (Security Groups, Batch, Lambda, S3, ECS, EC2, ALB, RDS, IAM, SNS, Fargate, ElastiCache, Redis.
$10Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Includes Snowflake, Apache Airflow, AWS cloud infrastructure (e.g., Kinesis, Kubernetes/EKS, Lambda, Aurora RDS PostgreSQL), Python and Typescript. Experience building and managing production-grade data platforms using distributed systems such as Kafka, Spark, Flink and/or others.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
We use Apache Airflow, Python, and Apache Spark for ETL. For streaming data, we use Apache Kafka managed by a vendor and use Kafka Connect, Kafka Streams, and Spark Streaming for stream processing.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Python, Apache Airflow, Apache Spark, PostgreSQL, Presto SQL, Snowflake SQL, Confluence, JIRA. Utilize programming languages such as Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.
Part-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with high-speed distributed computing frameworks involving MapReduce techniques like Apache Spark, Kafka Streams, Apache Flink etc. Working knowledge of DevOps tools such as Jenkins, Kubernetes, Helm and CI/CD pipeline etc.
ExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience of working with Spring Java applications for Kubernetes & AWS environment. Develop applications to be deployed in Kubernetes environments, As a Systemically Important Financial Market Utility (SIFMU), OCC operates under the jurisdiction of the U.S. Securities and Exchange Commission (SEC), the U.S. Commodity Futures Trading Commission (CFTC), and the Board of Governors of the Federal Reserve System.
Full-timeExpandApply NowActive JobUpdated 3 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Market-relevant, complementary technologies e.g. Apache Kafka, Kubernetes. Other Tools and connectors - Ops/Cloud Manager, Compass, Connector for BI, Connector for Spark. Other Tools and connectors - Ops/Cloud Manager, Compass, Connector for BI, Connector for Spark.
Full-timeExpandUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads. Experience orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi.
ExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark, Apache Airflow, PySpark, AWS Glue – expert level skills. Docker and Kubernetes, REST API design pattern. Apache Spark, Apache Airflow, PySpark, AWS Glue – expert level skills.
ExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or windows shell is preferable. As the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Apache Spark, Apache Airflow. Docker and Kubernetes. Apache Spark, Apache Airflow. Databases - extensive experience working with MySQL, PostgreSQL or Oracle 11g and NoSQL databases like DynamoDB, MongoDB.
Full-timeExpandApply NowActive JobUpdated 2 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Reporting and data visualization tools like Tableau, Looker, Sisense, etc. Statistical and data mining techniques: GLM/Regression, Random Forest, Boosting, Trees, text mining, social network analysis, etc.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience in big data technologies, e.g. Hadoop, BigQuery, MapReduce, Apache Spark. Experience working in accordance with DevSecOps principles, and familiarity with industry deployment best practices using CI/CD tools and infrastructure as code (Jenkins, Docker, Kubernetes, and Terraform.
$122,500 - $162,000 a yearFull-timeExpandApply NowActive JobUpdated 3 months ago
apache spark kubernetes jobs in Chicago, IL
FEATURED BLOG POSTS
How to Utilize Keywords for Your Job Ads
Before we give you the scoop on how to utilize keywords in job ads, it would be helpful if we defined what keywords are and why they are important. In simple terms,
What Makes a Good Paid Time Off (PTO) Policy
The world of work has undergone some major transformation in recent years. From remote and flexible work to increased emphasis on employee benefits and wellbeing, companies nowadays have to be very intentional about their HR policies and how they approach talent acquisition.
Internal Recruiting: Benefits and 5 Internal Recruiting Methods to Consider
Internal and external recruiting are nearly the same thing. The biggest difference is where candidates are sourced. There are instances where external recruiting may be the best option. However, when you are presented with the opportunity to recruit internally, you should take full advantage of the different internal recruiting methods. Initially you will find that the hiring process gets a little bit easier. Then you'll notice all the other benefits that internal recruiting offers.
How to Answer the Interview Question: What is Your Communication Style?
As a job searcher, you probably have so many questions about job searching. However, once you've landed an interview, your excitement takes your questions to a whole new level. What will you wear? Will you know how to answer all the questions? Have you practiced giving nice firm handshakes?
What Makes a Company a Great Place to Work
After one too many after-hours emails, you’re on the hunt for a new gig. But what makes a company a great place to work? And how will you know when you find one? Finding a motivating, safe, and productive work environment is important for our mental and physical health. If you’re financially frustrated, creatively stuck, or just plain over it, it’s time to find a healthier workplace where you can flourish.
What Makes a Good Boss? The Top 12 Qualities & Attributes
Think back to the best boss you’ve ever had—does someone come to mind? We hope so! Okay, now think back to the worst boss you’ve ever had. I’m sure you can conjure up a few faces.
How Does Temp to Hire Work? Benefits, Concerns, & More
Whether you’re just starting out your career or are looking for the next opportunity, the job market has never been more burgeoning with opportunities. From flexible work options and freelancing gigs to seasonal and temp-to-hire work, people today are spoiled for choice when it comes to finding engaging and fulfilling work.