- UpvoteDownvoteShare Job
- Suggest Revision
8+ years data engineering experience focused on Snowflake, Databricks, Kafka, AWS Glue, Airflow, and AWS services. Design and build data pipelines: Design, develop, and implement data pipelines using Kafka, Airflow, AWS Glue, Python, and Lambda functions to ingest, transform, and load data into Snowflake.
Full-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
3+ years' of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M). Experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. SnowFlake, Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience in operating a workload/workflow management system (e.g. Slurm, Apache Airflow/Beam/Flink) Experience with data storage and analytics systems (e.g. AWS RDS/DynamoDB, Elasticsearch, Databricks.
$150,000 - $215,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Use of tools like Apache Airflow, ADF, or Databricks to orchestrate and schedule data workflows. Use of tools like Apache Airflow, ADF, or Databricks to orchestrate and schedule data workflows.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Design and implement distributed data processing pipelines using Spark, Hive, Python, Airflow, and other tools and languages prevalent in the Hadoop ecosystem. Expert knowledge and experience in Databricks, Lake House, Structured Streaming, Kafka, Delta Lake, Delta Live table, Delta shareetc.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience in designing and implementing ETL processes using Databricks notebooks for efficient data extraction, transformation, and loading. In-depth knowledge of the Databricks Unified Analytics Platform and its features for collaborative big data analytics.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Develops and implements standards, and promotes their use throughout the warehouseDevelop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Airflow, Redshift, Databricks, EMR.Define and manage overall schedule and availability for a variety of data sets.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data processing technologies and tools, such as Spark, Hadoop(HDFS, Hive, MapReduce), Athena, Airflow, Luigi. Build big data processing pipelines using Spark and Airflow. A pioneer of the geo-location space, Foursquare's location tech stack is being utilized by our mobile apps CityGuide and Swarm, as well as the world's largest enterprises and most recognizable brands, like Amazon, Microsoft, Samsung, Spotify, Uber, Airbnb and others.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
In this role, you will help define and build the data tech stack including Snowflake, AWS Redshift, Databricks, Python, Scala, SQL, SparkSQL , Talend, Airflow, AWS Glue, Tableau, AWS Sagemaker.
$140,000 - $225,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Overall 5+ years of exp in the software industry Exp in developing architecture data applications using python or scala, Airflow, and Kafka on AWS Data platform Experience and expertise. You will be preferred if Expertise in Amazon EMR, Apache Airflow, Terraform, CloudWatch.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with DAG/workflow management tools like Apache Airflow. Knowledge of the UGC gaming market, e.g. Roblox and Unreal Editor for Fortnite. Experience with data visualization tools (Looker, Power BI, Tableau.
Full-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Build workflow DAGs and schedule jobs utilizing Airflow. Build robust, scalable data processing and data ingestion pipelines using Python, Kafka, Spark, REST API endpoints, and microservices to ingest data from a variety of external data sources to Snowflake.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
The ideal candidate has a strong software engineering background and problem-solving ability along with cloud computing (AWS) and data engineering skill set with prior experience on technologies such as Snowflake, Airflow, dbt, Kafka, Spark, Python, and Tableau.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Our work spans across a variety of datasets and Machine Learning models and across a diverse technology stack ranging from Spark, SageMaker, Airflow, DataBricks, Kubernetes, AWS and much more! Familiar with cloud services like AWS, Azure and workflow orchestration tools (e.g., Airflow.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with processes supporting data transformation, data structures, metadata, dependency and workload management (data pipeline orchestration, airflow, dbt core, gitlab scheduler, prefect.
ExpandApply NowActive JobUpdated Today
airflow job in Seattle, WA
FEATURED BLOG POSTS
Brand Reputation 101
People's initial perception of your organization is also known as your brand reputation. Your brand rep either encourages or discourages people from engaging with your company. This means the way people view your company will affect sales and even recruiting efforts.
Recruiting in a Tight Market
As a recruiter or employer, you know how much the economy affects your recruitment and retention efforts. You aren't just in competition with companies in your industry, but you are also fighting against inflation, recession, unemployment rates, and so much more.
How to Build a Candidate Persona
A candidate persona is a semi-fictional representation of your ideal candidate. Building a candidate persona is one of the best methods employers use to ensure their sourcing, recruiting, and hiring processes are focused. Knowing exactly what you're looking for streamlines everything and helps increase hiring confidence. So here's how to create a candidate persona and how to use it.
How to Get Into The Trades: Step-by-Step Guide
Getting a trade job can be a great career move if you like variety and prefer to learn on the job instead of in an academic setting. A trade job can offer security and be a lucrative career path as the demand for skilled trade workers continues to grow.
How do Good Interviewers Prepare for Interviews?
Just like candidates take the time to research you and your company, you should take the time to prepare for the interview. Preparing for the interview doesn't just reflect well on your employer brand and create a better candidate experience. Preparation also helps prevent bad hiring decisions. Bad hiring decisions are usually a result of poor execution during the hiring process. However, going into an interview fully prepared and ready to evaluate candidates will help avoid bad hires. So, here are 6 interview preparation tips for employers.
How to Get a Union Job? A Step-by-Step Guide
A union job can significantly impact your job security, pay, and employment benefits. Whether this is your first job or you have years of experience, a union job can offer much-needed protection in a labor market where employees are hired and fired at will.
Should I Hire for Potential Over Experience?
The workforce is shifting every day. In fact, research from the World Economic Forum (WEF) shows over half of employees around the world will need to upskill or reskill by 2025. The rapid rise of digital literacy, automation, and new technologies will quickly supersede businesses that don't train ahead of the curve. With the dire need to invest in training, it's evident that hiring someone with experience isn't that much different than hiring someone without it.