- UpvoteDownvoteShare Job
- Suggest Revision
Architect and develop large-scale, distributed data processing pipelines using technologies like Apache Spark, Apache Beam, and Apache Airflow for orchestration. Proven expertise in Apache Spark, Apache Beam, and Airflow, with a deep understanding of distributed computing and data processing frameworks.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Python, Apache Airflow, Apache Spark, PostgreSQL, Presto SQL, Snowflake SQL, Confluence, JIRA. Utilize programming languages such as Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Amazon Web Services (Security Groups, Batch, Lambda, S3, ECS, EC2, ALB, RDS, IAM, SNS, Fargate, ElastiCache, Redis) At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
1+ years’ experience working with public cloud preferably Azure, Databricks, Docker, Kubernetes and real-time deployments. 2+ years’ experience with data orchestration workflow tools such as DBT, Airflow etc.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar. Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Working knowledge with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis. Collaborate with the rest of data engineering & architecture team to design and launch new features and services.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
For example, Flyte, Apache Airflow, Dagster, or Apache NiFi. · Demonstrated experience utilizing containerization technologies such as Docker, Podman, Kubernetes, or similar. For example, Flyte, Apache Airflow, Dagster, or Apache NiFi. · Demonstrated experience utilizing containerization technologies such as Docker, Podman, Kubernetes, or similar.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data and workflow management technologies like Hadoop, Spark, Redshift, Athena, Airflow, etc. Familiarly with services and tools like AWS, Kubernetes, Docker, Terraform, Concourse, Argo CD, etc.
$130,000 - $170,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data streaming technologies such as Hadoop, Spark, Kafka, and Airflow or AWS equivalent such as EMR, Glue, Lakehouse, etc. Experience with cloud-based solutions (AWS, GCP, Azure) and familiarity with containerization technologies (Docker, Kubernetes.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data engineering and data workflows using cloud-native solutions or tools, including Airflow, Luigi, or Prefect. 2+ years of experience in containerization and container orchestration platforms, including Docker and Kubernetes.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Ensuring the integrity of data backup and storage systems Monitoring security software and tools Responding to security or usability concerns quickly Comprehensive grasp of data warehouse design best practices for data modeling and ETL system design Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Virtualization and orchestration of applications (Docker/Kubernetes/ECS). Familiarity with Airflow and Python a plus. 6+ years of experience with any of the following databases: MongoDb, PostgreSQL (or any other relational database), Cloud Databases like BigQuery or BigTable.
$148,000 - $185,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
At least 6 years of experience in software engineering (Internship experience does not apply) Lead a portfolio of diverse technology projects and a team of developers with deep experience in full stack systems to create automation tools to support the Card Architecture team aligned with leading standards and practices including tooling solutions for Content Management, SDLC, DevOps, reporting, etc.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar. Knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. Lead Software Engineer, Full Stack (Java/AWS) Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC.
Part-timeExpandApply NowActive JobUpdated 5 days ago
airflow docker jobs in Mclean, VA
FEATURED BLOG POSTS
16 Tech Jobs You can Get Without a College Degree
You might think that if you don’t have a computer science, information technology, or related degree, then there’s absolutely no way you can break into the technology field and score a high-paying tech job. But this is a misconception. There are actually tons of tech jobs out there that don’t require a college degree. Instead, employers are more interested in the skills that you can offer. So, read on to learn more about how to land tech jobs without a degree.
What Are SMART Goals?
When it comes to achieving our goals, there’s a lot of noise to work through. A study by the University of Scranton has found that only 8% of people who set New Year’s resolutions actually achieve them. Our busy lives might be one reason for this. Another, even more important reason, is our approach to goal setting. Being too vague, too ambitious or simply unclear on the timeframe can set us up for failure.
How Long Do Background Checks Take for Pre-Employment
Many jobs require a background check. For some companies, this is a matter of company policy. In other jobs, such as finance, childcare, and security, the government often requires background checks. While there are varying levels of intensity, for most people, a background check is nothing to worry about. In fact, the biggest question is often how long does a background check take? Here’s what job seekers and applicants need to know about background checks before they apply to new jobs.
The Best Remote Jobs: Where & How to Find Them
The Covid-19 pandemic hasn’t been easy on any of us, but if there’s one silver lining, it’s the fact that remote work has grown in popularity because of it. Companies that previously weren’t open to their employees working remotely were suddenly forced into allowing it. Since then, they've realized that much of their workforce is happier and more productive. Naturally, this has led to more remote job openings, which is great if you’re interested in this type of position. Read on to learn more about the best remote jobs and where to find them.
In-House vs Outsourcing Recruiting: Which is Better?
When looking at in-house vs outsourcing recruiting, it is important to nail down the benefits for each and whether those benefits outweigh the risks that follow.
How to Write a Short Bio
First impressions can be tricky. When meeting someone in person, it’s likely you have an elevator speech. These short, practiced introductions can help you share more about who you are, what you do for work and other facts about you. While this works well in a live, in-person context, there are many cases where professionals “meet” someone via written form - like social media, a resume, or published work. In these cases, your bio works as your first impression. So, here’s a step-by-step guide on how to write a short bio.
How to Effectively Recruit Employees
Today, hiring and retaining talent looks much different than it did only two or three years ago. Financial instability and the strain on our mental health brought on by the pandemic has made everyone more wary and selective of their workplace and employer. Whereas in the past people might have prioritized promotions and financial reward, today they look at other factors such as workplace flexibility, personal fulfillment and values alignment.