- UpvoteDownvoteShare Job
- Suggest Revision
Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. You demonstrate clear devotion to the data engineering best practices and meet the following qualifications (required):Bachelor’s Degree and 12+ years of prior relevant experience or Masters with 10+ years of prior relevant experienceMust possess an active TS security clearance and the ability to obtain and maintain a TS/SCI security designation with PolygraphExperience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expert in building data pipelines on Azure with skills Databricks spark, Azure Data factory, Azure data lake. Design and develop migration of data/ETL to Cloud(Azure) based services Experience with Python, Pyspark and writing complex SQL querys.
Full-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Data Integration Engineer -TS/SCI. Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Implement complex data operations using Python, Java, Spark, and SQL, optimizing ETL/ELT processes for performance and efficiency. This position involves leveraging advanced analytics tools to enhance the organization's analytics platform, collaborating with both business and technical teams to design data solutions that align with strategic goals, and implementing complex data operations with Python, Java, Spark, and SQL. Additionally, you'll manage data across various platforms using cloud services, big data technologies, and non-relational databases to ensure seamless data integration and accessibility.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
3+ years' experience of Data Storage/Big Data platform implementation, with a preference for hands-on experience in implementation and performance tuning Hadoop/Spark implementations. Monitor performance, troubleshoot and tune ETL processes as appropriate using tools like in the AWS ecosystem.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrated experience with cloud technologies used with ETL and big data pipelines such as Glue, EMR, HIVE, Spark, S3, SQS, and SNS. Experience deploying code in AWS utilizing solutions such as Terraform, Ansible, and CloudFormation.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Description: Our client is currently seeking a Data Integration Engineer. Ensure data integrity by performing employing data engineering best practices. This is a hybrid position based out of Bethesda, MD (2-3 days a week on-site.
$170,000 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
3+ years experience in one or more big data technology : S3, HDFS, Spark, Presto, etc. Experience designing and implementing ETL pipelines to support Data Science and/or Machine Learning.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Ensure data integrity by employing data engineering best practices. Must possess an active TS security clearance and the ability to obtain and maintain a TS/SCI security designation with Polygraph. Are you ready to join Leidos all-star team.
$183,300 a yearFull-timeExpandApply NowActive JobUpdated 12 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Implement complex data operations using Python, Java, Spark, and SQL, optimizing ETL/ELT processes for performance and efficiency across diverse data types. Implement complex data operations using Python, Java, Spark, and SQL, optimizing ETL/ELT processes for performance and efficiency across diverse data types.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
An understanding of big data engineering tools and how they can be used strategically (e.g. Spark, Hive, Hadoop, Dask)." Experience in testing data validation scenarios and Data ingestion, pipelines, and transformation processes (e.g.,ETL.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Perform ETL processes to convert data into various target formats (e.g., text, SQL, Parquet, CSV, MDF, IRIS). Experience with Microsoft SQL Server, Oracle, Mongo, Azure Data Bricks, Varigence BimlStudio, Azure Data Lake, Azure Data Factory, Spark etc.
RemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
A candidate with distributed computer understanding and experience with SQL, Spark, ETL. 4+ years of experience developing data pipelines using modern Big Data ETL technologies like NiFi or StreamSets.
Full-timeExpandApply NowActive JobUpdated 14 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of Big Data systems, including Hadoop, HDFS, Hive, or Cloudera. Experience in using DoD Data Management to manipulate and integrate databases with SQL, SAS, or other languages. Daily operational support of the Collibra application, metadata import schedules, and overall operating model implementation Test and Perform application upgrades.
Full-timeRemoteExpandApply NowActive JobUpdated 6+ months ago - UpvoteDownvoteShare Job
- Suggest Revision
We are in search of a highly motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Mclean, VA Must have: 5+ years of experience with Python, SQL, Airflow, Spark, AWS (EMR, Lambda) Nice to have: Scala, Snowflake The candidate will be collaborating with other engineers and following the Agile Methodology.
ExpandApply NowActive JobUpdated Today
spark etl jobs in Glen Echo, MD
FEATURED BLOG POSTS
Hiring Taking Too Long?
We all know one of the biggest downfalls of a successful recruiting and hiring process is the amount of time it takes to hire someone. The time it takes to hire is sometimes completely out of line with applicant's expectations, creating a huge gap between candidates and businesses. Meanwhile, most recruiters and hiring managers don't even notice that they're taking too long. They have been fighting the symptoms of a too-long-hiring process without addressing the problem at the root. Here, we will expose some of those symptoms and offer solutions to help shorten your hiring process.
Explore Your Skill and Find the Best Way to Make Money From Home
When you just can’t stomach another drive-thru coffee on your morning commute, close your navigation app on your phone and search for easy ways to make money from home instead. With a computer and some niche skills, there are countless opportunities for you to earn a living from your couch. (Okay, fine, your home office.) Below, we’ll explore 30 different ways to make money from home, as well as a few “too-good-too-be-true" warning signs to know to keep you from booking the wrong remote gig.
5 Common Interview Mistakes
Everyone's interview process is unique in some form or fashion. Like most, your interview process is crafted so you can get the most information out of your candidates to increase hiring confidence and make the right hiring decisions. However, there are often small problems in interview processes that could ultimately affect the success of hiring decisions.
How to Ask Someone to be a Reference + Email Templates
One part of the job-hunting process that frequently gets overlooked is putting together a list of good references. Most of the time we focus on creating the perfect resume, writing an awesome cover letter, and getting our hands on letters of recommendation. We think about what outfit we’ll wear to the job interview, how we’ll answer those tricky questions, and what our career plan looks like. But, in fact, having multiple references lined up who will speak favorably about you to a potential employer is critical to landing a job. This aspect of job searching really can’t be ignored.
Job Rejection Email Response with Examples
Glassdoor estimates that, on average, there are about 250 applicants for every job vacancy out there. If you’ve ever applied for a job, the odds are that you’ve received the dreaded job rejection email.
How to Calculate Net Income
Understanding your finances can be daunting even if you’re good with numbers. Your net income, in particular, is a key metric for determining how well you’re doing financially and whether your current way of operating is sustainable or not.
6 Best Ways to End a Cover Letter with Examples
Including a cover letter with your resume is a great way to introduce yourself to the hiring manager, tell them why you’re the ideal fit for the role, and provide context about your personal situation. A strong cover letter will give you an advantage over other applicants. But it’s important that you structure it properly and write it powerfully so that it carries an impact. This article will discuss how to end a cover letter effectively so you catch the eye of a hiring manager and increase your odds of landing an interview. Read on to learn more.