- UpvoteDownvoteShare Job
- Suggest Revision
7+ years expertise in big data ecosystem for data integration, data storage, compute framework, analytics, and advanced visualization (i.e., ETL Tools, Streaming Tools, No-SQL data bases, Spark, Airflow, ELT tools like DBT, Reporting Tools, AI/ML Platforms.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
We are in search of a highly motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Mclean, VA Must have: 5+ years of experience with Python, SQL, Airflow, Spark, AWS (EMR, Lambda) Nice to have: Scala, Snowflake The candidate will be collaborating with other engineers and following the Agile Methodology.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Your expertise in ETL, DataBricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupiter Notebooks will be essential in ensuring efficient data processing and analysis. - High level of proficiency in ETL processes and demonstrated hands-on experience with technologies such as DataBricks, Python, Spark, Scala, JavaScript/ JSON, SQL, and Jupyter Notebooks.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Experience working streaming applications (Spark Streaming, Flink, Kafka, or equivalent.
Full-timeRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with developing and deploying ETL pipelines using Apache Spark. Experience with distributed computing, such as Apache Spark and/or Databricks. Experience in SQL and/or Spark SQL.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
4+ years of professional software development within at least one of the following Java, Spark, Scala, Python. Experience programming languages like Python, Scala, Spark, Java. Strong working knowledge of SQL and the ability to write, debug and optimize SQL queries and ETL jobs to reduce the execution window or reduce resource utilization.
$236,500Full-timeRemoteExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. You demonstrate clear devotion to the data engineering best practices and meet the following qualifications (required):Bachelor’s Degree and 12+ years of prior relevant experience or Masters with 10+ years of prior relevant experienceMust possess an active TS security clearance and the ability to obtain and maintain a TS/SCI security designation with PolygraphExperience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
This position requires to implement complex data operations using Python, Java, Spark, and SQL, optimizing ETL/ELT processes for performance and efficiency across diverse data types. We have an immediate opening for a Sr Data Engineer to design, develop, and maintain scalable ETL data pipelines for batch and streaming data, handling both structured and unstructured formats effectively.
$75 an hourFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Perform ETL processes to convert data into various target formats (e.g., text, SQL, Parquet, CSV, MDF, IRIS). Experience with Microsoft SQL Server, Oracle, Mongo, Azure Data Bricks, Varigence BimlStudio, Azure Data Lake, Azure Data Factory, Spark etc.
RemoteExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
A candidate with distributed computer understanding and experience with SQL, Spark, ETL. 4+ years of experience developing data pipelines using modern Big Data ETL technologies like NiFi or StreamSets.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
5+ years of experience developing scalable ETL and ELT workflows using Apache Spark, Apache Airflow, or Apache Flink. 5+ years of experience with Distributed data and computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka.
Full-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks. Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Full-timeExpandApply NowActive JobUpdated 15 days ago - UpvoteDownvoteShare Job
- Suggest Revision
This architecture includes Databricks, Microsoft Azure platform tools (including Data Lake and Synapse), Apache platform tools (including Hadoop, Hive, Impala, Spark, Sedona, and Airflow), and data pipeline/ETL development tools (including Streamsets, Apache NiFi, Azure Data Factory.
$141,000 a yearExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Advance experience with developing Data Pipeline, ETL/ELT, utilizing tooling of Big Data Platform, Datalake, Synapse, Airflow, AirByte, Snowflake. Experience with Data Ingestion/ streaming tooling such as ADF (Azure Data Factory), Kafka, Five Tran, Spark, or similar technologies.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
Full-timeExpandApply NowActive JobUpdated 8 days ago
spark etl jobs in Bethesda, MD
FEATURED BLOG POSTS
5 Common Interview Mistakes
Everyone's interview process is unique in some form or fashion. Like most, your interview process is crafted so you can get the most information out of your candidates to increase hiring confidence and make the right hiring decisions. However, there are often small problems in interview processes that could ultimately affect the success of hiring decisions.
What is Employment Participation Rate
According to economists, there are four factors of production that go into creating higher quality goods at lower prices. These are
How to Get Pay Stubs (From Previous Employee Also!)
Pay stubs are an important piece of document which shows your earnings in a given period, as well as any deductions made towards your health insurance or pension contributions. They’re also excellent for finding out how much your recent salary raise has bumped up your monthly net income.
How to Write a Job Description?
It might be tempting to overlook the importance of a well-written job description. After all, if you’ve posted job ads before and ended up with tons of resumes in hand, it’s easy to assume that this will always be the case, regardless of how your job ad reads. But, in reality, you really can’t take getting an influx of resumes for granted.
How to Get a W2 From Previous Employers
When tax time rolls around, the last thing you want to worry about is having to track down a W-2 from your former employer. Many times you won’t have to because the IRS requires companies to send these forms to all current and former employees who have earned more than $600 in the last year. Unfortunately, there are employers who don’t do what they’re supposed to. There are even times where something else may happen that prevents the W-2 from getting where it’s supposed to go.
How to Ask Someone to be a Reference + Email Templates
One part of the job-hunting process that frequently gets overlooked is putting together a list of good references. Most of the time we focus on creating the perfect resume, writing an awesome cover letter, and getting our hands on letters of recommendation. We think about what outfit we’ll wear to the job interview, how we’ll answer those tricky questions, and what our career plan looks like. But, in fact, having multiple references lined up who will speak favorably about you to a potential employer is critical to landing a job. This aspect of job searching really can’t be ignored.
Job Rejection Email Response with Examples
Glassdoor estimates that, on average, there are about 250 applicants for every job vacancy out there. If you’ve ever applied for a job, the odds are that you’ve received the dreaded job rejection email.