- UpvoteDownvoteShare Job
- Suggest Revision
You will be working with all levels of technology from backend data processing technologies (Databricks/Apache Spark) to other Cloud computing technologies / Azure Data Platform.
RemoteExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Significant hands-on experience designing and implementing reusable frameworks using Apache Spark (PySpark preferred or Java/Scala). Analyze and define with product teams the data migration and data integration strategies.
$97,500 - $173,675 a yearExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
This architecture includes an Databricks, Microsoft Azure platform tools (including Data Lake, Synapse), Apache platform tools (including Hadoop, Hive, Impala, Spark, Sedona, Airflow) and data pipeline/ETL development tools (including Streamsets, Apache NiFi, Azure Data Factory.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The platform will be designed for District wide use and integration with other client Enterprise Data tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle databases and integration tools.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in designing and implementing ETL processes and data integration workflows using tools like Apache Airflow, Informatica, or Talend. Strong proficiency in programming languages such as Python, Java, or Scala, with expertise in data processing frameworks and libraries (e.g., Spark, Hadoop, SQL, etc.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Work with big data technologies like Azure Databricks, Apache Spark & Palantir. Experience with Data integration, data processing, data streaming, message queuing techniques.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
3+ years of Experience with Apache Spark, Kafka, Pig, Oozie, Flume, and Streaming and similar distributed computing technologies. Minimum of 10 years of experience in enterprise data architecture, including data requirements collection, data architecture analysis, evaluation, documentation, data modeling, design, development, model validation, and data integration.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with utilizing common data analytics tools in the Microsoft Azure environment such as Databricks, Apache Spark, or Microsoft Fabric (Synapse, Data Factory, and OneLake) is preferred.
Full-timeExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Must have experience with data analysis programming languages (e.g., SQL, Python & Apache Spark, SAS & R) Learn and demonstrate mastery across a wide variety of data engineering activities, including data warehousing, master data management, data cataloging, system integration, data streaming, data visualization, data analysis, and data ops.
Full-timeExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Minimum 2 years of experience with large-scale data processing platforms such as Spark, EMR, and/or HPC computing experience with e.g. Apache Aurora, Slurm. This role will lead solutioning and implementation of data and integration needs of digital & omni-channel platforms at BCBSMA This role will work closely with other technology partners to build highly available, scalable and distributed data platforms using open source frameworks to process high volume, high velocity, and wide variety of structured and unstructured data.
ExpandApply NowActive JobUpdated 10 days ago - UpvoteDownvoteShare Job
- Suggest Revision
3+ years of experience working in large-scale data integration and analytics projects, including using cloud (e.g. AWS Redshift, S3, EC2, Glue, Kinesis, EMR) and data-orchestration (e.g. Oozie, Apache Airflow) technologies.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Tech stack: React / C# / Azure / Apache Spark / Delta Lake / Unity Catalog / Databricks. These include, but are not limited to 1) the establishing of a Production environment in Databricks, 2) the orchestration of Unity Catalog for future state and scalability of data, 3) contextualized MLops/MLflow expertise and implementation, 4) additional silver and gold layer transformations relevant to business needs for data science, BI tools, Web App integration, etc.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The Data Solution Architect must have familiarity with traditional data technologies (Data Warehouse, Data Lake) as well as transformative capabilities such as Data Lakehouse, Data Fabric, and Data Mesh in order to define go-forward strategies which are compliant for US Govt clients – including addressing Federal Cloud security requirements, data privacy, data security, and data integration approaches which are approved for US Govt use.
$123,000 - $231,000 a yearFull-timeExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data warehousing and ETL tools like Apache Spark, Apache Hadoop, or AWS Glue. Familiarity with cloud computing platforms like AWS, Azure, or Google Cloud. Key OutcomesHolistic Data Integration: Efficiently extract and integrate varied data sources, from mainstream platforms like NetSuite and Salesforce to unique data from our high-throughput labs and manufacturing sensors.
ExpandApply NowActive JobUpdated 4 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of message queuing technologies such as Kafka, Azure Service Bus, and stream data integration technologies or stream analytics technologies such as Apache Kafka KSQL, Spark Streaming and others.
ExpandApply NowActive JobUpdated 4 days ago
apache spark data integration jobs
FEATURED BLOG POSTS
How to Call Out of Work
No matter how happy we are with our jobs, there are days when we feel overwhelmed and want to call out of work. No, don't feel guilty. It's expected because we're humans, and we can't control the uncertainties of life. But the problem lies in how to call out of work without seeming uncommitted to work, especially if you seldom get work-free days.
What is Seasonal Employment?
Depending on where you are in your career, you might have first-hand experience with seasonal employment. Seasonal employment can be a great way to expand your skill set and earn extra cash while helping businesses meet seasonal increases in demand.
How to Avoid a Bad Hire
"A new employee who doesn't meet the minimum performance, quality, and culture fit standards you set when you began sourcing and recruiting. Additionally, bad hires will immediately show signs of self-interest instead of an interest in their role and the company."
How to Ask for a Letter of Recommendation
When the job board you subscribe to finally posts your dream job, you may feel like the stars have aligned. But part of securing a position that matches your career plan is ensuring you address all the application basics. You know, the resume, the cover letter, the portfolio. It seems like you've got this in the bag — until you realize they want a letter of recommendation, too!
16 Tech Jobs You can Get Without a College Degree
You might think that if you don’t have a computer science, information technology, or related degree, then there’s absolutely no way you can break into the technology field and score a high-paying tech job. But this is a misconception. There are actually tons of tech jobs out there that don’t require a college degree. Instead, employers are more interested in the skills that you can offer. So, read on to learn more about how to land tech jobs without a degree.
What Are SMART Goals?
When it comes to achieving our goals, there’s a lot of noise to work through. A study by the University of Scranton has found that only 8% of people who set New Year’s resolutions actually achieve them. Our busy lives might be one reason for this. Another, even more important reason, is our approach to goal setting. Being too vague, too ambitious or simply unclear on the timeframe can set us up for failure.
In-House vs Outsourcing Recruiting: Which is Better?
When looking at in-house vs outsourcing recruiting, it is important to nail down the benefits for each and whether those benefits outweigh the risks that follow.