- UpvoteDownvoteShare Job
- Suggest Revision
Extensive knowledge of and experience with large-scale database technology (e.g. Databricks, Spark, Netezza, Oracle Exadata, Teradata, Greenplum, Google BigQuery, Amazon Redshift, Microsoft Synapse, etc.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
As a data engineer, you have experience spanning traditional DW and ETL architectures and big data ecosystems like Databricks / Snowflake / EMR / Airflow. Proficient in spark, sparkSQL and hiveSQLExperience working with Snowflake / Databricks or similar distributed compute systemsExcellent understanding of scheduling and workflow frameworks.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Must have experience with data analysis programming languages (e.g., SQL, Python & Apache Spark, SAS & R) Experience with ETL/Orchestration tools (e.g., Informatica, Autosys, and Airflow, etc.
Full-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data warehousing and ETL tools like Apache Spark, Apache Hadoop, or AWS Glue. Familiarity with cloud computing platforms like AWS, Azure, or Google Cloud. Technical Expertise: Deep familiarity with Python and SQL, as well as extensive experience in cloud-based data storage including, data lakes, data warehouses, and data lake houses warehousing; and ETL processes.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with data integrations and ETL tools (Airflow, Spark, etc.) Design, develop, and maintain scalable data pipelines and ETL processes to ingest process and store large volumes of structured and unstructured data.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
2+ years of demonstrated ability with Cloud Stack in AWS, Talend (Integration Tool), Snowflake (Cloud computing data storage and analytic service), Spark, etc. Able to do analysis and make code changes to the DataStage ETL, Java, Talend (Cloud), and Unix jobs.
ExpandApply NowActive JobUpdated 12 days ago - UpvoteDownvoteShare Job
- Suggest Revision
5+ years hands-on experience with the Big Data stack (HDFS, SPARK, MapReduce, Hadoop, Sqoop, Pig, Hive, Hbase, Flume, Kafka) Hands-on experience with ETL (Extract-Transform-Load) tools (e.g. Informatica, Talend, Pentaho.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake. · Develop and maintain ETL processes to ingest, transform, and load data from various sources into Databricks Delta Lake.
Full-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The ideal candidate is an experienced Data Engineer with background in ETL or ELT processing with SQL/NoSQL databases, a background in transforming existing tech to new open source technologies (ideally Postgres) as well as a strong development background in Spark, Scala, Java and/or Python.
ExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Net, API Management, ETL tools (e.g. Informatica, Azure Data Framework, Databricks), Spark (Scala/Python), CSS, HTML5, AngularJS, Maven, Java Spring, designing and implementation of SQL and NoSQL databases.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Experience working streaming applications (Spark Streaming, Flink, Kafka or equivalent.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Bachelor’s degree in computer science, Engineering, IT, Management Information Systems, or a related discipline Experience in Python and SQL Experience in ingesting data from a variety of structures including relational databases, Hadoop/Spark, cloud data sources, XML, JSON Experience in ETL concerning metadata management and data validation.
Full-timeExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience programming languages like Python, Scala, Spark, Java. Strong working knowledge of SQL and the ability to write, debug and optimize SQL queries and ETL jobs to reduce the execution window or reduce resource utilization.
ExpandApply NowActive JobUpdated 6 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Google Cloud DataFlow, Azure Data Factory, Spark, Spark Streaming, etc.
$99,000 - $148,000 a yearFull-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge in Apache Spark, and/or Databricks. You will help lead multiple agile sprints to support the execution of data management, data cataloging, and ETL/Data Conversion activities leading into building of a modernized Data Fabric and Platform that supports and feeds business benefits including automation, AI/ML, analytics, and data visualization efforts.
$123,000 - $231,000 a yearFull-timeExpandApply NowActive JobUpdated 6 days ago
spark etl jobs
FEATURED BLOG POSTS
How to Navigate Hiring Out of State
The job market has shifted significantly in recent years. The accelerated adoption of technology has not only pushed many companies into remote working arrangements but also increased the availability of supporting tools and technologies (i.e., video conferencing and collaboration software).
Building a Candidate Pipeline Through Internships
Building a candidate pipeline through a great internship program for local college students and recent graduates at local universities is a great and cost-effective way to attract and retain top talent. By offering meaningful and impactful work experiences, regular feedback, coaching, and mentorship, you can create a positive internship experience that will make your organization a sought-after destination for future employees. This not only benefits the organization in the short-term but also in the long-term, as you'll have a pool of well-trained and experienced candidates who may be interested in full-time employment once they graduate. Furthermore, building relationships with local universities and college students can increase brand awareness and build a positive reputation for your organization in the local community.
Hiring Transparency
Transparency in hiring refers to the open and honest communication and information sharing that takes place between employers and job candidates. It encompasses all aspects of the hiring process, from posting job descriptions to providing feedback on performance during and after the interview process. In today's job market, hiring transparency has become increasingly important for both employers and candidates alike.
Recruitment strategies that are weird, but actually work
In the current candidate-driven job market, recruiters are looking for unique ways to attract talent. Some have resorted to even (dare we say it?) recruitment strategies on the border of weird and wacky. What can we learn from the unusual recruitment tactics that are being used and actually getting results? Here’s a rundown of some unique recruitment strategies that actually work.
How To Make $100K a Year – No BS Strategies & Advice
If you’re like most of us, you’d love to be wealthier. Having more money would alleviate stress. It would make it easier to pay your bills and buy nicer things. Maybe it’d allow you to spend more time with your kids and go on more vacations. You’re not alone if you wish you could somehow earn a more significant income.
How to Write a Recommendation Letter for a Student
When a student applies for their first job or for their next academic degree, they don’t have much experience to showcase their skills and personal qualities. Hiring managers and admissions officers, therefore, often look at recommendation letters as a way to go beyond the student’s GPA and learn more about the student’s skills and personal qualities.
How To Answer “Why Do You Want to Be a Supervisor” in an Interview
Anyone who has worked in a supervisor role knows how challenging yet rewarding it is. But chances are if you're trying to become a supervisor, you'll be forced to answer: