- UpvoteDownvoteShare Job
- Suggest Revision
Fluent in SQL in big data warehouse systems such as Snowflake, BigQuery, Databricks, etc. Internal knowledge of open source or related big data technologies. As a member of the Data Engineering - Business ETL team, you own the data warehouse and data pipelines that are used for financial and regulatory reporting.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
As we continue to expand, we are seeking an experienced Principal Data Engineer with expertise in data engineering and AI/ML. In this key role, you will take ownership of driving innovation and leading the technology strategy for modern data platforms across data warehouse, tooling, integrations, and AI/ML. You will collaborate with cross-functional leaders to deliver impactful data solutions that directly influence our business outcomes.
Full-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience deploying and maintaining pipelines (AWS, Docker, Airflow) and in engineering big-data solutions using technologies like Databricks, S3, and Spark. Feature Engineering and Optimization: Develop and maintain ETL pipelines using orchestration tools such as Airflow and Jenkins; deploy scalable streaming and batch data pipelines to support petabyte scale datasets.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Apache Hadoop or Apache Spark (for big data processing) Data Warehousing (e.g., AWS Redshift, Google BigQuery) Natural Language Processing (NLP) Tools and Frameworks (e.g., Hugging Face, AWS Comprehend Medical for extracting insights from clinical text data.
RemoteExpandApply NowActive JobUpdated 5 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Advanced skills in big data technologies like Hadoop, Hive, Sqoop, Python, Spark, Presto, Apache Zeppelin, Ranger, Kafka. Build scalable data pipelines for both real time and batch using best practices in data modeling, ETL/ELT processes utilizing various technologies such as Spark, Kafka, Python, Airflow, Glue, Elastic Search, Lambda, and EMR.
$190,300 a yearFull-timeExpandApply NowActive JobUpdated 19 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Our design and architecture draw inspiration from many state-of-the-art systems in the big data space, and we learned best practices from Druid, Scuba, Dremel, and other open-source projects (Apache Arrow, Apache IceBerg, etc.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Write pipelines for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL, Spark, AWS, and Azure ‘big data’ technologies.
Full-timeExpandApply NowActive JobUpdated 9 days ago - UpvoteDownvoteShare Job
- Suggest Revision
You have a deep understanding of the modern data landscape (e.g. Snowflake, Databricks, AWS, GCP, dbt) and have built or used API products. 3-5 years experience in Product Management, or in a data-centric role (e.g. data engineer, data scientist, data analyst) which requires similar skills.
$200,000 a yearFull-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong understanding of Registered Investment Advisors (RIA) structures, concepts, needs; key regulatory bodies, and how modern clearing, custody, and brokerage platforms fits into the capital market ecosystem.
$245,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Prior experience with modern data technologies stack such as Databricks, Airflow, etc. We are building and deploying edge software and cloud services for real-time customer facing products as well as internal big data tools.
ExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query) Expanding, scaling, and standardizing the core foundational principles through consistent observability, lineage, data quality, logging, and alerting across all engineering teams in the Data organization is imperative to the creation of a single pane of glass.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
A minimum of six years' experience in providing complex consultative services in the following focus areas: information strategy, big data architecture, information/data governance, master data management, data quality, data integration particularly in a life science or healthcare setting.
$325,800 a yearFull-timeExpandApply NowActive JobUpdated 15 days ago - UpvoteDownvoteShare Job
- Suggest Revision
The Department of Epidemiology and Biostatistics, University of California, San Francisco (UCSF) invites applications for a full-time ladder rank faculty position at the Associate or Full rank from applicants with deep expertise in the methods of contemporary quantitative epidemiology - including modern causal inference - and a strong interest and track record in methods education.
$297,200 a yearTemporaryExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Build intuitive and responsive user interfaces using modern JavaScript frameworks like React, Angular, or Vue.js. Frontend Technologies: Proficiency in HTML, CSS, and JavaScript, with experience using modern JavaScript frameworks such as React, Angular, or Vue.js.
Full-timeExpandApply NowActive JobUpdated 17 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with modern infrastructure tools, such as Docker, Kubernetes, Ansible, Cloud Formation, Terraform. Familiarity with the Bitcoin protocol and BTC infrastructure a big plus. 5+ years of programming experience with at least one modern compiled language such as Go, Rust, Java, or C.
ExpandApply NowActive JobUpdated 3 days ago
modern big data jobs Title: principal in San Francisco, CA
FEATURED BLOG POSTS
How to Pass a Personality Test with Flying Colors
Whether you’re applying for your first job or looking to move up the career ladder, personality tests aren’t usually the first thing we think about. But surprisingly, they can have a massive impact on how our future employers perceive us. In fact, a 2017 study by the Society for Human Resource Management (SHRM) has found that 32% of U.S. employers use personality tests when hiring for senior management positions, and 28% use them for middle management positions. Personality tests are also used for hourly workers and contractors, though less frequently.
Virtual Reality Job Interviews
With the advent of desktop computers, the arduous task of scouring through weekly job classifieds became a thing of the past. The mid-1990s brought about a new era where job seekers could easily search and apply for jobs online. The introduction of AOL's Instant Messaging feature provided an even faster means for employers and candidates to communicate and schedule interviews. As smartphones became more pervasive in the early 2000s, hiring managers increasingly used phone calls for screening and interviewing candidates. Despite this trend, over 80% of interviews still took place in person.
A Potential TikTok Ban?!
As you may already know, there has been a lot of talk lately about the possibility of a TikTok ban. While this has not yet come to fruition, it's important to consider the implications this could have for businesses and recruiters who rely on TikTok as a platform to market their brand, recruit new talent, and connect with their audience.
The Effects of Workplace Racism and Sexism
One day it's a covert statement to a mother returning to work after maternity leave. Another day it's a lingering gaze at an employee enjoying a culturally rich meal. These microaggressions (or sometimes macroaggressions) can take an employee from a confident, high-performer to one that feels insecure being themselves at work. Your employees engage with people with different ideas and feel most comfortable and valued when they can work without losing their cultural, racial, and gender identity. While most employers know this, why have workplace racism and sexism often been neglected?
How to Navigate Hiring Out of State
The job market has shifted significantly in recent years. The accelerated adoption of technology has not only pushed many companies into remote working arrangements but also increased the availability of supporting tools and technologies (i.e., video conferencing and collaboration software).
Building a Candidate Pipeline Through Internships
Building a candidate pipeline through a great internship program for local college students and recent graduates at local universities is a great and cost-effective way to attract and retain top talent. By offering meaningful and impactful work experiences, regular feedback, coaching, and mentorship, you can create a positive internship experience that will make your organization a sought-after destination for future employees. This not only benefits the organization in the short-term but also in the long-term, as you'll have a pool of well-trained and experienced candidates who may be interested in full-time employment once they graduate. Furthermore, building relationships with local universities and college students can increase brand awareness and build a positive reputation for your organization in the local community.