Mars

Slack is looking for a staff software engineer to join the Data Ingestion Team. As part of the Data Engineering organization, we build and operate the platform that ingests data from various sources into our Data Warehouse with both streaming and batch approaches.. Currently, our infrastructure handles 65PB+ of storage, processes ~900B records a day, 400+ data pipelines and 900+ Active Airflow DAGs. As Slack’s data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient ingestion platform leveraging modern Streaming and Lakehouse technologies.. 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Iceberg, Hudi, Delta, Kafka/Kafka Connect, Flink, Spark Streaming or equivalent. You have good experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3, etc.. You are skilled at crafting and building robust distributed microservices with tools like Docker, Kubernetes, AWS ECS/EKS, Terraform, etc.

staff software engineer

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
Job Category
Software Engineering Job Details
About Salesforce
We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.
Slack is looking for a staff software engineer to join the Data Ingestion Team. As part of the Data Engineering organization, we build and operate the platform that ingests data from various sources into our Data Warehouse with both streaming and batch approaches. Currently, our infrastructure handles 65PB+ of storage, processes ~900B records a day, 400+ data pipelines and 900+ Active Airflow DAGs. As Slack’s data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient ingestion platform leveraging modern Streaming and Lakehouse technologies.
As a Staff Engineer, you will play a key role in driving our streaming and lakehouse strategies while also building highly scalable services and tools to help our customers acquire large volumes of high quality data at scale and making customer’s interactions with the ingested data pleasant and productive. You will have deep technical skills, be a self-starter, detail and quality oriented, and passionate about driving data driven decisions and having a huge impact at Slack! Here are a few blog posts that shed light into what we do here at Slack:
Data Lineage at Slack
Reliably Upgrading Apache Airflow at Slack's Scale
Introducing Data Residency for Slack
Data Wrangling At Slack
What you will be doing Design and develop highly scalable and resilient streaming services for ingesting and processing structured and unstructured datasets
Design and implement Slack’s Lakehouse solutions and enable production use cases for customers
Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration).
Improve the data quality and reliability of the pipelines through properly monitoring and alerting.
Comfortably collaborate with cross functional partners and lead technical initiatives independently end to end.
Be a role model and a multiplier, coaching and mentoring other engineers across the org.
Write, review, or provide feedback on a technical design proposal from others.
What you should have 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Iceberg, Hudi, Delta, Kafka/Kafka Connect, Flink, Spark Streaming or equivalent
You are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala or Go
You have good experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3, etc.
You are skilled at crafting and building robust distributed microservices with tools like Docker, Kubernetes, AWS ECS/EKS, Terraform, etc.
You have strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests.
You have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders
You have high growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them
Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience
Accommodations
If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form .
Posting Statement
At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at www.equality.com and explore our company benefits at www.salesforcebenefits.com .
Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce .
Salesforce welcomes all.
For Colorado-based roles, the base salary hiring range for this position is $175,600 to $254,700. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, benefits. More details about our company benefits can be found at the following link: https://www.salesforcebenefits.com.
#J-18808-Ljbffr

START NEW SEARCH