- UpvoteDownvoteShare Job
- Suggest Revision
Oversee the design, development, and maintenance of data infrastructure using platforms like Snowflake, Adtran, Databricks, SQL, COSMOS DB, Apache Kafka, Hadoop, Spark, DBT (Data Build Tool) and cloud data services (AWS, GCP, Azure.
$230,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Proven experience with Databricks, Delta Lake, and Apache Spark. - Develop and optimize big data pipelines using Apache Spark ( Pyspark ) to handle large-scale data processing and analysis.
ExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Contemporary and innovative approach: Develop novel solutions using modern platforms (e.g., Cloud based platforms like Azure, AWS, GCP), languages/technologies (e.g., Python, Spark, SQL, DBT), Orchestration (ADF, Airflow, Dagster) and tools (e.g., Power BI), with an ability to build IP into reusable software.
Full-timeExpandApply NowActive JobUpdated 2 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience in Native Spark Migration to Databricks. Strong hands on in PySpark and Apache Spark. Implement Massive Parallel Processing Layers in Spark SQL and PySpark. Build CICD for Databricks in Azure Devops.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Expertise in Databricks (Delta Lake, Apache Spark, Unity Catalog), Snowflake, Azure (Data Factory, Blob), SQL, and Python. Create high performance data products by monetizing warehouse and ETL solutions using python, sql and spark.
$150,000 a yearFull-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Familiarity with additional data processing frameworks/tools like Apache Spark, dbt, or Kafka. - Data Processing: SQL, Apache Spark, dbt. Familiarity with additional data processing frameworks/tools like Apache Spark, dbt, or Kafka.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Tech stack includes Airflow, Spark, Databricks, Delta Lake, Snowflake, Scala, Python. Hands-on production environment experience with distributed processing systems such as Spark. Contribute to maintaining, updating, and expanding the existing Data Capture platform including the Spark data pipelines while maintaining strict uptime SLAs.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Must have: Spark, Python, SQL, AWS, Snowflake, Databricks, ETL, Datawarehouse. Ingestion Patterns & Data Quality enforcement techniques within Databricks, Spark and DLT. Deep experience with distributed computing with Spark with knowledge of Spark runtime internals & Spark Structured Streaming.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Provide technical excellence to apply state-of-the-art machine learning / artificial intelligence utilizing technologies such as Spark, R, Hadoop, Scala, SQL to real world infrastructure business problems.
ExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL. Experience with data processing frameworks and tools like Apache Spark (including Databricks), and Hadoop and knowledge of database technologies like SQL databases (e.g., MySQL, PostgreSQL.
$210,000 a yearFull-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Demonstrated experience in building, tuning data pipelines on Spark, Cloud native tools like Azure Data Factory, Databricks and ETL tools. More than 10+ years of relevant experience in data engineering tools like Azure Data pipelines , Azure Data factory, Azure Data Lake Storage, Databricks.
ExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Develops and maintains expertise in the use of a variety of statistical programming languages and software (such as R, Python, SAS, and SQL) and distributed computing software and databases (such as Apache Spark, DataBricks, PySpark, Greenplum, etc.
Full-timeExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Strong knowledge of Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib, as Databricks is built on Spark. Strong knowledge of Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib, as Databricks is built on Spark.
ExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift. Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
ExpandUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Experience with data technologies: e.g., Databricks, MapReduce, HDFS, Hive, Spark, Sqoop. Experience with streaming technologies: e.g., Kafka, Kafka Connect, Kinesis, Beam, Flink, Spark. Integrate data platform infrastructure with other systems fostering seamless collaboration among teams e.g. system integration with Fivetran, Monte Carlo, Salesforce Data Cloud, Tableau, Looker, Teradata, Bigquery.
$212,450 a yearFull-timeExpandUpdated Today
spark job in New York, NY
FEATURED BLOG POSTS
10 Best Tips to Find a Job When Relocating
Are you planning to move? That’s great news, but now you might wonder what that means for your job. Some people are lucky – they can relocate and keep working the same position as always, just remotely. For others, however, this isn’t an option. They must search for and land a job in their soon-to-be new city. This can be intimidating, given that getting a new job even under normal circumstances can be challenging. Now you’ll have to overcome additional hurdles. This article provides valuable tips on how to find a job in another state. Because it can be done! Read on to learn how.
How to Re-apply for Your Old Job Professionally
Have you recently started a new job only to find that you miss your old one? Maybe you didn’t realize how good you had it, and now you regret leaving. Don’t worry. You’re not the first person to feel this way, and you might even be able to return to your old job if you play your cards right.
Looking for New Candidates?
Before the turn of the century, recruiters could put their "help wanted" ads in the newspaper, and applications would pour in. Since then, recruiting has turned a new page. The use of the internet and other technologies allows recruiters to broaden their candidate pool for the simple reason being
Decline a Job Offer Professionally: When to Rescind
Your job search has finally paid off! After countless job applications, numerous emails, and several interviews, the hiring manager and other stakeholders have decided that you’re the right person for the job! All you have to do now is accept the offer and walk into the sunset, right?
Resume Job Description Samples - 8 Tips to Follow
When looking for a job, your resume becomes a crucial element. From making a great first impression to showcasing all your achievements and potential, your resume has to portray your professional story in minutes.
Internship Cover Letter Tips with Examples
Until now, college has been about learning, absorbing, and experiencing. It’s not until you become eligible for an internship that things start getting real—real-world experiences using real-life scenarios. Applying for internships takes time, and there’s no college course on “how to apply for jobs.” (We’d sign up immediately if there was, though!) But here's a spoiler alert: most internships require a cover letter. And while this may seem like a burden, it’s actually a blessing.
Tips to Get Your First Job Confidently
Whether you’re a recent graduate or you still have a few exams left, you may be itching to put your polished leather shoes on and join the workforce. After all, your first job is an entryway into the professional life you’d lead for the decades to come.