- UpvoteDownvoteShare Job
- Suggest Revision
Graduate-level degree in computer science, engineering, or relevant work experience Preferred: Understanding of ML frameworks (sklearn, TensorFlow, PyTorch, etc) Experience working with big data platforms (Hadoop, Redshift, Snowflake, etc) Architecture, design patterns, production scaling/optimization Insurance industry experience Salary range: $132,500-$197,500 Overtime eligible: Exempt Discretionary bonus eligible: Yes Sales bonus eligible: No.
$197,500ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Knowledge of data integration and ETL tools like Apache Nifi, Talend, Informatica, or Apache Airflow for orchestrating data workflows and ensuring data quality ‘ Expertise in big data technologies such as Hadoop, Spark, Kafka, and Hive for processing and analyzing large datasets.
$150,000 a yearFull-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
And we are looking for people like you to help us translate big data into big ideas. 3 years of experience with Amazon Web Services (AWS) – EC2, S3, CloudFormation Moderately experienced in: Bash, Chef, Powershell, Python, XML, Web concepts such as REST APIs and SPA, HTTP Get and Post Skilled with Development tools and methodologies, such as XML config files, Rest API calls, HTTP Headers and Response Codes Proven experience and understanding with Continuous Integration/Deployment Technologies: Atlassian Bamboo, Octopus Deploy, MSBuild, NUnit, GIT, Maven, Docker.
Full-timeExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
Proficiency in PySpark , Apache Spark , and related big data technologies for data processing and integration. Familiarity with data streaming platforms (e.g., Kafka , Kinesis ) and big data technologies (e.g., Hadoop , Hive , HBase ) is a plus.
ExpandApply NowActive JobUpdated Today - UpvoteDownvoteShare Job
- Suggest Revision
We are looking for Senior Ab Initio Solutions Engineer to be able to design and build Ab Initio-based solutions across Data Integration, Governance & Quality domains for our customer programs.
$120,000 a yearFull-timeExpandApply NowActive JobUpdated 13 days ago - UpvoteDownvoteShare Job
- Suggest Revision
We are in need of QA Engineers with Python for data testing (ETL, Streaming, MDM, etc) and CI/CD Integration (bamboo) experience. ETL tester, someone with solid skills in handling big data sets.
$50 an hourFull-timeExpandApply NowActive JobUpdated 8 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with big data technologies (Spark, Clickhouse, Redshift, Snowflake etc.) As a senior data engineer, you bring your previous industry experience in infrastructure scaling to Jerry and lead the development of a new infrastructure solution that will continue to perform with great stability and efficiency even when the company grows 10x bigger.
Full-timeRemoteExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Data Maestro Director : Direct the development of complex data models to accurately mirror critical business processes, ensuring seamless integration with our comprehensive data architecture, including Big Data frameworks like Spark.
$160,000 a yearFull-timeExpandApply NowActive JobUpdated 1 month ago - UpvoteDownvoteShare Job
- Suggest Revision
Strong awareness of data tools and platforms like: Starburst, Snowflakes, Data Bricks, Trino, Ab Initio, Talend, Big Data and programming languages like SQL, R, Python, Shell Scripting.
$213,480 a yearFull-timeExpandApply NowActive JobUpdated 25 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Mentor and guide data engineering teams in the adoption and integration of observability practices. Expert knowledge of data pipeline architectures, data warehousing, big data technologies, and cloud services.
$220,000 a yearFull-timeExpandApply NowActive JobUpdated 7 days ago - UpvoteDownvoteShare Job
- Suggest Revision
As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, data integration processes, and data infrastructure using Dataiku.
Full-timeExpandApply NowActive JobUpdated 2 months ago - UpvoteDownvoteShare Job
- Suggest Revision
Experience with Apache Spark for big data processing. Data Integration and ETL: Develop and manage data integration processes, including ETL (Extract, Transform, Load) workflows using SQL, Python, and Spark.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Expert knowledge of data integration and ETL tools (e.g., dbt, Apache NiFi, Talend, Informatica, Azure Data Factory, Prefect). Strong familiarity with big data technologies (e.g., Hadoop, Spark, Kafka, Delta Lake, Iceberg, Arrow, Data Fusion.
$314,000 a yearFull-timeExpandApply NowActive JobUpdated Yesterday - UpvoteDownvoteShare Job
- Suggest Revision
Exhibit a solid understanding of database design, data warehousing concepts, big data platforms, and ETL operations. Creating data processing and integration solutions for both batch and real-time scenarios, proficiently handling structured and unstructured data.
ExpandApply NowActive JobUpdated 3 days ago - UpvoteDownvoteShare Job
- Suggest Revision
Comprehensive knowledge of big data technologies such as Apache Hadoop, Hive, Sqoop, Kafka, and Spark. Design architecture for data integration pipelines, ensuring efficient extraction, transformation, and loading of data from diverse sources using Spark, SQL, and other technologies.
ExpandApply NowActive JobUpdated 3 days ago
big data integration jobs Title: engineer in New York, NY
FEATURED BLOG POSTS
A Comprehensive Guide to Becoming a Better Conversationalist
Have you ever stood awkwardly next to someone at a party because you didn’t know what to say to them? How about at a networking event or on a first date? You're not alone if you’ve ever experienced this uncomfortable silence. Many people struggle to master the art of being a great conversationalist.
Why is Non-Verbal Communication Really Important?
In a world where words and phrases rule daily communication, you may wonder why non-verbal communication is important. Whether you realize it or not, you communicate more with nonverbal actions than you do with verbal communication. When you interact with your peers, people are reading your body language, facial expressions, voice, and many other factors that help fill in blanks that words can't fill.
Making Hybrid Work More Efficient
Covid was a catalyst for change in the work environment. Keeping people safe and helathy was the initial goal for employers, but the unintended result was the considerable demand in remote work. Now, onsite work has been dramatically altered to remote work, which is now transforming into a combination of the two: hybrid work.
How Can HR Technology Help Retain Employees?
Human resources' rapid adoption of technology has led to new ways of streamlining human capital management. Based on the IEE Global Study, these technologies changed how HR handled recruitment and retention in 2022. This includes tech like
Why is Time Management Important? 10 Crucial Importances of Time Management
We’ve all been there before. What starts as a relaxing evening scroll quickly becomes a full-blown binge. You blink, and it’s midnight - throwing off your entire next day before it even starts. And at its worst, this indulgence might leave you feeling behind on things you planned to finish that night. This is why time management is important.
Minimizing Candidate Renegs During the Hiring and Onboarding Process
Candidates reneging on job offers or during the onboarding process can be a frustrating experience for any recruiter. In a talent-driven job market, it’s common for candidates to have more than one job offer to consider. It becomes a race against time to see which organization can offer the best career experience, compensation, and circumstances that secure the right employees.
10 Reasons to Be on Time at Work
Being punctual at work may not be something you’ve given much thought to, but it’s the foundation for building a successful career. All of your technical or job-specific skills will be in vain if your peers and superiors can’t trust you to show up on time and do the work. In fact, Simon Sinek once famously said that