{"schemaVersion":"jobsearcher.job.v1","id":"d324ec30485ca6c2abc89429","url":"https://jobsearcher.com/jobs/d324ec30485ca6c2abc89429","canonicalUrl":"https://jobsearcher.com/jobs/d324ec30485ca6c2abc89429","title":"IT Data Quality Developer","description":"Hi,Hope you are doing well.We have the below requirement with my client, please let me know if you are looking for a job.Job Title : Data Engineer Ab initioLocation : Berkeley Height, NJLong Term ContractJob Description:We are seeking a highly skilled resource to design and implement high-performance, event-driven data pipelines, ensuring low-latency data processing and high availability system for the large credit card processing system. The ideal candidate will work with the Ab Initio ecosystem (GDE, EME, Conduct> It) to build stateful services that ingest, filter, and transform data from sources like Kafka or message queues, pushing updates to dashboards or downstream databases in near-real-time.Key Responsibilities:Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.Implement event-driven data pipelines using Kafka, MQ, and file streams.Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee \"exactly-once\" processing.Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance.Proactively monitor live production streams to ensure 24/7 reliability and troubleshooting data issuesDevelop ETL pipelines for batch and real-time data ingestion and transformation.Implement and ensure data validation, data security, integrity, and compliance across big data platforms.Monitor and troubleshoot performance issues in large-scale clusters.Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.Automate workflows and improve operational efficiency using scripting and orchestration tools.Required Skills & Qualifications:Deep understanding of credit card process systemDeep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta> Environment), Conduct> It, and Continuous Flows.Understanding of Kafka, message queues, and real-time stateful services.Proficiency in Unix/Linux shell scripting, SQL, and database technologies (e.g., Oracle, Teradata).Experience in Java , Scala, Python or Kafka is plus.Familiarity with Linux/Unix environments and shell scripting.Understanding of data security, governance, and compliance standards.Experience with cloud-based big data platformsExposure to containerization (Docker, Kubernetes) for big data workloads.Knowledge of CI/CD pipelines for data engineering projects.Behavioral Skills:Good Communication skills5 days' Work from Office at Berkley Heights, NJTeam PlayerAbility to work in a changing environmentStrong problem solving and analytical skillsAbility to work independently or within a teamManage day-to-day challenges and communicate developmental risks with the technical teamQualifications:Bachelor's degree in computer science, Software Engineering, or a related field.Proficiency in business process modeling and documentation tools.Product implementation experience is preferred","company":"Envision Technology Solutions","rawCompany":"envision technology solutions","city":"Berkeley Heights","state":"NJ","isRemote":false,"isActive":false,"createdAt":"2026-11-01T11:40:48.303Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1211.00","title":"Computer Systems Analysts","slug":"computer-systems-analysts"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"IT Data Quality Developer","description":"Hi,Hope you are doing well.We have the below requirement with my client, please let me know if you are looking for a job.Job Title : Data Engineer Ab initioLocation : Berkeley Height, NJLong Term ContractJob Description:We are seeking a highly skilled resource to design and implement high-performance, event-driven data pipelines, ensuring low-latency data processing and high availability system for the large credit card processing system. The ideal candidate will work with the Ab Initio ecosystem (GDE, EME, Conduct> It) to build stateful services that ingest, filter, and transform data from sources like Kafka or message queues, pushing updates to dashboards or downstream databases in near-real-time.Key Responsibilities:Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.Implement event-driven data pipelines using Kafka, MQ, and file streams.Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee \"exactly-once\" processing.Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance.Proactively monitor live production streams to ensure 24/7 reliability and troubleshooting data issuesDevelop ETL pipelines for batch and real-time data ingestion and transformation.Implement and ensure data validation, data security, integrity, and compliance across big data platforms.Monitor and troubleshoot performance issues in large-scale clusters.Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.Automate workflows and improve operational efficiency using scripting and orchestration tools.Required Skills & Qualifications:Deep understanding of credit card process systemDeep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta> Environment), Conduct> It, and Continuous Flows.Understanding of Kafka, message queues, and real-time stateful services.Proficiency in Unix/Linux shell scripting, SQL, and database technologies (e.g., Oracle, Teradata).Experience in Java , Scala, Python or Kafka is plus.Familiarity with Linux/Unix environments and shell scripting.Understanding of data security, governance, and compliance standards.Experience with cloud-based big data platformsExposure to containerization (Docker, Kubernetes) for big data workloads.Knowledge of CI/CD pipelines for data engineering projects.Behavioral Skills:Good Communication skills5 days' Work from Office at Berkley Heights, NJTeam PlayerAbility to work in a changing environmentStrong problem solving and analytical skillsAbility to work independently or within a teamManage day-to-day challenges and communicate developmental risks with the technical teamQualifications:Bachelor's degree in computer science, Software Engineering, or a related field.Proficiency in business process modeling and documentation tools.Product implementation experience is preferred","datePosted":"2026-11-01T11:40:48.303Z","dateModified":"2026-11-01T11:40:48.303Z","hiringOrganization":{"@type":"Organization","name":"Envision Technology Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Berkeley Heights","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"d324ec30485ca6c2abc89429"},"url":"https://jobsearcher.com/jobs/d324ec30485ca6c2abc89429"}}