{"schemaVersion":"jobsearcher.job.v1","id":"0c9df429cb00a6625881af83","url":"https://jobsearcher.com/jobs/0c9df429cb00a6625881af83","canonicalUrl":"https://jobsearcher.com/jobs/0c9df429cb00a6625881af83","title":"Ab Initio Data Engineer","description":"Required Qualifications \r \r Bachelor’s degree in Computer Science, Engineering, or related technical field. \r 7+ years of ETL development experience with 5+ years of hands-on experience in Ab Initio development. \r Strong expertise with:\r \r Ab Initio GDE (Graphical Development Environment) \r Co>Operating System (Co>Op) \r Enterprise Meta>Environment (EME) \r Conduct>It \r Data Profiler and Continuous Flows \r \r \r Strong understanding of parallel processing concepts, partitioning strategies, and Multi-File System (MFS). \r Advanced SQL skills with experience in relational databases, especially DB2. \r Strong experience with Unix/Linux shell scripting. \r Solid understanding of data warehousing concepts:\r \r Dimensional modeling \r Slowly Changing Dimensions (SCD) \r Star and Snowflake schemas \r \r \r Experience designing and implementing Kafka-based data pipelines. \r Strong debugging, troubleshooting, and performance tuning skills for large-volume data processing. \r \r Preferred Qualifications \r \r Experience with mainframe data integration: COBOL copybooks, VSAM, Flat files \r Exposure to Kubernetes or OpenShift environments. \r Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures. \r Experience with API-based integrations and streaming data solutions. \r Prior experience as a technical lead or in client-facing architecture roles. \r \r Roles and Responsibilities \r \r Design, develop, and maintain complex ETL workflows and graphs using Ab Initio GDE. \r Architect end-to-end data integration solutions across multiple source and target systems including: RDBMS, Mainframe systems, Flat files, Message queues, Streaming platforms \r Optimize Ab Initio graph performance through: Parallelism, Partitioning techniques (Hash, Broadcast, Range), Layout optimization, Checkpointing strategies \r Develop and manage solutions using Ab Initio components including Co>Op, EME, Conduct>It, Data Profiler, and Continuous Flows. \r Implement CDC (Change Data Capture) and near-real-time data processing pipelines. \r Manage metadata, lineage, and data governance activities within EME. \r Troubleshoot production issues, perform root-cause analysis, and implement permanent fixes. \r Define development standards, review ETL code, and enforce Ab Initio best practices. \r Mentor junior and mid-level Ab Initio developers. \r Collaborate with data architects, DBAs, and business teams to translate requirements into technical solutions.","company":"Pb Consulting","rawCompany":"pb consulting","city":"Middlesex","state":"NJ","isRemote":false,"isActive":true,"createdAt":"2026-08-13T23:21:08.383Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Ab Initio Data Engineer","description":"Required Qualifications \r \r Bachelor’s degree in Computer Science, Engineering, or related technical field. \r 7+ years of ETL development experience with 5+ years of hands-on experience in Ab Initio development. \r Strong expertise with:\r \r Ab Initio GDE (Graphical Development Environment) \r Co>Operating System (Co>Op) \r Enterprise Meta>Environment (EME) \r Conduct>It \r Data Profiler and Continuous Flows \r \r \r Strong understanding of parallel processing concepts, partitioning strategies, and Multi-File System (MFS). \r Advanced SQL skills with experience in relational databases, especially DB2. \r Strong experience with Unix/Linux shell scripting. \r Solid understanding of data warehousing concepts:\r \r Dimensional modeling \r Slowly Changing Dimensions (SCD) \r Star and Snowflake schemas \r \r \r Experience designing and implementing Kafka-based data pipelines. \r Strong debugging, troubleshooting, and performance tuning skills for large-volume data processing. \r \r Preferred Qualifications \r \r Experience with mainframe data integration: COBOL copybooks, VSAM, Flat files \r Exposure to Kubernetes or OpenShift environments. \r Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures. \r Experience with API-based integrations and streaming data solutions. \r Prior experience as a technical lead or in client-facing architecture roles. \r \r Roles and Responsibilities \r \r Design, develop, and maintain complex ETL workflows and graphs using Ab Initio GDE. \r Architect end-to-end data integration solutions across multiple source and target systems including: RDBMS, Mainframe systems, Flat files, Message queues, Streaming platforms \r Optimize Ab Initio graph performance through: Parallelism, Partitioning techniques (Hash, Broadcast, Range), Layout optimization, Checkpointing strategies \r Develop and manage solutions using Ab Initio components including Co>Op, EME, Conduct>It, Data Profiler, and Continuous Flows. \r Implement CDC (Change Data Capture) and near-real-time data processing pipelines. \r Manage metadata, lineage, and data governance activities within EME. \r Troubleshoot production issues, perform root-cause analysis, and implement permanent fixes. \r Define development standards, review ETL code, and enforce Ab Initio best practices. \r Mentor junior and mid-level Ab Initio developers. \r Collaborate with data architects, DBAs, and business teams to translate requirements into technical solutions.","datePosted":"2026-08-13T23:21:08.383Z","dateModified":"2026-08-13T23:21:08.383Z","hiringOrganization":{"@type":"Organization","name":"Pb Consulting","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Middlesex","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0c9df429cb00a6625881af83"},"url":"https://jobsearcher.com/jobs/0c9df429cb00a6625881af83"}}