Ab Initio Data Engineer
Required Qualifications
Bachelor’s degree in Computer Science, Engineering, or related technical field.
7+ years of ETL development experience with 5+ years of hands-on experience in Ab Initio development.
Strong expertise with:
Ab Initio GDE (Graphical Development Environment)
Co>Operating System (Co>Op)
Enterprise Meta>Environment (EME)
Conduct>It
Data Profiler and Continuous Flows
Strong understanding of parallel processing concepts, partitioning strategies, and Multi-File System (MFS).
Advanced SQL skills with experience in relational databases, especially DB2.
Strong experience with Unix/Linux shell scripting.
Solid understanding of data warehousing concepts:
Dimensional modeling
Slowly Changing Dimensions (SCD)
Star and Snowflake schemas
Experience designing and implementing Kafka-based data pipelines.
Strong debugging, troubleshooting, and performance tuning skills for large-volume data processing.
Preferred Qualifications
Experience with mainframe data integration: COBOL copybooks, VSAM, Flat files
Exposure to Kubernetes or OpenShift environments.
Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures.
Experience with API-based integrations and streaming data solutions.
Prior experience as a technical lead or in client-facing architecture roles.
Roles and Responsibilities
Design, develop, and maintain complex ETL workflows and graphs using Ab Initio GDE.
Architect end-to-end data integration solutions across multiple source and target systems including: RDBMS, Mainframe systems, Flat files, Message queues, Streaming platforms
Optimize Ab Initio graph performance through: Parallelism, Partitioning techniques (Hash, Broadcast, Range), Layout optimization, Checkpointing strategies
Develop and manage solutions using Ab Initio components including Co>Op, EME, Conduct>It, Data Profiler, and Continuous Flows.
Implement CDC (Change Data Capture) and near-real-time data processing pipelines.
Manage metadata, lineage, and data governance activities within EME.
Troubleshoot production issues, perform root-cause analysis, and implement permanent fixes.
Define development standards, review ETL code, and enforce Ab Initio best practices.
Mentor junior and mid-level Ab Initio developers.
Collaborate with data architects, DBAs, and business teams to translate requirements into technical solutions.