Technical Certification Program Sr. Advisor
Overview
Senior Certification Exam Development Specialist (Psychometrician)
One Identity is an award-winning security software provider offering a broad selection of solutions that solve some of the most common and most challenging IT security problems. Part of the One Identity Software group, One Identity solutions eliminate the complexities and time-consuming processes often required to govern identities, manage privileged accounts and control access. Our solutions enhance business agility while addressing IAM challenges within on-premises, cloud and hybrid environments. The combined entity delivers a complete portfolio of market-leading Identity Access Management, Privileged Access Management, and Identity Governance solutions. Now, customers can achieve identity-centric security with trusted, proven technology in each major category.
We are seeking a certification exam development specialist with strong psychometric expertise to establish and maintain standards for our certification and credentialling program. This includes design, validate, and maintenance of certification exams for one identity's software solutions.
This role is responsible for translating product knowledge and instructional content into high-quality assessments that accurately measure a learner's understanding and ability to apply that knowledge. The focus is on creating exams that are rigorous, fair, and aligned to real-world product use.
This individual will partner closely with Product and instructional subject matter experts to ensure that assessments effectively validate the intended learning outcomes.
Responsibilities
Assessment Design and Development – Design and build certification exams that measure knowledge and applied understanding. Translate product functionality and instructional content into structured, testable assessment items. Develop exam blueprints aligned to defined learning objectives and job-relevant skills. Create and maintain item banks including multiple-choice, scenario-based, and case-based questions. Maintain consistency in the credentialing program across products.
Psychometric Quality and Rigor – Apply psychometric principles to ensure exams are valid, reliable, and fair. Define scoring models, passing thresholds, and exam structures. Conduct item analysis including difficulty, discrimination, and effectiveness of distractors. Continuously calibrate exams to address variability in perceived difficulty.
Curriculum Alignment (Non-Ownership Role) – Partner with Product and instructional SMEs to understand the intent and outcomes of training content. Ensure exams accurately reflect what learners are expected to know and apply. Identify and resolve gaps where exams are perceived as too easy, too difficult, or misaligned. Establish clear linkage between learning objectives, curriculum content, and exam coverage.
Lab-Based and Performance Assessment – Design and introduce hands-on, lab-based assessment components to validate real-world application. Define scenarios, tasks, and scoring criteria for performance-based testing. Collaborate with platform owners to integrate lab environments into certification exams. Ensure hands-on assessments are measurable, repeatable, and scalable.
Exam Lifecycle Management – Own the lifecycle of certification exams including creation, release, maintenance, and updates. Ensure exams remain current with product changes and evolving use cases. Manage versioning and periodic refresh of exam content.
Data Analysis and Continuous Improvement – Analyze exam performance data including pass rates, item performance, and learner outcomes. Identify trends related to exam difficulty and effectiveness. Use data to refine exam quality, consistency, and alignment. Provide insights to improve overall certification credibility and effectiveness.
Qualifications
5–10+ years of experience in assessment design, certification exam development, or psychometrics.
Strong understanding of psychometric principles including validity, reliability, and item analysis.
Experience developing technical or software-related certification exams.
Proven ability to translate complex technical content into clear, measurable assessment items.
Experience developing exam blueprints and structured item banks.
Strong collaboration skills when working with SMEs and product teams.
Preferred Qualifications
Background in enterprise software, cybersecurity, or infrastructure technologies.
Experience designing performance-based or hands-on assessments.
Experience with Lismus, Skytap, and Credly.
Familiarity with platforms such as Mindtickle, Skillable, CloudLabs, or Pearson VUE.
Benefits
Life at One Identity means collaborating with dedicated professionals with a passion for technology.
When we see something that could be improved, we get to work inventing the solution.
Our people demonstrate our winning culture through positive and meaningful relationships.
We invest in our people and offer a series of programs that enable them to pursue a career that fulfills their potential.
Our team members' health and wellness are our priority, as well as rewarding them for their hard work.
Equal Opportunity Employer
One Identity is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: One Identity is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at One Identity are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. One Identity will not tolerate discrimination or harassment based on any of these characteristics. One Identity encourages applicants of all ages.
J-18808-Ljbffr