<Back to Search
Legal Subject Matter Expert (SME)
Orlando, FLApril 4th, 2026
Legal Subject Matter Expert (SME) – Quality Review & AI EvaluationLocation: Remote (must be able to support PST hours)Duration: 3 months with possibility to extendHours: ranging from 40-70 hours/week depending on business needs Our Client is looking for their next Legal SME! Responsibilities Incoming Data Quality Control (QC)Review tasks and rubrics to confirm they meet campaign standards (complexity,feasibility, completeness, clarity) and legal-domain standards (e.g., correctterminology, workflow realism, appropriate constraints, reasonable deliverableexpectations).Ensure tasks do not require inaccessible systems or privileged information(unless explicitly permitted).Validate legal realism: proper framing (jurisdiction/context), reasonableassumptions, appropriate deliverable types (memos, issue spotting, drafting,research outlines, etc.).Identify and correct common legal-domain failure patterns (missing jurisdiction,overbroad prompts, impossible deadlines, unclear client goals).Provide actionable feedback and track resolution.Data Collection Process MonitoringMonitor campaign health and throughput (submission volume, rework rates,bottlenecks, common failure modes).Proactively flag blocked contributors/reviewers, recurring quality issues, oremerging drift from guidelines.Surface systematic issues to Frontier Evals leads and propose concretemitigations (rubric tweaks, examples, quick clarifications).Maintain lightweight QC logs/audit trails to support retrospectives anddownstream analysis.Contributor Support and CoordinationAnswer contributor questions to improve first-pass quality and reduce iterationcycles.Coordinate with reviewers on edge cases and escalate ambiguous decisionsquickly.Produce weekly (or ad hoc) summaries: quality themes, top issue categories, andrecommended guideline updates.Technical Work (light)Run simple Python scripts and SQL queries, spot anomalies, and supportworkflow optimization or automation (you can use ChatGPT!)Additional tasks (as needed)Draft/update legal-specific examples, checklists, and “good vs. bad” task patterns.Participate in QA sweeps for high-risk segments and new task templates.Assist tagging/categorization for analysis.Qualifications / profile3+ years in legal field, including legal opsStrong attention to detail and comfort applying rubrics consistently.Able to write clear feedback that improves quality quickly.Comfortable with spreadsheets; basic SQL/Python helpful but not required
218 matching similar jobs near Orlando, FL
- Legal Counsel, NA
- Legal Counsel, NA
- Civil Litigation AttorneyOrlando, FLApril 4th, 2026
- Legal Support Coordinator
- Associate AttorneyOrlando, FLApril 4th, 2026
- Family Law AttorneyOrlando, FLApril 2nd, 2026
- Associate Attorney
- Commercial Litigation Attorney
- Employment Law / Education Law Attorney
- Attorney - General Liability - Hybrid or Fully Remote - Prominent Regional Law Firm
- Pediatrician, Developmental
- NP / Medical Director / Florida / Locum tenens / Medical Director in Orlando, FL
- Insurance Defense Attorney
- Commercial Underwriting Counsel Attorney - Hybrid (Orlando)
- Conflicts Attorney
- 2037 - Staff Attorney
- Real Estate Associate
- Reference Librarian & Assistant Professor of Law Library
- Senior Real Estate Paralegal
- Civil Litigation Defense Associate AttorneyOrlando, FLApril 4th, 2026
- Physician Assistant / Not Specified / Florida / Permanent / Physician Assistant Studies - Faculty
- Physician / Neurology / Florida / Permanent / Vascular Neurology Physician Faculty Job Kissimmee, FL
- Real Estate Associate
- Speech Language Pathologist - SLP - Rehabilitation
- Assistant/Associate Professor of Law
- Assistant City Attorney I/II/III (Real Estate)
- Paralegal
- Counsel
- Trademark Attorney
- Mauro Schnaidman named as Managing Director in Miami, Florida
- Physician Assistant Studies - Nonclincal
- Litigation Attorney- 3572569
- Attorney
- Litigation Attorney (ID# 4973)
- Litigation Attorney
- DWTSurge Patent Attorney (Remote)
- Associate AttorneyOrlando, FLApril 3rd, 2026
- Associate AttorneyOrlando, FLApril 3rd, 2026
- Family Law Attorney
- Commercial Litigation & General Liability Defense Attorney - to $275kOrlando, FLApril 3rd, 2026