{"schemaVersion":"jobsearcher.job.v1","id":"00a69e4c60850cb026758330","url":"https://jobsearcher.com/jobs/00a69e4c60850cb026758330","canonicalUrl":"https://jobsearcher.com/jobs/00a69e4c60850cb026758330","title":"Gmail & Google Calendar AI Assistant Evaluator","description":"Role Title:\nGmail & Google Calendar AI Assistant Evaluator\nRole Type:\nContractor, Remote\nLocation:\nUnited States only\nmicro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life - email, calendars, bookings, and coordination - to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.\nKey Responsibilities:\n\nComplete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.\nGive an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.\nApply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.\nTest scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.\nUtilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.\nCollaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.\nParticipate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.\n\nRequired Skills and Qualifications:\n\nAre based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.\nDaily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.\nRegular experience coordinating with others over email or text - setting up meetups, following up on threads, or confirming shared plans and payments.\nComfort booking things online independently, such as restaurants, appointments, travel, or deliveries.\nExperience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.\nExceptional attention to detail and accuracy when reviewing AI-generated output.\nStrong written communication skills for clear reporting and timely updates on progress and challenges.\nDemonstrated time management and self-organization for independent, remote project participation.\n\nPreferred Qualifications:\n\nPrior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.\nFamiliarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.\nExperience grading or reviewing AI outputs for accuracy, helpfulness, and safety.\n\n#J-18808-Ljbffr","company":"Micro","rawCompany":"micro1","city":"Eastern","state":"KY","isRemote":false,"isActive":false,"createdAt":"2026-10-10T05:16:01.543Z","occupations":[{"code":"43-6011.00","title":"Executive Secretaries and Executive Administrative Assistants","slug":"executive-secretaries-and-executive-administrative-assistants"},{"code":"43-6014.00","title":"Secretaries and Administrative Assistants, Except Legal, Medical, and Executive","slug":"secretaries-and-administrative-assistants-except-legal-medical-and-executive"},{"code":"13-1161.00","title":"Market Research Analysts and Marketing Specialists","slug":"market-research-analysts-and-marketing-specialists"}],"industries":[{"code":"561320","title":"Temporary Help Services","slug":"temporary-help-services"},{"code":"541990","title":"All Other Professional, Scientific, and Technical Services","slug":"all-other-professional-scientific-and-technical-services"},{"code":"541690","title":"Other Scientific and Technical Consulting Services","slug":"other-scientific-and-technical-consulting-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Gmail & Google Calendar AI Assistant Evaluator","description":"Role Title:\nGmail & Google Calendar AI Assistant Evaluator\nRole Type:\nContractor, Remote\nLocation:\nUnited States only\nmicro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life - email, calendars, bookings, and coordination - to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.\nKey Responsibilities:\n\nComplete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.\nGive an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.\nApply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.\nTest scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.\nUtilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.\nCollaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.\nParticipate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.\n\nRequired Skills and Qualifications:\n\nAre based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.\nDaily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.\nRegular experience coordinating with others over email or text - setting up meetups, following up on threads, or confirming shared plans and payments.\nComfort booking things online independently, such as restaurants, appointments, travel, or deliveries.\nExperience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.\nExceptional attention to detail and accuracy when reviewing AI-generated output.\nStrong written communication skills for clear reporting and timely updates on progress and challenges.\nDemonstrated time management and self-organization for independent, remote project participation.\n\nPreferred Qualifications:\n\nPrior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.\nFamiliarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.\nExperience grading or reviewing AI outputs for accuracy, helpfulness, and safety.\n\n#J-18808-Ljbffr","datePosted":"2026-10-10T05:16:01.543Z","dateModified":"2026-10-10T05:16:01.543Z","hiringOrganization":{"@type":"Organization","name":"Micro","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Eastern","addressRegion":"KY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"00a69e4c60850cb026758330"},"url":"https://jobsearcher.com/jobs/00a69e4c60850cb026758330"}}