Establish what the displayed number is meant to represent
Depending on the provider, a percentage may describe estimated text coverage, probability, classification confidence or another proprietary measure. These concepts are not interchangeable. Without the product, version, date, input text, supported language, minimum length and documented settings, a bare score is difficult to reproduce or interpret responsibly.
The analysed state matters as well. A title page, bibliography, quotations, tables or appendices may have been included or excluded. A rerun after minor editing or a service update may produce a different output. Any serious discussion therefore needs the exact file and full report rather than a cropped image of one prominent number.
False positives and false negatives are part of classification
A classifier can label human writing as AI-generated and fail to identify AI-generated writing. Performance depends on the evaluation corpus, language, genre, length, model family, degree of editing and threshold. A broad promotional metric cannot simply be transferred to a short German methods paragraph or to writing by a multilingual student.
Published research has reported bias affecting non-native English writing. Other work explains why paraphrasing and editing can alter detection results. Such studies do not prove that a specific flag is wrong. They demonstrate why a score requires relevant validation and individual review before it can support a strong provenance claim.
The reverse inference is equally unsafe: a low score does not certify human authorship. Treating both error directions seriously means using a detector, at most, to frame specific questions rather than to automate an assessment decision.
A reviewable report needs more than a headline score
The record should identify provider, product, displayed version or access date, input file, analysed characters or sections, and exclusions. It should define the score and show passage-level output. Where threshold, supported language and limitations are documented, retain those details too.
Ask who generated the report and who examined the flagged passages. Were quotations, formulaic language, bibliographies and standard phrases considered? If multiple runs exist, preserve text states and results rather than selecting only the most dramatic one. A transparent report also distinguishes provider documentation from the reviewer’s later interpretation.
Process evidence addresses how the work actually developed
Detection infers a class from textual patterns. Drafts, version history, searches, annotations, commits, feedback and activity logs instead document events in the workflow. They may show when an argument emerged, which source was opened, how a paragraph changed or where a model suggestion was rejected.
Process traces also have limits. Version history does not necessarily identify the person at a device; timestamps can move; notes may be retrospective. Their value grows through clear provenance, passage-level linkage and agreement among independent records. The guide to using versions as evidence of your work explains that assessment in detail.
Seven questions that improve an evidence discussion
- How does the provider define this particular score?
- Which unchanged file and sections were analysed?
- Which product state, language and settings applied?
- Are the marked passages and complete report available?
- What validation actually matches the language, length and genre?
- What human passage-level review is documented?
- Which process records support, contradict or complicate the output?
The examination procedures hub connects these questions to other procedural tasks. Use the evidence inventory after an AI concern to protect existing records. This page has one foundation connection: academic writing and evidence.
Keep each report paired with the exact analysed file. A later edited version needs a new identifier and its own result. Otherwise a score produced for version A can easily be quoted as though it described version B. A recorded checksum, date and export route can support that narrow file-to-report connection when they were genuinely created and preserved.