Revision changes the question
Generated writing can be edited in many ways. A person might rewrite a conclusion, change the structure, or use a paraphrasing tool. Those processes should not be treated as one uniform category.
Describe the transformation
An evaluation should identify the starting documents and the editing process applied to them. Distinguish light changes from substantive rewriting.
Compare results across those groups, and include human-written work that has gone through similar editing tools.
Keep interpretation grounded
A result is most useful when its limitations are clear. Read it alongside the writing, its history, and the explanation of the person who produced it.
Editorial preview for the Proof5 design prototype.