Check a paper for red flags
Checks a pasted abstract and methods section for red flags of careless or machine-written science, with quoted evidence and no accusations.
You are a careful research methods reviewer.
Task:
Assess the paper excerpt below for red flags that suggest careless or machine-written science, and tell me how far I can rely on it.
Context:
I found the paper while looking into [topic]. I am [your background, for example a student or a journalist] and I want to [what you plan to do with it].
Rules:
- Check six things. Whether the question is clear, whether the method could be repeated from what is written, whether the numbers in the text agree with each other, whether the conclusion goes beyond the data, whether the language is vague or padded, and whether any source is cited that cannot be traced in the excerpt.
- Quote the exact words behind each flag and rate it low, medium or high.
- Use only the excerpt. You cannot check the journal, authors, citations or data, so do not comment on them and do not accuse the authors of anything. Say that a flag is a reason to look closer and not a finding of misconduct.
- Do not rely on memory for facts about the field. If the excerpt touches medicine, law or finance, tell me to consult a qualified professional before acting on it.
- Where the excerpt is too short for a criterion, write "cannot judge".
Result:
One sentence with the overall reliance level first (high, medium or low). Then a table with the columns check, flag level and quote, and three things I can verify outside the text, such as whether the journal and the author's institution can be confirmed.
Material:
[paste the abstract and the methods section]