-
evaluation of good research practice
-
evaluation of research integrity and credibility in social, and behavioral sciences, specifically psychology
-
evaluation of questionable research and/or measurement practices (QRP & QMP)
-
evaluation of content & construct validation in educational, social, and personality research on all three phases according to APA, AERA, and NCME
Guiding principle in terms of usage of automated inference statistics like LLMs (a subcategory of AI/ML) :
“If generative AI tools generate inappropriate language, plagiarized content, biased content, errors, mistakes, incorrect references, or misleading content, and that output is included in scientific works, it is the responsibility of the author(s). We have recently clarified our penalties for this. If a submission contains incontrovertible evidence that the authors did not check the results of LLM generation, this means we can’t trust anything in the paper.” Thomas G. Dietterich (arXiv), 2026
Guiding principle in terms of conclusions:
“Bias can be formally defined as the unequal correspondence between the domain of observations and the universe of generalization.” Van de Vijver & Poortinga, 2005