My research interests focus on three inter-related topics related to Open Science and Meta-Science: forensic meta-science, the meta-science of measurement, and more general Open Science topics such as replications and Questionable Research Practices.

The below lists both recent publications and current projects in various stages of development. Prospective students or postdocs should be aware that this page may not always be up to date, but should nontheless be useful to determining a fit between our interests.

1. Forensic meta-science

1.1. Error detection

ERЯOR: A bug-bounty program for science

1.2. Forensic meta-science method and tool development

“Forensic Meta-Science in Psychology” Slack group

I run the Slack group “Forensic Meta-Science in Psychology”, which is one of several groups for sleuths. This group has a particular focus on psychology, tool development, and is orientated towards encouraging Early Career Researcher involvement. Contact me with your relevant interests and experience if would like to join.

Granularity-based testing via GRIM & GRIMMER

  • I drafted the GRIM & GRIMMER guide for the Collection of Open Science Integrity Guides (COSIG, see https://cosig/net).
  • Our lab support’s the hosting of Lukas Jung’s excellent Shiny web app and R package {scrutiny}, see https://errors.shinyapps.io/scrutiny.

Bounds-based testing via TIDES

Intuitiions for the plausibility of effect-sizes

Detecting errors in correlation tables: Positive-definiteness Of r Tables (PORT)

1.3. Instances of forensic meta-science

Critiques of original research articles

Critiques of meta-analyses

  • Hussey, I. (2025). Verification report: A critical reanalysis of Vahey et al. (2015) “A meta-analysis of criterion effects for the Implicit Relational Assessment Procedure (IRAP) in the clinical domain”. Behavior Therapy* *and Experimental Psychiatry. https://doi.org/10.1016/j.jbtep.2024.102015
  • Alsalti, T., Hussey, I., Elson, M., Krause, R., & Pohl, S. (2025, under review). A Methodological Evaluation of Meta-Analyses in tDCS-Motor Learning Research. https://doi.org/10.1101/2024.07.26.24311068

Pubpeer comments

2. Meta-science of measurement

2.1. Psychology: the science of behavior?

Psychology’s self-image is that we are the science of behavior, but Baumeister et al. (2007) argued that we collect measurements of actual behavior with increasing rarity, undermining this self-image. This project defines different modes of measurement in psychology and examines trends over time. Stage 1 Registered Report under review at PCI: Registered Reports

  • Norwood, S. F., Elson, M., & Hussey, I. (2025, under review). Psychology: The science of behavior? https://osf.io/ykw4s/

2.2. Evidence of wide-scale schmeasurement and fragmentation

  • Anvari, F., Alsalti, T., Oehler, L., Hussey, I., Elson, M., Arslan. R.C. (2025). A fragmented field: Construct and measure proliferation in psychology. Advances in Methods and Practices in Psychological Science. https://osf.io/preprints/psyarxiv/b4muj
  • Anvari, F., Alsalti, T., Oehler, L., Hussey, I., Elson, M., Arslan. R.C. (2025). Defragmenting psychology. Nature Human Behaviour. https://doi.org/10.1038/s41562-025-02138-0
  • Hussey, I., Alsalti, T., Bosco, F., Elson, M., Arslan, R. (2025). An aberrant abundance of Cronbach’s alpha values at .70. Advances in Methods and Practices in Psychological Science, 8(1). https://doi.org/10.1177/25152459241287123
  • Elson, M., Hussey, I., Alsalti, T., & Arslan, R. C. (2023). Psychological Measures Aren’t Toothbrushes. Communications Psychology. https://doi.org/10.1038/s44271-023-00026-9
  • Hussey, I. & Hughes, S. (2020). Hidden invalidity among 15 commonly used measures in Social and Personality psychology. Advances in Methods and Practices in Psychological Science. https://doi.org/10.1177/2515245919882903

2.3. Instances of schmeasurement

Measurement flexiblity in the Iowa Gambling Task: A meta-methods study

Aka “the Iowa Gambling task is actually dozens of different tasks in a trenchcoat”. Project nearly ready for pre-printing.

Item-content overlap analyses

Fried’s (2016) compared the overlap in the symptoms measured by common depression scales. Some of my current students run item-content overlap studies in other domains, including suicidal ideation and Alcohol Use Disorder.

The Implicit Association Test has poor individual-level utility

The Implicit Relational Assessment Procedure is a poor measure

  • http://irapresearch.org
    • If you get a dangerous site warning you can ignore it; I can’t seem to get https configured and google sometimes flags it.
  • Hussey, I., & Drake, C. E. (2022). The Implicit Relational Assessment Procedure demonstrates poor internal consistency and test-retest reliability: A meta-analysis. https://psyarxiv.com/ge3k7
  • Hussey, I., & Drake, C. E. (2022). The IRAP is not very sensitive to the attitudes and learning histories it seeks to assess. https://psyarxiv.com/sp6jx
  • Hussey, I. (2022). The IRAP is not suitable for individual use due to very wide confidence intervals around D scores. https://psyarxiv.com/w2ygr
  • Hussey, I. (2023). Reply to Barnes-Holmes & Harte (2022) ‘The IRAP as a Measure of Implicit Cognition: A Case of Frankenstein’s Monster.’ https://psyarxiv.com/qmg6s
  • Hussey, I. (2023). The Implicit Relational Assessment Procedure’s trial-types are not independent. https://osf.io/preprints/psyarxiv/4gsxq

The Affect Misattribution Procedure is a poor measure

  • Hughes, S., Cummins, J., & Hussey, I. (2023). Effects on the Affect Misattribution Procedure are Strongly Moderated by Awareness. Behavior Research Methods, 1(29). https://doi.org/10.3758/s13428-022-01879-4
  • Hussey, I., & Cummins, J. (2022). Evidence against effects on the Affect Misattribution Procedure being unaware: AMP effects involve construct-irrelevant individual differences. https://psyarxiv.com/8k94v

3. Open Science, replications, etc.

3.1. Data sharing

3.2. Replications

  • Deming (Adam) Wang, Kai Qin Chan, Wakefield Morys-Carter, … Hussey, I., … & Martin Hagger. (2025, Stage 1 Accepted Registered Report). Multilab direct replication of: Wegner & Erber (1992) ‘The hyperaccessibility of suppressed thoughts’ and Wegner et al. (1987) ‘Paradoxical effects of thought suppression’. Advances in Methods and Practices in Psychological Science.
    • Data collection complete, manuscript in preparation
  • Röseler, L., Kaiser, L., Doetsch, C.A., Klett, K., Seida, C., … Hussey, I., … Zhang., Yikang. (2024) The Replication Database: Documenting the Replicability of Psychological Science. Journal of Open Psychology Data, 12(1). https://doi.org/10.5334/jopd.101
  • Kurdi, B., Hussey, I., Stahl, C., Hughes, S, Unkelbach, C., Ferguson, N, … (2022). Unaware attitude formation in the surveillance task? Revisiting the findings of Moran et al.(2021). International Review of Social Psychology, 35(1). https://doi.org/10.5334/irsp.546
  • Moran, T., Hughes, S., Hussey, I., Vadillo, M. A. Olson, M. A., Aust, F., Bading, K., Balas, R., Benedict, T., Corneille, O., Douglas, S. B., Ferguson, M. J., Fritzlen, K. A., Gast, A., Gawronski, B., Heycke, T., Högden, F., Hütter, M., Kurdi, B., Mierop, A., Richter, J., Sarzyńska, J., Smith, C. T., Stahl, C., Thomasius, P., Unkelbach, C., & De Houwer, J. (2021). Incidental Attitude Formation via the Surveillance Task: A Pre-Registered Replication of Olson and Fazio (2001). Psychological Science, 32(1). https://doi.org/10.1177/09567976209685

3.3. Sample sizes and power

  • Hussey, I. (2023). A systematic review of Null Hypothesis Significance Testing, sample sizes and statistical power in research using the Implicit Relational Assessment Procedure. Journal of Contextual Behavioral Science, 29, 86-97. https://doi.org/10.1016/j.jcbs.2023.06.008

3.4. p-hacking

  • Replication of Stefan & Schonbrödt’s ‘A compendium of p-hacking strategies’ (in progress)
  • Hussey, I. (2021). A method to streamline p-hacking. Meta Psychology, 5. https://doi.org/10.15626/MP.2020.2529