Selected Indicators of Effect Size in Psychological Research

Arkadiusz Prajzner

Abstract


Reflecting the changing statistical practice in psychological research, dominated by null hypothesis testing using a decision about the level of significance of the results, the recommendations are indicated for reporting effect sizes in papers. The study presents the concept of the effect size and indicates its place in data analysis regarding to outcome’s significance. The purpose of the work is to describe selected effect size indicators and to point the need of use and their proper presentation and interpretation in social sciences empirical work data analysis reports. Considering statistical analysis approach limits based on significance level only, the study presents the possibility of including in the data analysis an indicator of a more practical use which is the size of the effect. By using the most popular analysis methods, such as, Student t-test, univariate analyses of variance in between- and within-group schemes as well as Wilcoxon test, Mann-Whitney’s U, Kruskal-Wallis H, Friedman’s test and considering analysis for qualitative data, matched to research plans indicators of the effect size were presented. The paper presents the use, calculation and interpretation of the size effect such as: Cohen’s d, Hedges g, delta, Glass’s rg, matched pairs correlation rc, eta-square, omega-square and epsilon-square, Kendall’s W and fi, Cramer’s V as well as odds ratio and relative risk. The presentation of the effect size indicators was contrasted with the corresponding research plans and the type of data collected.


Keywords


effect size; null hypothesis; statistical analysis; psychological research

Full Text:

PDF (Język Polski)

References


LITERATURA

American Psychology Association (APA). (1994). Publication Manual of the American Psychology Association (4th ed.). Washington: Author.

American Psychology Association (APA). (2020). Publication Manual of the American Psychology Association (7th ed.). Washington: Author.

Baguley, T. (2009). Standardized or Simple Effect Size: What Should Be Reported? British Journal of Psychology, 100(3), 603–617. DOI: 10.1348/000712608X377117

Bosco, F.A., Aguinis, H., Singh, K., Pierce, C.A. (2015). Correlational Effect Size Benchmarks. Journal of Applied Psychology, 100(2), 431–439. DOI: 10.1037/a0038047

Brzeziński, J.M. (2021). Testy istotności różnic i wskaźniki wielkości efektu ES – wybrane zagadnienia. W: Metodologia badań psychologicznych (s. 205–234). Warszawa: Wydawnictwo Naukowe PWN.

Cohen, J. (1988). Statistical Power: Analysis for the Behavioral Sciences. Hillsdale: Lawrence Erlbaum Associates.

Cypryańska, M., Bedyńska, S. (2013). Testy t-Studenta i ich nieparametryczne odpowiedniki. W: S. Bedyńska, M. Cypryańska (red.), Statystyczny drogowskaz 1. Praktyczne wprowadzenie do wnioskowania statystycznego (s. 159–193). Warszawa: Wydawnictwo Akademickie Sedno.

Ferguson, C.J. (2009). An Effect Size: A Guide for Clinicians and Researchers. Professional Psychology: Research and Practice, 40(5), 532–538. DOI: 10.1037/a0015808

Field, A. (2013). Discovering Statistics Using IBM SPSS. Thousand Oaks: Sage.

Fritz, C.O., Morris, P.E., Richler, J.J. (2012). Effect Size Estimates: Current Use, Calculations and Interpretation. Journal of Experimental Psychology: General, 141(1), 2–18. DOI: 10.1037/a0024338

Grissom, R.J., Kim, J.J. (2011). Effect Sizes for Research: Univariate and Multivariate Applications. New York: Routledge, Taylor and Francis Group. DOI: 10.4324/9780203803233

Henson, K. (2016). Effect-Size Measures and Meta-Analytics Thinking in Counseling Psychology Research. Counseling Psychology, 34(5), 601–629. DOI: 10.1177/00110005283558

King, B.M., Minium, E.W. (2020). Statystyka dla psychologów i pedagogów. Warszawa: Wydawnictwo Naukowe PWN.

Kirk, R.E. (2001). Promoting Good Statistical Practices: Some Suggestions. Educational and Psychological Measurement, 61(2), 213–218. DOI: 10.1177/00131640121971185

Kühberger, A., Fritz, A., Scherndl, T. (2014). Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size. PLoS ONE, 9(9), 1–8. DOI: 10.1371/journal.pone.0105825

Lourel, M., Gueguen, N., Pascaul, A., Mouda, F. (2011). The Effect-Size: A Simple Methodology for Determining and Evaluating the “Effect-Size”. Psychology, 2(6), 631–632. DOI: 10.4236/psych.2011.26096

Olejnik, S., Algina, J. (2000). Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations. Contemporary Educational Psychology, 25(3), 241–286. DOI: 10.1006/ceps.2000.1040

Olejnik, S., Algina, J. (2003). Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs. Psychological Methods, 8(4), 434–447. DOI: 10.1037/1082-989X.8.4.434

Pek, J., Flora, D.B. (2018). Reporting Effect Size in Original Psychological Research: A Discussion and Tutorial. Psychological Methods, 23(2), 208–225. DOI: 10.1037/met0000126

Rosenthal, R., Rosnow, R.L., Rubin, D.B. (2000). Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach. Cambridge: Cambridge University Press. DOI: 10.1017/CBO9780511804403

Rosnow, R.L., Rosenhtal, R. (2003). Effect Size for Experimenting Psychologists. Canadian journal of Experimental Psychology, 57(3), 221–237. DOI: 10.1037/h0087427

Sawilowsky, S.S. (2009). New Effect Size Rules of Thumb. Journal of Modern Applied Statistical Methods, 8(2), 597–599. DOI: 10.22237/jmasm/1257035100

Sullivan, G.M., Feinn, R. (2012). Using Effect Size – or Why the p Value Is Not Enough. Journal of Graduate Medical Education, 4(3), 279–282. DOI: 10.4300/JGME-D-12-00156.1

Sun, S., Pan, W., Wang, L.L. (2010). A Comprehensive Review of Effect Size Reporting and Interpreting Practice in Academic Journals in Education and Psychology. Journal of Educational Psychology, 102(4), 989–1004. DOI: 10.1037/a0019507

Vacha-Haase, T., Thompson, B. (2004). How to Estimate and Interpret Various Effect Sizes. Journal of Counseling Psychology, 51(4), 473–481. DOI: 10.1037/0022-0167.51.4.473

NETOGRAFIA

Coe, R. (12–14.09.2002). It’s the Effect Size, Stupid. British Educational Research Association Annual Conference, Exeter, Great Britain. Pobrane z: https://f.hubspotusercontent30.net/hubfs/5191137/attachments/ebe/ESguide.pdf




DOI: http://dx.doi.org/10.17951/j.2022.35.4.139-157
Date of publication: 2023-02-27 15:39:08
Date of submission: 2022-02-19 19:01:52


Statistics


Total abstract view - 554
Downloads (from 2020-06-17) - PDF (Język Polski) - 2576

Indicators



Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Arkadiusz Prajzner

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.