Is the Quality of Judging in Women Artistic Gymnastics Equivalent at Major Competitions of Different Levels?

• Authors: Maja Bučar Pajek , Ivan Čuk , Jernej Pajek , Marjeta Kovač , Bojan Leskošek
• Languages of publication: EN

Abstracts

EN

In the present study, the reliability and validity of judging at the European championship in Berlin 2011 were analysed and the results were compared to a different level gymnastic competition - Universiade 2009 in Belgrade. For reliability and consistency assessment, mean absolute judge deviation from final execution score, Cronbach’s alpha coefficient, intra-class correlations (ICC) and Armor’s theta coefficient were calculated. For validity assessment mean deviations of judges’ scores, Kendall’s coefficient of concordance W and ANOVA eta-squared values were used. For Berlin 2011 in general Cronbach’s alpha was above 0.95, minima of item-total correlations were above 0.8, and the ICC of average scores and Armor’s theta were above 0.94. Comparison with Universiade 2009 identified vault and floor scores at both competitions to have inferior reliability indices. At both competitions average deviations of judges from the final E score were close to zero (p=0.84) but Berlin 2011 competition showed a higher number of apparatuses with significant Kendall’s W (5 vs. 2 for Universiade 2009) and higher eta-squared values indicating higher judge panel bias in all-round and apparatus finals. In conclusion, the quality of judging was comparable at examined gymnastics competitions of different levels. Further work must be done to analyse the inferior results at vault and floor apparatuses.

Keywords

EN

aesthetic sports; sport statistics; evaluation; validity; bias

• Publisher: De Gruyter Open
• Journal: Journal of Human Kinetics
• Year: 2013
• Volume: 37
• Issue: 1
• Pages: 173-181

Dates

published

1 - 06 - 2013

online

05 - 07 - 2013

Contributors

author

Maja Bučar Pajek

• Faculty of Sport, University of Ljubljana, Gortanova 22, 1000 Ljubljana, Slovenia, Phone/mobile: + 386 41 794 658, Fax/Home Telefone: + 386 59 924 922

author

Ivan Čuk

• Faculty of Sport, University of Ljubljana, Gortanova 22, 1000 Ljubljana, Slovenia

author

Jernej Pajek

• University Medical Centre Ljubljana, Zaloška 2, 1525 Ljubljana, Slovenia

author

Marjeta Kovač

• Faculty of Sport, University of Ljubljana, Gortanova 22, 1000 Ljubljana, Slovenia

author

Bojan Leskošek

• Faculty of Sport, University of Ljubljana, Gortanova 22, 1000 Ljubljana, Slovenia

References

• Ansorge CJ, Scheer JK. International bias detected in judging gymnastic competition at the 1984 olympic games. Res Q Exercise Sport, 1988; 59: 103-107
• Ansorge CJ, Scheer JK, Laub J, Howard J. Bias in judging womens gymnastics induced by expectations of within-team order. Res Q, 1978; 49: 399-405
• Armor DJ. Theta reliability and factor scaling. In Sociological methodology. Ed: Costner HL. San Francisco: Jossey- Bass Publishers, 17-50; 1974
• Aronson RM. The art and science of judging men's gymnastics. Lowell: Lowell Technological Institute; 1970
• Boen F, Van Hoye K, Auweele YV, Feys J, Smits T. Open feedback in gymnastic judging causes conformity bias based on informational influencing. J Sport Sci, 2008; 26: 621-628[Crossref][WoS]
• Bučar M, Čuk I, Pajek J, Karacsony I, Leskošek B. Reliability and validity of judging in women's artistic gymnastics at University Games 2009. Eur J Sport Sci, 2012; 12: 207-215[WoS]
• Bučar Pajek M, Forbes W, Pajek J, Leskošek B, Čuk I. Reliability of real time judging system. Sci Gymnastics J, 2011; 3: 47-54
• Čuk I, Karacsony I. Vault : methods, ideas, curiosities, history. Ljubljana: STD Sangvincki; 2004
• Dallas G, Kirialanis P. Judges' evaluation of routines in men's artistic gymnastics. Sci Gymnastics J, 2010; 2: 49-58
• FIG. Code of Points for Women Artistic Gymnastics Competitions, 2009. Available at: http://figdocs.sportcentric.net/external/public.php?folder=661
• GymnasticsResultsCom. Gymnastics Results, 2012. Available at: http://www.gymnasticsresults.com
• Leskošek B, Čuk I, Karácsony I, Pajek J, Bučar M. Reliability and validity of judging in men’s artistic gymnastics at the 2009 university games. Sci Gymnastics J, 2010; 2: 25-34
• Plessner H. Expectation biases in gymnastics judging. J Sport Exercise Psy, 1999; 21: 131-144
• Plessner H, Schallies E. Judging the cross on rings: A matter of achieving shape constancy. Appl CognitivePsych, 2005; 19: 1145-1156[Crossref]
• Popović R. International bias detected in judging rhythmic gymnastics competition at Sydney-2000 Olympic Games. Facta universitatis-series: Phys Educ Sport, 2000; 1: 1-13
• Ste-Marie DM. Expertise in women's gymnastic judging: An observational approach. Percept Motor Skill, 2000; 90: 543-546
• Ste-Marie DM, Lee TD. Prior processing effects on gymnastic judging. J Exp Psychol Learn, 1991; 17: 126-136[Crossref]
• Ste-Marie DM, Valiquette SM, Taylor G. Memory-influenced biases in gymnastic judging occur across different prior processing conditions. Res Quarterly Exercise Sport, 2001; 72: 420-426

Identifiers

DOI

10.2478/hukin-2013-0038