Five Degrees of Happiness: Effective Smiley Face Likert Scales for Evaluating with Children

This alert has been successfully added and will be sent to: You will be notified whenever a record that you have chosen has been cited.

To manage your alert preferences, click on the button below. Manage my Alerts

New Citation Alert!

Abstract

This paper focuses on achieving optimal responses through supporting children's judgements, using Smiley Face Likert scales as a rating scale for quantitative questions in evaluations. It highlights the need to provide appropriate methods for children to communicate judgements, highlighting that the traditional Smiley Face Likert scale does not provide an appropriate method. The paper outlines a range of studies, identifying that to achieve differentiated data and full use of rating scales by children that faces with positive emotions should be used within Smiley Face Likert scales. The proposed rating method, the Five Degrees of Happiness Smiley Face Likert scale, was used in a large-scale summative evaluation of a Serious Game resulting in variance within and between children, with all points of the scale used.

References

Ang, S., Van Dyne, L., Koh, C., Ng, K. Y., Templer, K. J., Tay, C., & Chandrasekar, N. A. Cultural Intelligence: Its Measurement and Effects on Cultural Judgment and Decision Making, Cultural Adaptation and Task Performance. Management and Organization Review 3, 3 (2007), 335--371.

Bell, A. Designing and testing questionnaires for children. Journal of Research in Nursing 12, 5 (2007) 461--469.

Buckleitner, W. The State of Children's Software Evaluation---Yesterday, Today, and in the 21st Century. Information Technology in Childhood Education Annual 1999, 1 (1999), 211--220.

Chambers, C. T., & Johnston, C. Developmental differences in children's use of rating scales. Journal of Pediatric Psychology 27 (2002) 27--36.

Cole, J. S., Mccormick, A. C., & Gonyea, R. M. Respondent use of straight-lining as a response strategy in education survey research: Prevalence and implications. Annual meeting of the American Educational Research Association, (2012) 1--18.

Danner, D., Aichholzer, J., & Rammstedt, B. Acquiescence in personality questionnaires: Relevance, domain specificity and stability. Journal of Research in Personality 57, August (2015), 119--130

Dowrick, A., Wootten, A., Murphy, D., & A, C. "We used a validated Questionnaire": What Does This Mean and is it an Accurate Statment in Urologic Research. Urology, 85,6 (2014) 1304--10

Endrass, B., Hall, L., Hume, C., Tazzyman, S., & Andre, E. A Pictorial Interaction Language for Children to Communicate with Cultural Virtual Characters. In 16th International Conference on Human Interaction (2014) 532--543).

Endrass, B., Hall, L., Hume, C., Tazzyman, S., Andre, E., & Aylett, R. (2014). Engaging with virtual characters using a pictorial interaction language. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 531--534)

Guinard, J.X. Sensory and consumer testing with children. Trends in Food Science and Technology 11, (2000) 273--283.

Haddad, S., King, S., Osmond, P., & Heidari, S. Questionnaire design to determine children's thermal sensation, preference and acceptability in the classroom. Proceedings - 28th International PLEA Conference on Sustainable Architecture + Urban Design: Opportunities, Limits and Needs - Towards an Environmentally Responsible Architecture (2012).

Hall, L. and Hume, C. Why Numbers, Invites and Visits are not Enough: Evaluating the User Experience in Social Eco-Systems. SOTICS 2011, The First International Conference on Social Eco-Informatics, (2011) 8--13.

Hall, L., Tazzyman, S., Hume, C., Endrass, B., Lim, M-Y., Hofstede, G., Paiva, A., Andre, E., Kappas, A. and Aylett, R. Learning to overcome cultural conflict through engaging with intelligent agents in synthetic cultures. Journal of Artificial Intelligence and Education: Special Issue on Culturally-Aware Educational Technologies 25, 2 (2015) 291--317.

Hall, L., Jones, S., Aylett, R., Hall, M., Tazzyman, S., Paiva, A., & Humphries, L. Serious Game Evaluation as a Metagame. Journal of Interactive Technology and Smart Education. 10, 2 (2013) 130--146.

Krosnick, J. A.The threat of satisficing in surveys: the shortcuts respondents take in answering questions. Survey Methods Newsletter 20 (2000) 4--8.

van Laerhoven, H., van der Zaag-Loonen, H. J., & Derkx, B. H. F. A comparison of Likert scale and visual analogue scales as response options in children's questionnaires. Acta paediatrica, 93, 6 (2004) 830--835

Markopoulos, P., Read, J. C., MacFarlane, S., & Hööysniemi, J. Evaluating Children's Interactive Products: Principles and Practices for Interaction Designers. Morgan Kaufmann Publishers Inc. San Francisco (CA), US. (2008)

Matson, J. L., Neal, D., Fodstad, J. C., Hess, J. a, Mahan, S., & Rivet, T. T. Reliability and validity of the Matson Evaluation of Social Skills with Youngsters. Behavior modification 34, 6 (2010) 539--58.

McCambridge, J., De Bruin, M., & Witton, J. The effects of demand characteristics on research participant behaviours in non-laboratory settings: a systematic review. PloS one 7, 6 (2012) e39116.

Mellor, D., & Moore, K. A. The use of likert scales with children. Journal of Pediatric Psychology 39 (2014) 369--379.

Millen, L., Cobb, S., Patel, H., & Glover, T. Collaborative virtual environment for conducting design sessions with students with autism spectrum conditions. Proc. 9th International Conf. on Disability, Virtual Reality and Assoc. Technologies, (2012) 269--278.

Nijs, L. and Leman, M. Interactive technologies in the instrumental music classroom: A longitudinal study with the Music Paint Machine. Computers and Education 73 (2014) 40--59.

Oerke, B. and Bogner, F.X. Social Desirability, Environmental Attitudes, and General Ecological Behaviour in Children. International Journal of Science Education 35, 5 (2013) 713--730.

Ólafsson, K., Livingstone, S., & Haddon, L. Children's use of online technologies in Europe: a review of the European evidence base. EU Kids Online, London, UK (2013)

Orne, M.T. On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American psychologist 17, 11 (1962) 776.

Read, J. MESS Days: Working with Children to Design and Deliver Worthwhile Mobile Experiences. UPA User Experience Magazine, 9, 2 (2010)

Read, J. and Markopoulos, P. Evaluating children's interactive products. Extended abstracts of the 32nd annual ACM Conference on Human Factors in Computing Systems, (2014)1043--1044.

Read, J. and Fine, K. Using survey methods for design and evaluation in child computer interaction. Workshop on Child Computer Interaction: Methodological Research at Interact. (2005).

Read, J., MacFarlane, S., & Casey, C. Endurability, engagement and expectations: Measuring children's fun. Proceedings of Interaction Design and Children, (2002) 189--198.

Reynolds-Keefer, L., Johnson, R., & Carolina, S. Is a picture worth a thousand words? Creating effective questionnaires with pictures. Practical Assessment, Research & Evaluation 16 (2011) 1--7.

Reynolds-Keefer, L., Johnson, R., Dickenson, T., & McFadden, L.Validity issues in the use of pictorial Likert scales. Studies in Learning, Evaluation Innovation and Development 6 (2009) 15--24.

Roberto, C. A., Baik, J., Harris, J. L., & Brownell, K. D.Influence of licensed characters on children's taste and snack preferences. Pediatrics 126 (2010) 88--93.

Rubie-Davies, C. M., & Hattie, J. A. C. The dangers of extreme positive responses in Likert scales administered to young children. The International Journal of Educational and Psychological Assessment 11 (2012) 75--89.

Salvador-Herranz, G., Perez-Lopez, D., Ortega, M., Soto, E., Alcaliz, M., & Contero, M. Manipulating virtual objects with your hands: A case study on applying desktop Augmented Reality at the primary school. Proceedings of the Annual Hawaii International Conference on System Sciences (2013) 31--39.

Sluis, F. Van Der, Dijk, E. M. a G. Van, & Perloy, L. M. Measuring Fun and Enjoyment of Children in a Museum: Evaluating the Smileyometer Study One: Prototype. In Proceding of Measuring (2012) 86--89.

Tatla. 2014, S.K. The development of the Pediatric Motivation Scale for children in rehabilitation: a pilot study. Retrieved from http://elk.library.ubc.ca/bitstream/handle/2429/45920/ubc_2014_spring_tatla_sandeep.pdf?sequence=27

Tourangeau, R. and Rasinkski, K.A. Cognitive processes underlying context effects in attitude measurement. Psychological Bulletin 103 (2008) 299--314.

Vannette, D. and Krosnick, J. A comparison of Survey Satisficing and Mindlessness. In The Willey Blackwell Handbook of Mindfullness. (2014) 312.

Zaman, B., Vanden Abeele, V., & De Grooff, D. Measuring product liking in preschool children: An evaluation of the Smileyometer and This or That methods. International Journal of Child-Computer Interaction 1 (2013) 61--70.

Zaman, B., Vanden Abeele, V., Markopoulos, P., & Marshall, P. Editorial: The evolving field of tangible interaction for children: The challenge of empirical validation. Personal and Ubiquitous Computing 16, (2012) 367--378.

Zarins, B. Are validated questionnaires valid? The Journal of Bone & Joint Surgery 87, 8 (2005) 1671--1672.