Academic literature on the topic 'Research Audio-visual education. 4-H clubs'

Many studies have shown a link between being competent in early mathematics and achievement in school. Early math skills have the potential to be the best predictors of later performance in reading and mathematics. Movement and songs are activities that children like, making it easier for teachers to apply mathematical concepts through this method. This study aims to develop audio-visual learning media in the form of songs with a mixture of western and traditional musical idioms, accompanied by movements that represent some of the teaching of early mathematics concepts. The stages of developing the ADDIE model are the basis for launching new learning media products related to math and art, and also planting the nation's cultural arts from an early age. These instructional media products were analyzed by experts and tested for their effectiveness through experiments on five children aged 3-4 years. The qualitative data were analyzed using transcripts of field notes and observations and interpreted in a descriptive narrative. The quantitative data were analyzed using gain score statistics. The results showed that there was a significant increase in value for early mathematical understanding of the concepts of geometry, numbers and measurement through this learning medium. The results of the effectiveness test become the final basis of reference for revision and complement the shortcomings of this learning medium. Further research can be carried out to develop other mathematical concepts through motion and song learning media, and to create experiments with a wider sample. Keywords: Early Mathematical Skills, Movement and Song Idiom Traditional, Audio-visual Learning Media References An, S. A., & Tillman, D. A. (2015). Music activities as a meaningful context for teaching elementary students mathematics: a quasi-experiment time series design with random assigned control group. European Journal of Science and Mathematics Education, 3(1), 45–60. https://doi.org/10.1038/srep15999 An, S., Capraro, M. M., & Tillman, D. A. (2013). Elementary Teachers Integrate Music Activities into Regular Mathematics Lessons: Effects on Students’ Mathematical Abilities. Journal for Learning through the Arts: A Research Journal on Arts Integration in Schools and Communities, 9(1). https://doi.org/10.21977/d99112867 Austin, A. M. B., Blevins-Knabe, B., Ota, C., Rowe, T., & Lindauer, S. L. K. (2011). Mediators of preschoolers’ early mathematics concepts. Early Child Development and Care, 181(9), 1181–1198. https://doi.org/10.1080/03004430.2010.520711 Barrett, J. E., Cullen, C., Sarama, J., Miller, A. L., & Rumsey, C. (2011). Children ’ s unit concepts in measurement : a teaching experiment spanning grades 2 through 5. 637–650. https://doi.org/10.1007/s11858-011-0368-8 Basco, R. O. (2020). Effectiveness of Song, Drill and Game Strategy in Improving Mathematical Performance. International Educational Research, 3(2), p1. https://doi.org/10.30560/ier.v3n2p1 Bausela Herreras, E. (2017). Risk low math performance PISA 2012: Impact of assistance to Early Childhood Education and other possible cognitive variables. Acta de Investigación Psicológica, 7(1), 2606–2617. https://doi.org/10.1016/j.aipprr.2017.02.001 Buchoff, R. (2015). Childhood Education. January. https://doi.org/10.1080/00094056.1995.10521830 Clements, D. H. (2014). Geometric and Spatial Thinking in Young Children. In Science of Advanced Materials (Vol. 6, Issue 4). National Science Foundation. https://doi.org/10.1166/sam.2014.1766 Clements, D. H., Baroody, A. J., Joswick, C., & Wolfe, C. B. (2019). Evaluating the Efficacy of a Learning Trajectory for Early Shape Composition. XX(X), 1–22. https://doi.org/10.3102/0002831219842788 Clements, D. H., Swaminathan, S., Anne, M., & Hannibal, Z. (2016). Young Children ’ s Concepts of Shape. 30(2), 192–212. Cross, C. T., Woods, T., & Schweingruber, H. (2009). Mathematics Learning in Early Chidhood Paths Toward Excellence and Equity. The National Academies Press. Geary, D. C. (2011). Cognitive predictors of achievement growth in mathematics: A 5-year longitudinal study. Developmental Psychology, 47(6), 1539–1552. https://doi.org/10.1037/a0025510 Geary, D. C. (2012). Learning Disabilities and Persistent Low Achievement in Mathematics. J Dev Behav Pediatr., 32(3), 250–263. https://doi.org/10.1097/DBP.0b013e318209edef.Consequences Gejard, G., & Melander, H. (2018). Mathematizing in preschool : children ’ s participation in geometrical discourse. 1807. https://doi.org/10.1080/1350293X.2018.1487143 Harususilo, Y. E. (2020). Skor PISA Terbaru Indonesia, Ini 5 PR Besar Pendidikan pada Era Nadiem Makarim. https://pusmenjar.kemdikbud.go.id/ Hsiao, T. (1999). Romanticism with Deep Affection: Selected Articles About the Music of Hsiao Tyzen (Hengzhe Lin (ed.)). Wang Chun Feng Wen Hua Fa Xing. Kasuya-Ueba, Y., Zhao, S., & Toichi, M. (2020). The Effect of Music Intervention on Attention in Children: Experimental Evidence. Frontiers in Neuroscience, 14(July), 1–15. https://doi.org/10.3389/fnins.2020.00757 Kołodziejski, M., Králová, P. D. E., & Hudáková, P. D. J. (2014). Music and Movement Activities and Their Impact on Musicality and Healthy Development of a Child. Journal of Educational Revies, 7(4). Kristanto, W. (2020). Javanese Traditional Songs for Early Childhood Character Education. 14(1), 169–184. Litkowski, E. C., Duncan, R. J., Logan, J. A. R., & Purpura, D. J. (2020). When do preschoolers learn specific mathematics skills? Mapping the development of early numeracy knowledge. Journal of Experimental Child Psychology, 195, 104846. https://doi.org/10.1016/j.jecp.2020.104846 Logvinova, O. K. (2016). Socio-pedagogical approach to multicultural education at preschool. Procedia - Social and Behavioral Sciences, 233(May), 206–210. https://doi.org/10.1016/j.sbspro.2016.10.203 Lopintsova, O., Paloniemi, K., & Wahlroos, K. (2012). Multicultural Education through Expressive Methods in Early Childhood Education. Ludwig, M. ., Marklein, M. ., & Song, M. (2016). Arts Integration: A Promising Approach to Improving Early Learning. American Institutes for Research. Macdonald, A., & Lowrie, T. (2011). Developing measurement concepts within context : Children ’ s representations of length. 27–42. https://doi.org/10.1007/s13394-011-0002-7 Mans, M. (2002). Playing The Music- Comparing Perfomance of Children’s Song and dance in Traditional and Contemporary Namibian Education. In The Arts in Children’s Live (pp. 71–86). Kluwer Academic Publishers. Maričić, S. M., & Stamatović, J. D. (2017). The Effect of Preschool Mathematics Education in Development of Geometry Concepts in Children. 8223(9), 6175–6187. https://doi.org/10.12973/eurasia.2017.01057a Missall, K., Hojnoski, R. L., Caskie, G. I. L., & Repasky, P. (2015). Home Numeracy Environments of Preschoolers: Examining Relations Among Mathematical Activities, Parent Mathematical Beliefs, and Early Mathematical Skills. Early Education and Development, 26(3), 356–376. https://doi.org/10.1080/10409289.2015.968243 Moreno, S., Bialystok, E., Barac, R., Schellenberg, E. G., Cepeda, N. J., & Chau, T. (2011). Short-term music training enhances verbal intelligence and executive function. Psychological Science, 22(11), 1425–1433. https://doi.org/10.1177/0956797611416999 Nketia, J. H. K. (1982). Developing Contemporary Idioms out of Traditional Music. Studia Musicologica Academiae Scientiarum Hungaricae, 24, 81. https://doi.org/10.2307/902027 Nyota, S., & Mapara, J. (2008). Shona Traditional Children ’ s Games and Play : Songs as Indigenous Ways of Knowing. English, 2(4), 189–203. Östergren, R., & Träff, U. (2013). Early number knowledge and cognitive ability affect early arithmetic ability. Journal of Experimental Child Psychology, 115(3), 405–421. https://doi.org/10.1016/j.jecp.2013.03.007 Pantoja, N., Schaeffer, M. W., Rozek, C. S., Beilock, S. L., & Levine, S. C. (2020). Children’s Math Anxiety Predicts Their Math Achievement Over and Above a Key Foundational Math Skill. Journal of Cognition and Development, 00(00), 1–20. https://doi.org/10.1080/15248372.2020.1832098 Papadakis, Stamatios, Kalogiannakis, M., & Zaranis, N. (2017). Improving Mathematics Teaching in Kindergarten with Realistic Mathematical Education. Early Childhood Education Journal, 45(3), 369–378. https://doi.org/10.1007/s10643-015-0768-4 Papadakis, Stamatios, Kalogiannakis, M., & Zaranis, N. (2018). The effectiveness of computer and tablet assisted intervention in early childhood students’ understanding of numbers. An empirical study conducted in Greece. Education and Information Technologies, 23(5), 1849–1871. https://doi.org/10.1007/s10639-018-9693-7 Papadakis, Stamatis, Kalogiannakis, M., & Zaranis, N. (2016). Comparing Tablets and PCs in teaching Mathematics: An attempt to improve Mathematics Competence in Early Childhood Education. Preschool and Primary Education, 4(2), 241. https://doi.org/10.12681/ppej.8779 Paul, T. (2019). Mathematics and music : loves and fights To cite this version. PISA worldwide ranking; Indonesia’s PISA results show need to use education resources more efficiently, (2016). Phyfferoen, D. (2019). The Dagbon Hiplife Zone in Northern Ghana Contemporary Idioms of Music Making in Tamale. 1(2), 81–104. Purpura, D. J., Napoli, A. R., & King, Y. (2019). Development of Mathematical Language in Preschool and Its Role in Learning Numeracy Skills. In Cognitive Foundations for Improving Mathematical Learning (1st ed., Vol. 5). Elsevier Inc. https://doi.org/10.1016/b978-0-12-815952-1.00007-4 Ribeiro, F. S., & Santos, F. H. (2020). Persistent Effects of Musical Training on Mathematical Skills of Children With Developmental Dyscalculia. Frontiers in Psychology, 10(January), 1–15. https://doi.org/10.3389/fpsyg.2019.02888 Roa, R., & IA, C. (2020). Learning Music and Math, Together as One: Towards a Collaborative Approach for Practicing Math Skills with Music. In I. T. (eds) Nolte A., Alvarez C., Hishiyama R., Chounta IA., Rodríguez-Triana M. (Ed.), Collaboration Technologies and Social Computing. Col (Vol. 26, Issue 5, pp. 659–669). https://doi.org/https://doi.org/10.1007/978-3-030-58157-2_10 Sarama, J., & Clements, D. H. (2006a). Mathematics, Young Students, and Computers: Software, Teaching Strategies and Professional Development. The Mathematics Educato, 9(2), 112–134. Sarama, J., & Clements, D. H. (2006b). Mathematics in early childhood. International Journal of Early Childhood, 38(1). https://doi.org/10.1007/bf03165980 Sarkar, J., & Biswas, U. (2015). The role of music and the brain development of children. 4(8), 107–111. Sheridan, K. M., Banzer, D., Pradzinski, A., & Wen, X. (2020). Early Math Professional Development: Meeting the Challenge Through Online Learning. Early Childhood Education Journal, 48(2), 223–231. https://doi.org/10.1007/s10643-019-00992-y Silver, A. M., Elliott, L., & Libertus, M. E. (2021). When beliefs matter most: Examining children’s math achievement in the context of parental math anxiety. Journal of Experimental Child Psychology, 201, 104992. https://doi.org/10.1016/j.jecp.2020.104992 Sterner, G., Wolff, U., & Helenius, O. (2020). Reasoning about Representations: Effects of an Early Math Intervention. Scandinavian Journal of Educational Research, 64(5), 782–800. https://doi.org/10.1080/00313831.2019.1600579 Temple, B. A., Bentley, K., Pugalee, D. K., Blundell, N., & Pereyra, C. M. (2020). Using dance & movement to enhance spatial awareness learning. Athens Journal of Education, 7(2), 153–167. https://doi.org/10.30958/aje.7-2-2 Thippana, J., Elliott, L., Gehman, S., Libertus, K., & Libertus, M. E. (2020). Parents’ use of number talk with young children: Comparing methods, family factors, activity contexts, and relations to math skills. Early Childhood Research Quarterly, 53, 249–259. https://doi.org/10.1016/j.ecresq.2020.05.002 Tsai, Y. (2017). Taiwanese Traditional Musical Idioms Meet Western Music Composition: An Analytical and Pedagogical Approach to Solo Piano Works by Tyzen Hsiao. http://aquila.usm.edu/dissertations/1398 Upadhyaya, D. (2017). Benefits of Music and Movement in young children. Furtados School of Music. https://www.linkedin.com/pulse/benefits-music-movement-young-children-dharini-upadhyaya Vennberg, H., Norqvist, M., Bergqvist, E., Österholm, M., Granberg, C., & Sumpter, L. (2018). Counting on: Long Term Effects of an Early Intervention Programme. 4, 355–362. http://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-148101 Verdine, B. N., Lucca, K. R., Golinkoff, R. M., Hirsh-, K., & Newcombe, N. S. (2015). The Shape of Things : The Origin of Young Children ’ s Knowledge of the Names and Properties of Geometric Forms. 8372(October). https://doi.org/10.1080/15248372.2015.1016610 Wakabayashi, T., Andrade-Adaniya, F., Schweinhart, L. J., Xiang, Z., Marshall, B. A., & Markley, C. A. (2020). The impact of a supplementary preschool mathematics curriculum on children’s early mathematics learning. Early Childhood Research Quarterly, 53, 329–342. https://doi.org/10.1016/j.ecresq.2020.04.002 Wardani, I. K., Djohan, & Sittiprapaporn, P. (2018). The difference of brain activities of musical listeners. 1st International ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering, ECTI-NCON 2018, 181–184. https://doi.org/10.1109/ECTI-NCON.2018.8378307 Winter, E., & Seeger, P. (2015). The Important Role of Music in Early Childhood Learning. Independent School. Zaranis, N., Kalogiannakis, M., & Papadakis, S. (2013). Using Mobile Devices for Teaching Realistic Mathematics in Kindergarten Education. Creative Education, 04(07), 1–10. https://doi.org/10.4236/ce.2013.47a1001

Introduction: The ways in which Emergency Medicine (EM) physicians interact with the medical literature has been transformed with the rise of Free Open Access Medical Education (FOAM). Although nearly all residents use FOAM resources, some criticize the lack of universal quality assurance. This problem is a particular risk for trainees who have many time constraints and incompletely developed critical appraisal skills. One potential safeguard is journal club, which is used by virtually all EM residency programs in North America to review new literature. However, EM resident perspectives have not been studied. Our research objective was to describe how residents perceive journal club to influence how they translate the medical literature into their clinical practice. Our research question was whether FOAM has influenced residents’ goals and perceived value of journal club. Methods: We developed a semi-structured interview script in conjunction with a methods expert and refined it via pilot testing. Following constructivist grounded theory, and using both purposive and theoretical sampling, we conducted a focus group (n = 7) and 18 individual interviews with EM residents at the 4 training sites of the University of British Columbia. In total, we analyzed 920 minutes of recorded audio. Two authors independently coded each transcript, with discrepancies reconciled by discussion and consensus. Constant comparative analysis was performed. We conducted return of findings through public presentations. Results: We found evidence that journal club works as a community of practice with a progression of roles from junior to senior residents. Participants described journal club as a safe venue to compare practice patterns and to gain insight into the practical wisdom of their peers and mentors. The social and academic activities present at journal club interacted positively to foster this environment. In asking residents about ways that journal club accelerates knowledge translation, we actually found that residents cite journal club as a quality check to prevent premature adoption of new research findings. Residents are hesitant to adopt new literature into their practice without positive validation, which can occur during journal club. Conclusion: Journal club functions as a community of practice that is valued by residents. Journal club is a primary way that new evidence can be validated before being put into practice, and may act as quality assurance in the era of FOAM.

[1] Andanawarih, P., & Baroroh, I. (2018). The Role of Midwives as Facilitators for the Implementation of the Maternity Planning and Complication Prevention Program (P4k) in the Pekalongan District Health Center Area. Cycle: Journal of Tegal Polytechnic Midwifery Research, 7 (1) : 252-256. [2] Ministry of Health of the Republic of Indonesia, 2002, Guidelines for the Eradication of Acute Upper Respiratory Infection for Prevention of Pneumonia in Toddlers in Pelita VI , Ministry of Health of the Republic of Indonesia, Jakarta. [3] Ministry of Health of the Republic of Indonesia. Riskesdas Indonesia 2007 . jakarta: 2007 . [4] Ministry of Health of the Republic of Indonesia. 2004. Guidelines for the eradication ofacute respiratory infections (ISPA) to controlpneumonia in children under five. Jakarta: MOH RI. [5] Ministry of Health of the Republic of Indonesia, 2014a, Clinical Practice Guide for Doctors in Primary Health Care Facilities , Ministry of Health of the Republic of Indonesia, Jakarta. [6] Ministry of Health of the Republic of Indonesia, 2014b, Indonesia Health Profile 2013 , Ministry of Health of the Republic of Indonesia, Jakarta. [7] Nurrijal, (2009) . Acute Respiratory Infections . http: //www.springerlink.com (23 August 2014 ) [8] Papilaya, EA, ZuliAri, K., &. J. (2016). Comparison of the effect of health promotion using audio-visual media with audio-visual media on elementary students' oral health behavior. E-TEETH, 4 (2): 282-286. [9] Sanjaya, Vienna. 2009. Process-Oriented Learning Strategy Standards. Education. Jakarta : Prenada [10] Somantri, I., 2008, Medical Surgical Nursing: Nursing Care for Patients with Respiratory System Disorders , Salemba Medika, Jakarta. [11] Susilo, A., Rumende, CM, Pitoyo, CW, Santoso, WD, Yulianti, M., Herikurniawan, H., Sinto, R., Singh, G., Nainggolan, L., Nelwan, EJ, Chen, LK, Widhani, A., Wijaya, E., Wicaksana, B., Maksum, M., Annisa, F., Jasirwan, COM, & Yunihastuti, E. (2020).

Character education in early childhood is not new, and character education is also not just a transfer of knowledge, but something that needs to be built early on through various stimula- tions. This study aims to develop the character of early childhood through audio-visual media with traditional Javanese songs. Using educational design-based research to develop audio-visual media from traditional songs, this media was tested in the field with an experimental design with a control group. Respondents involved 71 kindergarten students from one experimental class in one control class. The data revealed that character education in children shows the average value of the experi- mental class is higher than the control group, this means character education in children can be built through traditional songs. Further research can be done to improve the character of early childhood through a variety of media that interests children. Keywords: Early Childhood, Character Education, Javanese Traditional Songs Media References: Anderson, T., & Shattuck, J. (2012). Design-based research: A decade of progress in education research? Educational Researcher, 41(1), 16–25. https://doi.org/10.3102/0013189X11428813 Bates, A. (2016). The management of ‘emotional labour’ in the corporate re-imagining of primary education in England. International Studies in Sociology of Education, 26(1), 66–81. https://doi.org/10.1080/09620214.2016.1175959 Bates, A. (2019). Character education and the ‘priority of recognition.’ Cambridge Journal of Education, 49(6), 695–710. https://doi.org/10.1080/0305764X.2019.1590529 Battistich, V., Schaps, E., Watson, M., Solomon, D., & Lewis, C. (2000). Effects of the Child Development Project on students’ drug use and other problem behaviors. Journal of Primary Prevention, 21(1), 75–99. https://doi.org/10.1023/A:1007057414994 Berkowitz, M. W. (1933). The Science of Character. The Journal of Philosophy, 30(20), 557. https://doi.org/10.2307/2016365 Berkowitz, M. W., & Bier, M. C. (2004). Research Based Character Education. Annals of the American Academy of Political and Social Science, 591(January), 72–85. https://doi.org/10.1177/0002716203260082 Botvin, G. J., Epstein, J. A., Baker, E., Diaz, T., & Ifill-Williams, M. (2013). School-based drug abuse prevention with inner-city minority youth. The Etiology and Prevention of Drug Abuse Among Minority Youth, 6(I), 5–19. https://doi.org/10.4324/9781315827735-6 Carr, D. (2012). Educating the Virtues: Essay on the philosophical psychology of moral development and education. London: Routledge. Cobb, J. (2007). What’ll I do with the baby-o? Nursery rhymes, songs, and stories for babies. Vancouver: BC: Blacksheep Press. Damon, W. (1988). The moral child: Nurturing children’s natural moral growth. New York: Free press. Derlicki, J. (2005). Ethno-pedagogy - the curse or the cure? The role of the school among youth in Nelemnoe (Yakutia). Sibirica, 4(1), 63–73. https://doi.org/10.1080/13617360500070731 Dick, W., & Carey, L. (2009). The Systematic Design of Instruction. New Jersey: Pearson Education. Ecclestone, K. (2012). From emotional and psychological well-being to character education: Challenging policy discourses of behavioural science and “vulnerability.” Research Papers in Education, 27(4), 463–480. https://doi.org/10.1080/02671522.2012.690241 Fleer, M., & Hedegaard, M. (2010). Children’s development as participation in everyday practices across different institutions. Mind, Culture, and Activity, 17(2), 149–168. https://doi.org/10.1080/10749030903222760 Goodman, J. F. (2019). Searching for character and the role of schools. Ethics and Education, 14(1), 15–35. https://doi.org/10.1080/17449642.2018.1537989 Greenberg, M. T., Kusche, C. A., Cook, E. T., & Quamma, J. P. (1995). Promoting emotional competence in school-aged children: The effects of the PATHS curriculum. Development and Psychopathology, 7(1), 117–136. https://doi.org/10.1017/S0954579400006374 Hanna, W. (2014). A Reggio-Inspired Music Atelier: Opening the Door Between Visual Arts and Music. Early Childhood Education Journal, 42(4), 287–294. https://doi.org/10.1007/s10643-013-0610-9 Harahap, N., Kahar, I. A., & Nasution, L. H. (2018). Preservation of lullabies songs in forming character based on local wisdom. International Journal of Linguistics, Literature and Culture, 5(1), 32–42. https://doi.org/10.21744/ijllc.v5n1.479 Hariswari, K. P., & Iswidayanti, S. (2019). Catharsis : Journal of Arts Education Gending Rare : Its Potential As A Character Education Media Based on Local Authority in Denpasar City. 8(3), 352–362. Hariyadi, S., Tamalene, M. N., & Hariyono, A. (2019). Ethnopedagogy of the osing tribe folk song: exploration and formation of biology learning character. Biosfer, 12(2), 258–276. https://doi.org/10.21009/biosferjpb.v12n2.258-276 Hendrix, R. E., Palmer, K. Z., Tashis, N., & Winner, M. G. (2013). The incredible flexible you: A social thinking curriculum for the preschool and the early elementary years. San Jose: CA: Think Social. Herliyana, & Rosmiati. (2018). Developing the Nationalism Character of Young Learners by Using Songs and Traditional Dances of Indonesia. Proceedings of the International Conference on the Roles of Parents in Shaping Children’s Characters (ICECED), 287–292. Hidayati, I., Handini, M. C., & Karnadi. (2018). Character education on Dendang saluang ( Traditional song Minangkabau ) in Nagari Saribu Rumah. International Journal of Advanced Education and Research, 3(3), 01–05. Ilari, B. (2018). Scaramouche Goes to Preschool: The Complex Matrix of Young Children’s Everyday Music. Early Childhood Education Journal, 46(1), 0. https://doi.org/10.1007/s10643-017-0842-1 Jeynes, W. H. (2019). A Meta-Analysis on the Relationship Between Character Education and Student Achievement and Behavioral Outcomes. Education and Urban Society, 51(1), 33–71. https://doi.org/10.1177/0013124517747681 Kotsonis, A. (2020). What can we learn from Plato about intellectual character education? Educational Philosophy and Theory, 52(3), 251–260. https://doi.org/10.1080/00131857.2019.1631157 Kurniawati, Y., Pranoto, S., & Hong, J. J. (2014). Developing Early Childhood’s Character Through Javanesenese Traditional Game. Indonesian Journal of Early Childhood Education Studies, 3(1), 68–72. https://doi.org/10.15294/ijeces.v3i1.9477 Lee, A. (2016). Implementing character education program through music and integrated activities in early childhood settings in Taiwan. International Journal of Music Education, 34(3), 340–351. https://doi.org/10.1177/0255761414563195 Lee, G. L. (2013). Re-emphasizing Character Education in Early Childhood Programs: Korean Children’s Experiences. Childhood Education, 89(5), 315–322. https://doi.org/10.1080/00094056.2013.830907 Lickona, T., Schaps, E., & Lewis, C. (2007). CEP ’ s of Effective Character Education Effective Character Education : Character Education Partnership. Mang, E. (2005). The referent of children’s early songs. Music Education Research, 7(1), 3–20. https://doi.org/10.1080/14613800500041796 Mans, M. (2002). Playing The Music- Comparing Perfomance of Children’s Song and dance in Traditional and Contemporary Namibian Education. In The Arts in Children’s Live (pp. 71–86). Netherlands: Kluwer Academic Publishers. Marshall, P. J., Bouquet, C. A., Thomas, A. L., & Shipley, T. F. (2010). Motor contagion in young children: Exploring social influences on perception-action coupling. Neural Networks, 23(8–9), 1017–1025. https://doi.org/10.1016/j.neunet.2010.07.007 MENTERI PENDIDIKAN NASIONAL. STANDAR PENDIDIKAN ANAK USIA DINI. , PERATURAN MENTERI PENDIDIKAN NASIONAL REPUBLIK INDONESIA NOMOR § (2009). Mullen, G. (2017). More Than Words: Using Nursery Rhymes and Songs to Support Domains of Child Development. Journal of Childhood Studies, 42(2), 42. https://doi.org/10.18357/jcs.v42i2.17841 Mutema, F. (2008). Shona Traditional Children ’ s Games and Play : Songs as Indigenous Ways of Knowing. English, 2(4), 189–203. Nakashima, D., Prott, L., & Bridgewater, P. (2000). Tapping Into the World’s Wisdom. UNESCO Sources, 1–24. Nyota, S., & Mapara, J. (2008). Shona Traditional Children ’ s Games and Play : Songs as Indigenous Ways of Knowing. English, 2(4), 189–203. Rogoff, B., Moore, L., Najafi, B., Dexter, A., Correa-Chávez, M., & Solís, J. (2007). Children’s development of cultural repertoires through participation in everyday routines and practices. Handbook of socialization (In J. E. G). New York: Guilford Press. Selasih, N. N., & Sudarsana, I. K. (2018). Education Based On Ethnopedagogy In Maintaining And Conserving The Local Wisdom: A Literature Study. Jurnal Ilmiah Peuradeun, 6(2), 293–306. Sizer, T. R., & Sizer, N. F. (1999). The students are watching: Schools and the moral contract. Boston: Beacon. Smeyers, P., Smith, R., & Standish, P. (2010). The therapy of education: Philosophy, happiness and personal growth. Basingstoke: Palgrave Macmillan. Sukoyo, J. (2016). The Development of Javanesenese Songs Containing Character Values as a Learning Medium of Early Childhood Education. Widyaparwa, 44(1), 1–9. Yang, L. H., Kleinman, A., Link, B. G., Phelan, J. C., Lee, S., & Good, B. (2007). Culture and stigma: Adding moral experience to stigma theory. Social Science and Medicine, 64(7), 1524–1535. https://doi.org/10.1016/j.socscimed.2006.11.013 Zeidler, Dana L; Keefer, M. (2003). the Role of Moral Reasoning on Socioscientific Issues and.

Abstract Background Sports clubs offer a unique position to increase performance and physical activity but may also provide additional health promoting opportunities. Research is limited on support clubs need to increase health promotion efforts. This study took a participative approach to gather French stakeholder ideas on perceived assistance sports clubs need to increase health promotion efforts and prioritized them based on ratings of importance and feasibility. Methods This concept mapping study had 4-steps: 1) drafting a focus prompt to a key issue, 2) brainstorming ideas in response to the focus prompt, 3) sorting ideas into themed piles and 4) rating ideas (1-6) based on two indicators. French stakeholders (45) in sports and health organizations were invited to respond using the groupwisdom™ platform. Researchers produced visual cluster maps of themed piles and Go-Zone graphs displaying ideas perceived as important and feasible. Results Participants generated 62 ideas responding to the focus prompt: 'What assistance would benefit sports clubs to become health-promoting settings?'. Once researchers edited ideas, 78 were available to sort. Final sorting formed 9 clusters: Tools for health promotion, Communication tools, Stakeholder training courses, Diagnostic & Financing, Awareness & Mobilization, Advocacy, Policies & Methods, Sharing & Networking, Communication & Dissemination. Importance and feasibility ratings produced Go-Zones with 34 ideas above the mean for both indicators. Top focus areas include: increasing awareness of health promotion benefits, mobilizing actors, advocating for support and educating club actors. Conclusions Understanding support stakeholders need to increase health promotion efforts in sports clubs is a crucial step to plan and implement policies. Including stakeholders' perceptions helps establish effective interventions by increasing the possibility of integration into current or emerging policies and acceptance from those working in clubs. Key messages Generating and organizing stakeholder ideas gives insight into perceptions of what support is needed to develop and implement health promotion interventions in the sports club context. Based on importance and feasibility, sports clubs can increase health promotion efforts by focusing on: increasing awareness of health promotion benefits, mobilizing actors, advocacy and education.

IntroductionIn a 2013 press release issued by Blind Citizens Australia, the advocacy group announced they were lodging a human rights complaint against the Australian government and the ABC over the lack of audio description available on the public broadcaster. Audio description is a track of narration included between the lines of dialogue which describes important visual elements of a television show, movie or performance. Audio description is broadly recognised as an essential feature to make television accessible to audiences who are blind or vision impaired (Utray et al.). Indeed, Blind Citizens Australia maintained that audio description was as important as captioning on Australian television:people who are blind have waited too long and are frustrated that audio description on television remains indefinitely beyond our reach. Our Deaf or hearing impaired peers have always seen great commitment from the ABC, but we continue to feel like second class citizens.While audio description as a technology was developed in the 1960s—around the same time as captions (Ellis, “Netflix Closed Captions”)—it is not as widely available on television and access is therefore often considered to be out of reach for this group. As a further comparison, in Australia, while the provision of captions was mandated in the Broadcasting Services Act (BSA) 1992 and television sets had clear Australian standards regarding their capability to display captions, there is no legislation for audio description and no consistency regarding the ability of television sets sold in Australia to display them (Ellis, “Television’s Transition”). While as a technology, audio description is as old as captioning it is not as widely available on television. This is despite the promise of technological advancements to facilitate its availability. For example, Cronin and King predicted that technological change such as the introduction of stereo sound on television would facilitate a more widespread availability of audio description; however, this has not eventuated. Similarly, in the lead up to the transition from analogue to digital broadcasting in Australia, government policy documents predicted a more widespread availability of audio description as a result of increased bandwidth available via digital television (Ellis, “Television’s Transition”). While these predictions paved way for an audio description trial, there has been no amendment to the BSA to mandate its provision.Audio description has been experienced on Australian broadcast television in 2012, but only for a 14-week trial on ABC1. The trial report, and feedback from disability groups, identified several technical impediments and limitations which effected the experience of audio described content during this trial, including: the timing of the trial during a period in which the transition from analogue to digital television was still occurring (creating hardware compatibility issues for some consumers); the limitations of the “ad hoc” approach undertaken by the ABC and manual implementation of audio description; and the need for upgraded digital receivers (ABC “Trial of Audio Description”, 2). While advocacy groups acknowledged the technical complexities involved, the expected stakeholder discussions that were due to be held post-trial, in part to attempt to resolve the issues experienced, were never undertaken. As a result of the lack of subsequent commitments to providing audio description, in 2013 advocacy group Blind Citizens Australia lodged their formal complaints of disability discrimination against the ABC and the Federal Government. Since the 2012 trial on ABC1, the ABC’s catch-up portal iView instigated another audio description trial in 2015. Through the iView trial it was further confirmed that audio description held considerable benefits for people with a vision impairment. They also demonstrated that audio description was technically feasible, with far less ‘technical difficulties’ than the experience of the 2012 broadcast-based trial. Over the 15 month trial on ABC iView 1,305 hours of audio described content was provided and played 158, 277 times across multiple platforms, including iOS, Android, the Freeview app and desktop computers (ABC, “ABC iView Audio Description Trial”).Yet despite repeated audio description trials and the lodgement of discrimination complaints, there remains no audio description on Australian broadcast television. Similarly, whereas 55 per cent of DVDs released in Australia have captions, only 25 per cent include an audio description track (Media Access Australia). At the time of writing, the only audio description available on Australian television is on Netflix Australia, a subscription video on demand provider.This article seeks to highlight the importance of television access for people with disability, with a specific focus on the provision of audio description for people with vision impairments. Research consistently shows that despite being a visual medium, people with vision impairments watch television at least once a day (Cronin and King; Ellis, “Netflix Closed Captions”). However, while television access has been a priority for advocates for people who are Deaf and hard of hearing (Downey), audiences advocating audio description are only recently making gains (Ellis, “Netflix Closed Captions”; Ellis and Kent). These gains are frequently attributed to technological change, particularly the digitisation of television and the introduction of subscription video on demand where users access television content online and are not constrained by broadcast schedules. This transformation of how we access television is also considered in the article, again with a focus on the provision–or lack thereof—of audio description.This article also reports findings of research conducted with Australians with disabilities accessing the emerging video on demand environment in 2016. The survey was run online from January to February 2016. Survey respondents included people with disability, their families, and carers, and were sourced through disability organisations and community groups as well as via disability-focused social media. A total of 145 people completed the survey and 12 people participated in follow-up interviews. Insights were gained into both how people with disability are currently using video on demand and their anticipated usage of services. Of note is that most subscription video on demand services (Netflix Australia, Stan, and Presto) had only been introduced in Australia in the year before the survey being carried out, with only Foxtel Play and Quickflix having been in operation for some time prior to that.Finally, the article ends by looking at past and current advocacy in this area, including a discussion on existing—albeit, to date, limited—political will.Access to Television for People with DisabilitiesTelevision can be disabling in different ways for people with impairments, yet several accessibility features exist to translate information. For example, people who are D/deaf or hard of hearing may require captions, while people with vision impairments prefer to make use of audio description (Alper et al.). Similarly, people with mobility and dexterity impairments found the transition to digital broadcasting difficult, particularly with relation to set top box set up (Carmichael et al.). As Joshua Robare has highlighted, even legislation has generally favoured the inclusion of audiences with hearing impairments, while disregarding those with vision impairments. Similarly, much of the literature in this area focuses on the provision of captions—a vital accessibility feature for people who are D/deaf or hard of hearing. Consequently, research into accessibility to television for a diversity of impairments, going beyond hearing impairments, remains deficient.In a study of Australian audiences with disability conducted between September and November 2013—during the final months of the analogue to digital simulcast period of Australian broadcast television—closed captions, clean audio, and large/colour-coded remote control keys emerged as the most desired access features (see Ellis, “Digital Television Flexibility”). Audio description barely registered in the top five. In a different study conducted two years ago/later, when disabled Australian audiences of video on demand were asked the same question, captions continued to dominate at 63.4 per cent; however, audio description was also seen to be a necessary feature for almost one third of respondents (see Ellis et al., Accessing Subcription Video).Robert Kingett, founder of the Accessible Netflix Project, participated in our research and told us in an interview that video on demand providers treat accessibility as an “afterthought”, particularly for blind people whom most don’t think of as watching television. Yet research dating back to the 1990s shows almost 100 per cent of people with vision impairments watch television at least once a day (Cronin & King). Statistically, the number of Australians who identify as blind or vision impaired is not insignificant. Vision Australia estimates that over 357,000 Australians have a vision impairment, while one in five Australians have a disability of some form. With an ageing population, this number is expected to grow exponentially in the next ten years (Australian Network on Disability). Kingett therefore describes this lack of accessibility as evidence video on demand is “stuck in the dark ages”, and advocates that people with vision impairments do use video on demand and therefore continue to have unmet access needs.Video on Demand—Transforming TelevisionSubscription video on demand services have caused a major shift in the way television is used and consumed in Australia. Prior to 2015, there was a small subscription video on demand industry in this country. However, in 2015, following the launch of Netflix Australia, Stan, and Presto, Australia was described as having entered the “streaming wars” (Tucker) where consumers would benefit from the increased competition. As Netflix gained dominance in the video on demand market internationally, people with disability began to recognise the potential this service could have in transforming their access to television.For example, the growing availability of video on demand services continues to provide disruptive change to the way in which consumers enjoy information and entertainment. While traditional broadcast television has provided great opportunities for participation in news, events, and popular culture, both socially and in the workplace, the move towards video on demand services has seen a notable decline in traditional television viewing habits, with online continuing to increase at the expense of Australian free-to-air programming (C-Scott).For the general population, this always-on, always-available, and always-shareable nature of video on demand means that the experience is both convenient and instant. If a television show is of interest to friends and family, it can be quickly shared through popular social media with others, allowing everyone to join in the experience. For people with disability, the ability to both share and personalise the experience of television is critical to the popularity of video on demand services for this group. This gives them not only the same benefits as others but also ensures that people with disability are not unintentionally excluded from participation—it allows people with disability the choice as to whether or not to join in. However, exclusion from video on demand is a significant concern for people with disability due to the lack of accessibility features in popular subscription services. The lack of captions, audio description, and interfaces that do not comply with international Web accessibility standards are resulting in many people with disability being unable to fully participate in the preferred viewing platforms of family and friends.The impact of this expands beyond the consumption patterns of audiences, shifting the way the audience is defined and conceptualised. With an increasing distribution of audience attention to multiple channels, products, and services, the ability to, and strategies for, acquiring a large audience has changed (Napoli). As audience attention is distributed, it is broken up, into smaller, fragmented groups. The success, therefore, of a new provider may be to amass a large audience through the aggregation of smaller, niche audiences. This theory has significance for consumers who require audio description because they represent a viable target group. In this context, accessibility is reframed as a commercial opportunity rather than a cost (Ellis, “Netflix Closed Captions”).However, what this means for future provision of audio description in Australia is still unclear. Chris Mikul from Media Access Australia, author of Access on Demand, was interviewed as part of this research. He told us that the complete lack of audio description on local video on demand services can be attributed to the lack of Australian legislation requiring it. In an interview as part of this research he explained the central issue with audio description in this country as “the lack of audio description on broadcast TV, which is shocking in a world context”.International providers fare only slightly better. Robert Kingett established the Accessible Netflix Project in 2013 with the stated aim of advocating for the provision of audio description on Netflix. Netflix, despite a lack of a clear accessibility policy, are seen as being in front in terms of overall accessibility—captions are available for most content. However, the provision of audio description was initially not considered to be of such importance, and Netflix were initially against the idea, citing technical difficulties. Nevertheless, in 2015—shortly after their Australian launch—they did eventually introduce audio description on original programming, describing the access feature as an option customers could choose, “just like choosing the soundtrack in a different language” (Wright). However, despite such successful trials, the issue in the Australian market remains the absence of legislation mandating the provision of audio description in Australia and the other video on demand providers have not introduced audio description to compete with Netflix. As the Netflix example illustrates, both legislation and recognition of people with disability as a key audience demographic will result in a more accessible television environment for this group.Currently, it is debatable as to whether this increasingly competitive market, the shifting perception of audience attraction and retention, and the entry of multiple international video on demand providers, has influenced how accessibility is viewed, both for broadcast television and video on demand. Although there is some evidence for an increasing consideration of people with disability as “valid” consumers—take, for example, the iView audio description trial, or the inclusion of audio description by Netflix—our research indicates accessibility is still inconsistently considered, designed for, and applied by current providers.Survey Response: Key Issues Regarding AccessibilityRespondents were asked to provide an overall impression of video on demand services, and to tell us about their positive and negative experiences. Analysis of 68 extended responses, and the responses provided by the interview participants, identified a lack of availability of accessibility features such as audio description as a key problem. What our results indicate is that while customers with a disability are largely accommodating of the inaccessibility of providers—they use their own assistive technology to access content—they are keenly aware of the provisions that could be made. As one respondent put it:they could do a lot better: talking menus, spoken sub titles, and also spoken messages on screen.However, many expressed low expectations due to the continued absence of audio description on broadcast television:so, the other thing is, my expectations are quite low because of years of not having audio descriptions. I have slightly different expectations to other people.This reflection is important in considering both the shifting expectations regarding video on demand providers but also the need for a clear communication of what features are available so that providers can cater to—and therefore capture—niche markets.The survey identified captioning as the main accessibility problem of video on demand services. However, this may not accurately reflect the need for other accessibility features such as audio description. Rather, it may be indicative that this feature is often the only choice given to consumers. As, Chris Mikul identified, “the only disability being catered for to any great extent is deafness/hearing impairment”. Kingett agreed, noting:people who are deaf and hard of hearing are placed way before the rest because captions are beyond easy and cheap to create now. Please, there’s even companies that people use to crowd source captions so companies don’t have to do it anymore. This all came about because the deaf community has [banded] together … to achieve a cause. I know audio description isn’t as cheap to make as captions but, by these companies’ budgets that’s like dropping a penny.Advocacy and Political WillAs noted above, it has been argued by some that accessibility features that address vision impairments have been neglected. The reason behind this is twofold—the perception that this disability is experienced by a minority of the population and that, because blind people “don’t watch television”, it is not an important accessibility feature. This points towards a need for both disability advocacy and political will by politicians to introduce legislation. As one survey respondent identified, the reality is that, in Australia, neither politicians nor people with vision impairments have yet to address the issue on audio description in an organised or sustained way:we have very little audio described content available in Australia. We don’t have the population of blind people nor the political will by politicians to force providers to provide for us.However, Blind Citizens Australia—the coalition of television audiences with vision impairments who lodged the human rights complaint against the government and the ABC—suggest the tide is turning. Whereas advocates for people with vision impairments have traditionally focused on access to the workforce, the issue of television accessibility is increasingly gaining attention, particularly as a result of international activist efforts and the move towards video on demand (see Ellis and Kent).For example, Kingett’s Accessible Netflix Project in the US is considered one of the most successful accessibility movements towards the introduction of audio description. While its members are predominantly US-based, it does include several Australian members and continues to cover Netflix Australia’s stance on audio description, and be covered by Australian media and organisations (including Media Access Australia and Life Hacker). When Netflix launched in Australia, Kingett encouraged Australians to become more involved in the project (Ellis and Kent).However, despite the progress towards mandating of audio description in parliament and the resolution of efforts made by advocacy groups (including Vision Australia and Blind Citizens Australia), the status of audio description remains uncertain. Whilst some support has been gained—specifically through motions made by Senator Siewert and the ABC iView audio description trials—significant change has been slow. For example, conciliation discussions are still ongoing regarding the now four-year-old complaint brought against the ABC and the Federal Government by Blind Citizens Australia. Meanwhile, although the Senate supported Senator Siewert’s motion to change the Broadcasting Services Act to include audio description, the Act has yet to be amended.The results of multiple ABC trials of audio description remain in discussion. Whilst the recently released report on the findings of the April 2015—July 2016 iView trial states that the “trial has identified that those who utilised the audio description service found it a valuable enhancement to their media engagement and their social interactions” (ABC, “ABC iView Audio Description Trial” 18), it also cautioned that “any move to introduce AD services in Australia would have budgetary implications for the broadcasters in a constrained financial environment” and “broader legislative implications” (ABC, “ABC iView Audio Description Trial” 18). Indeed, although the trial was considered “successful”—in that experiences by users were generally positive and the benefits considerable (Media Access Australia, “New Report”)—the continuation of audio description on iView alone was clarified as representing “a systemic failure to provide people who are blind or have low vision with basic access to television now, given that iView is out of reach for many people in the blindness and low vision community” (Media Access Australia, “New Report”). Indeed, the relatively low numbers of plays of audio described content during the trial (158, 277 plays, representing 0.58% of total program plays on iView) were likely a result of a lack of access to smartphones or Internet technology, prohibitive data speeds and/or general Internet costs, all factors which affect the accessibility of video on demand significantly more for people with disability (Ellis et al., “Access for Everyone?”).On a more positive note, the culmination of advocacy pressure, the ABC iView trial, political attention, and increasing academic literature on the accessibility of Australian media has resulted in the establishment of an Audio Description Working Group by the government. This group consists of industry representatives, advocacy group representatives, academics, and “consumer representatives”. The aims of the group are to: identify options to sustainably increase access to audio description services; identify any impediments to the implementation of audio description; provide expert advice on audio description implementation options; and develop a report on the findings due at the end of 2017.ConclusionIn the absence of audio description, people who are blind or vision impaired report a less satisfying television experience (Cronin and King; Kingett). However, with each technological advancement in the delivery of television, from stereo sound to digital television, this group has held hopes for a more accessible experience. The reality, however, has been a continued lack of audio description, particularly in broadcast television.Several commentators have compared the provision of audio description with closed captioning. They find that audio description is not as widely available, and reflect this is likely a result of lack of legislation (Robare; Ellis, “Digital Television Flexibility”)—for example, in the Australian context, whereas the provision of captions is mandated in the Broadcasting Services Act 1992, audio description is not. As a result, there have been limited trials of audio description in this country and inconsistent standards in how to display it. As discussed throughout this paper, people with vision impairments and their allies therefore often draw on the example of the widespread “acceptance” of captions to make the case that audio description should also be more widely available.However, following the introduction of subscription video on demand in Australia, and particularly Netflix, the issue of audio description is receiving greater attention. It has been argued that video on demand has transformed television, particularly the ways in which television is accessed. Video on demand could also potentially transform the way we think about accessibility for audiences with disability. While captions are a well-established accessibility feature facilitating television access for people with a range of disabilities, video on demand is raising the profile of the importance of audio description for audiences with vision impairments.ReferencesABC. “Audio Description Trial on ABC Television: Report to the Minister for Broadband, Communications and the Digital Economy”. Dec. 2012. 8 Apr. 2017 <https://www.communications.gov.au/sites/g/files/net301/f/ABC-Audio-Description-Trial-Report2.pdf>.ABC. “ABC iView Audio Description Trial: Final Report to The Department of Communications and the Arts.” Oct. 2016. 6 Apr. 2017 <https://www.communications.gov.au/documents/final-report-trial-audio-description-abc-iview>.Alper, Meryl, et al. “Reimagining the Good Life with Disability: Communication, New Technology, and Humane Connections.” Communication and the Good Life. Ed. H. Wang. New York: Peter Lang, 2015.Australian Network on Disability. “Disability Statistics.” Mar. 2017. 30 Apr. 2017 <https://www.and.org.au/pages/disability-statistics.html>.Blind Citizens Australia. Government and ABC Fail to Deliver on Accessible TV for Australia’s Blind. Submission. 10 July 2013. 1 May 2017 <http://bca.org.au/submissions/>.C-Scott, Marc. “The Battle for Audiences as Free-TV Viewing Continues Its Decline.” Mumbrella 22 Apr. 2016. 24 May 2016 <https://mumbrella.com.au/the-battle-for-audiences-as-free-tv-viewing-continues-its-decline-362010>.Carmichael, Alex, et al. “Digital Switchover or Digital Divide: A Prognosis for Useable and Accessible Interactive Digital Television in the UK.” Universal Access in the Information Society 4 (2006): 400–16.Cronin, Barry J., and Sharon Robertson King. “The Development of the Descriptive Video Services.” National Center to Improve Practice in Special Education through Technology, Media and Materials. Sep. 1998. 8 May 2014 <https://www2.edc.org/NCIP/library/v&c/Cronin.htm>.Downey, G. “Constructing Closed-Captioning in the Public Interest: From Minority Media Accessibility to Mainstream Educational Technology.” Info 9.2–3 (2007): 69–82.Ellis, Katie. “Digital Television Flexibility: A Survey of Australians with Disability.” Media International Australia 150 (2014): 96.———. “Netflix Closed Captions Offer an Accessible Model for the Streaming Video Industry, But What about Audio Description?” Communication, Politics & Culture 47.3 (2015).———. “Television’s Transition to the Internet: Disability Accessibility and Broadband-Based TV in Australia.” Media International Australia 153 (2014): 53–63.Ellis, Katie, and Mike Kent. “Accessible Television: The New Frontier in Disability Media Studies Brings Together Industry Innovation, Government Legislation and Online Activism.” First Monday 20 (2015). <http://firstmonday.org/ojs/index.php/fm/article/view/6170>.Ellis, Katie, et al. Accessing Subscription Video on Demand: A Study of Disability and Streaming Television in Australia. Australian Communications Consumer Action Network. Aug. 2016. <https://accan.org.au/grants/current-grants/1066-accessing-video-on-demand-a-study-of-disability-and-streaming-television>.Ellis, Katie, et al. “Access for Everyone? Australia’s ‘Streaming Wars’ and Consumers with Disabilities.” Continuum (2017, publication pending).Kingett, Robert. “The Accessible Netflix Project Advocates Taking Steps to Ensure Netflix Accessibility for Everyone.” 2014. 30 Jan. 2014 <https://netflixproject.wordpress.com>.Media Access Australia. “Statistics on DVD Accessibility in Australia.” 2012. 21 Nov. 2014 <https://mediaaccess.org.au/dvds/Statistics%20on%20DVD%20accessibility%20in%20Australia>.———. “New Report on the Trial of A.D. on ABC iView.” 7 Mar. 2017. 30 Apr. 2017 <https://mediaaccess.org.au/latest_news/television/new-report-on-the-trial-of-ad-on-abc-iview>.Napoli, Philip M., ed. Audience Evolution: New Technologies and the Transformation of Media Audiences. New York: Columbia UP, 2011.Robare, Joshua S. “Television for All: Increasing Television Accessibility for the Visually Impaired through the FCC’s Ability to Regulate Video Description Technology.” Federal Communications Law Journal 63.2 (2011): 553–78.Tucker, Harry. “Netflix Leads the Streaming Wars, Followed by Foxtel’s Presto.” News.com.au 24 June 2016. 18 May 2016 <http://www.news.com.au/technology/home-entertainment/tv/netflix-leads-the-streaming-wars-followed-by-foxtels-presto/news-story/7adf45dcd7d9486ff47ec5ea5951287f>.Utray, Francisco, et al. “Monitoring Accessibility Services in Digital Television.” International Journal of Digital Multimedia Broadcasting (2012): 9.

While the term “visual literacy” has grown in popularity in the last 50 years, its meaning remains nebulous. It is described variously as: a vehicle for aesthetic appreciation, a means of defence against visual manipulation, a sorting mechanism for an increasingly data-saturated age, and a prerequisite to civic inclusion (Fransecky 23; Messaris 181; McTigue and Flowers 580). Scholars have written extensively about the first three subjects but there has been less research on how visual literacy frames civic life and how it might help the public as a tool to address disadvantage and assist in removing social and cultural barriers. This article examines a forerunner to visual literacy in the push to create an international symbol language born out of popular education movements, a project that fell short of its goals but still left a considerable impression on graphic media. This article, then, presents an analysis of visual literacy campaigns in the early postwar era. These campaigns did not attempt to invent a symbolic language but posited that images themselves served as a universal language in which students could receive training. Of particular interest is how the concept of visual literacy has been mobilised as a pedagogical tool in design, digital humanities and in broader civic education initiatives promoted by Third Space institutions. Behind the creation of new visual literacy curricula is the idea that images can help anchor a world community, supplementing textual communication. Figure 1: Visual Literacy Yearbook. Montebello Unified School District, USA, 1973. Shedding Light: Origins of the Visual Literacy Frame The term “visual literacy” came to the fore in the early 1970s on the heels of mass literacy campaigns. The educators, creatives and media theorists who first advocated for visual learning linked this aim to literacy, an unassailable goal, to promote a more radical curricular overhaul. They challenged a system that had hitherto only acknowledged a very limited pathway towards academic success; pushing “language and mathematics”, courses “referred to as solids (something substantial) as contrasted with liquids or gases (courses with little or no substance)” (Eisner 92). This was deemed “a parochial view of both human ability and the possibilities of education” that did not acknowledge multiple forms of intelligence (Gardner). This change not only integrated elements of mass culture that had been rejected in education, notably film and graphic arts, but also encouraged the critique of images as a form of good citizenship, assuming that visually literate arbiters could call out media misrepresentations and manipulative political advertising (Messaris, “Visual Test”). This movement was, in many ways, reactive to new forms of mass media that began to replace newspapers as key forms of civic participation. Unlike simple literacy (being able to decipher letters as a mnemonic system), visual literacy involves imputing meanings to images where meanings are less fixed, yet still with embedded cultural signifiers. Visual literacy promised to extend enlightenment metaphors of sight (as in the German Aufklärung) and illumination (as in the French Lumières) to help citizens understand an increasingly complex marketplace of images. The move towards visual literacy was not so much a shift towards images (and away from books and oration) but an affirmation of the need to critically investigate the visual sphere. It introduced doubt to previously upheld hierarchies of perception. Sight, to Kant the “noblest of the senses” (158), was no longer the sense “least affected” by the surrounding world but an input centre that was equally manipulable. In Kant’s view of societal development, the “cosmopolitan” held the key to pacifying bellicose states and ensuring global prosperity and tranquillity. The process of developing a cosmopolitan ideology rests, according to Kant, on the gradual elimination of war and “the education of young people in intellectual and moral culture” (188-89). Transforming disparate societies into “a universal cosmopolitan existence” that would “at last be realised as the matrix within which all the original capacities of the human race may develop” and would take well-funded educational institutions and, potentially, a new framework for imparting knowledge (Kant 51). To some, the world of the visual presented a baseline for shared experience. Figure 2: Exhibition by the Gesellschafts- und Wirtschaftsmuseum in Vienna, photograph c. 1927. An International Picture Language The quest to find a mutually intelligible language that could “bridge worlds” and solder together all of humankind goes back to the late nineteenth century and the Esperanto movement of Ludwig Zamenhof (Schor 59). The expression of this ideal in the world of the visual picked up steam in the interwar years with designers and editors like Fritz Kahn, Gerd Arntz, and Otto and Marie Neurath. Their work transposing complex ideas into graphic form has been rediscovered as an antecedent to modern infographics, but the symbols they deployed were not to merely explain, but also help education and build international fellowship unbounded by spoken language. The Neuraths in particular are celebrated for their international picture language or Isotypes. These pictograms (sometimes viewed as proto-emojis) can be used to represent data without text. Taken together they are an “intemporal, hieroglyphic language” that Neutrath hoped would unite working-class people the world over (Lee 159). The Neuraths’ work was done in the explicit service of visual education with a popular socialist agenda and incubated in the social sphere of Red Vienna at the Gesellschafts- und Wirtschaftsmuseum (Social and Economic Museum) where Otto served as Director. The Wirtschaftsmuseum was an experiment in popular education, with multiple branches and late opening hours to accommodate the “the working man [who] has time to see a museum only at night” (Neurath 72-73). The Isotype contained universalist aspirations for the “making of a world language, or a helping picture language—[that] will give support to international developments generally” and “educate by the eye” (Neurath 13). Figure 3: Gerd Arntz Isotype Images. (Source: University of Reading.) The Isotype was widely adopted in the postwar era in pre-packaged sets of symbols used in graphic design and wayfinding systems for buildings and transportation networks, but with the socialism of the Neuraths’ peeled away, leaving only the system of logos that we are familiar with from airport washrooms, charts, and public transport maps. Much of the uptake in this symbol language could be traced to increased mobility and tourism, particularly in countries that did not make use of a Roman alphabet. The 1964 Olympics in Tokyo helped pave the way when organisers, fearful of jumbling too many scripts together, opted instead for black and white icons to represent the program of sports that summer. The new focus on the visual was both technologically mediated—cheaper printing and broadcast technologies made the diffusion of image increasingly possible—but also ideologically supported by a growing emphasis on projects that transcended linguistic, ethnic, and national borders. The Olympic symbols gradually morphed into Letraset icons, and, later, symbols in the Unicode Standard, which are the basis for today’s emojis. Wordless signs helped facilitate interconnectedness, but only in the most literal sense; their application was limited primarily to sports mega-events, highway maps, and “brand building”, and they never fulfilled their role as an educational language “to give the different nations a common outlook” (Neurath 18). Universally understood icons, particularly in the form of emojis, point to a rise in visual communication but they have fallen short as a cosmopolitan project, supporting neither the globalisation of Kantian ethics nor the transnational socialism of the Neuraths. Figure 4: Symbols in use. Women's bathroom. 1964 Tokyo Olympics. (Source: The official report of the Organizing Committee.) Counter Education By mid-century, the optimism of a universal symbol language seemed dated, and focus shifted from distillation to discernment. New educational programs presented ways to study images, increasingly reproducible with new technologies, as a language in and of themselves. These methods had their roots in the fin-de-siècle educational reforms of John Dewey, Helen Parkhurst, and Maria Montessori. As early as the 1920s, progressive educators were using highly visual magazines, like National Geographic, as the basis for lesson planning, with the hopes that they would “expose students to edifying and culturally enriching reading” and “develop a more catholic taste or sensibility, representing an important cosmopolitan value” (Hawkins 45). The rise in imagery from previously inaccessible regions helped pupils to see themselves in relation to the larger world (although this connection always came with the presumed superiority of the reader). “Pictorial education in public schools” taught readers—through images—to accept a broader world but, too often, they saw photographs as a “straightforward transcription of the real world” (Hawkins 57). The images of cultures and events presented in Life and National Geographic for the purposes of education and enrichment were now the subject of greater analysis in the classroom, not just as “windows into new worlds” but as cultural products in and of themselves. The emerging visual curriculum aimed to do more than just teach with previously excluded modes (photography, film and comics); it would investigate how images presented and mediated the world. This gained wider appeal with new analytical writing on film, like Raymond Spottiswoode's Grammar of the Film (1950) which sought to formulate the grammatical rules of visual communication (Messaris 181), influenced by semiotics and structural linguistics; the emphasis on grammar can also be seen in far earlier writings on design systems such as Owen Jones’s 1856 The Grammar of Ornament, which also advocated for new, universalising methods in design education (Sloboda 228). The inventorying impulse is on display in books like Donis A. Dondis’s A Primer of Visual Literacy (1973), a text that meditates on visual perception but also functions as an introduction to line and form in the applied arts, picking up where the Bauhaus left off. Dondis enumerates the “syntactical guidelines” of the applied arts with illustrations that are in keeping with 1920s books by Kandinsky and Klee and analyse pictorial elements. However, at the end of the book she shifts focus with two chapters that examine “messaging” and visual literacy explicitly. Dondis predicts that “an intellectual, trained ability to make and understand visual messages is becoming a vital necessity to involvement with communication. It is quite likely that visual literacy will be one of the fundamental measures of education in the last third of our century” (33) and she presses for more programs that incorporate the exploration and analysis of images in tertiary education. Figure 5: Ideal spatial environment for the Blueprint charts, 1970. (Image: Inventory Press.) Visual literacy in education arrived in earnest with a wave of publications in the mid-1970s. They offered ways for students to understand media processes and for teachers to use visual culture as an entry point into complex social and scientific subject matter, tapping into the “visual consciousness of the ‘television generation’” (Fransecky 5). Visual culture was often seen as inherently democratising, a break from stuffiness, the “artificialities of civilisation”, and the “archaic structures” that set sensorial perception apart from scholarship (Dworkin 131-132). Many radical university projects and community education initiatives of the 1960s made use of new media in novel ways: from Maurice Stein and Larry Miller’s fold-out posters accompanying Blueprint for Counter Education (1970) to Emory Douglas’s graphics for The Black Panther newspaper. Blueprint’s text- and image-dense wall charts were made via assemblage and they were imagined less as charts and more as a “matrix of resources” that could be used—and added to—by youth to undertake their own counter education (Cronin 53). These experiments in visual learning helped to break down old hierarchies in education, but their aim was influenced more by countercultural notions of disruption than the universal ideals of cosmopolitanism. From Image as Text to City as Text For a brief period in the 1970s, thinkers like Marshall McLuhan (McLuhan et al., Massage) and artists like Bruno Munari (Tanchis and Munari) collaborated fruitfully with graphic designers to create books that mixed text and image in novel ways. Using new compositional methods, they broke apart traditional printing lock-ups to superimpose photographs, twist text, and bend narrative frames. The most famous work from this era is, undoubtedly, The Medium Is the Massage (1967), McLuhan’s team-up with graphic designer Quentin Fiore, but it was followed by dozens of other books intended to communicate theory and scientific ideas with popularising graphics. Following in the footsteps of McLuhan, many of these texts sought not just to explain an issue but to self-consciously reference their own method of information delivery. These works set the precedent for visual aids (and, to a lesser extent, audio) that launched a diverse, non-hierarchical discourse that was nonetheless bound to tactile artefacts. In 1977, McLuhan helped develop a media textbook for secondary school students called City as Classroom: Understanding Language and Media. It is notable for its direct address style and its focus on investigating spaces outside of the classroom (provocatively, a section on the third page begins with “Should all schools be closed?”). The book follows with a fine-grained analysis of advertising forms in which students are asked to first bring advertisements into class for analysis and later to go out into the city to explore “a man-made environment, a huge warehouse of information, a vast resource to be mined free of charge” (McLuhan et al., City 149). As a document City as Classroom is critical of existing teaching methods, in line with the radical “in the streets” pedagogy of its day. McLuhan’s theories proved particularly salient for the counter education movement, in part because they tapped into a healthy scepticism of advertisers and other image-makers. They also dovetailed with growing discontent with the ad-strew visual environment of cities in the 1970s. Budgets for advertising had mushroomed in the1960s and outdoor advertising “cluttered” cities with billboards and neon, generating “fierce intensities and new hybrid energies” that threatened to throw off the visual equilibrium (McLuhan 74). Visual literacy curricula brought in experiential learning focussed on the legibility of the cities, mapping, and the visualisation of urban issues with social justice implications. The Detroit Geographical Expedition and Institute (DGEI), a “collective endeavour of community research and education” that arose in the aftermath of the 1967 uprisings, is the most storied of the groups that suffused the collection of spatial data with community engagement and organising (Warren et al. 61). The following decades would see a tamed approach to visual literacy that, while still pressing for critical reading, did not upend traditional methods of educational delivery. Figure 6: Beginning a College Program-Assisting Teachers to Develop Visual Literacy Approaches in Public School Classrooms. 1977. ERIC. Searching for Civic Education The visual literacy initiatives formed in the early 1970s both affirmed existing civil society institutions while also asserting the need to better inform the public. Most of the campaigns were sponsored by universities, major libraries, and international groups such as UNESCO, which published its “Declaration on Media Education” in 1982. They noted that “participation” was “essential to the working of a pluralistic and representative democracy” and the “public—users, citizens, individuals, groups ... were too systematically overlooked”. Here, the public is conceived as both “targets of the information and communication process” and users who “should have the last word”. To that end their “continuing education” should be ensured (Study 18). Programs consisted primarily of cognitive “see-scan-analyse” techniques (Little et al.) for younger students but some also sought to bring visual analysis to adult learners via continuing education (often through museums eager to engage more diverse audiences) and more radical popular education programs sponsored by community groups. By the mid-80s, scores of modules had been built around the comprehension of visual media and had become standard educational fare across North America, Australasia, and to a lesser extent, Europe. There was an increasing awareness of the role of data and image presentation in decision-making, as evidenced by the surprising commercial success of Edward Tufte’s 1982 book, The Visual Display of Quantitative Information. Visual literacy—or at least image analysis—was now enmeshed in teaching practice and needed little active advocacy. Scholarly interest in the subject went into a brief period of hibernation in the 1980s and early 1990s, only to be reborn with the arrival of new media distribution technologies (CD-ROMs and then the internet) in classrooms and the widespread availability of digital imaging technology starting in the late 1990s; companies like Adobe distributed free and reduced-fee licences to schools and launched extensive teacher training programs. Visual literacy was reanimated but primarily within a circumscribed academic field of education and data visualisation. Figure 7: Visual Literacy; What Research Says to the Teacher, 1975. National Education Association. USA. Part of the shifting frame of visual literacy has to do with institutional imperatives, particularly in places where austerity measures forced strange alliances between disciplines. What had been a project in alternative education morphed into an uncontested part of the curriculum and a dependable budget line. This shift was already forecasted in 1972 by Harun Farocki who, writing in Filmkritik, noted that funding for new film schools would be difficult to obtain but money might be found for “training in media education … a discipline that could persuade ministers of education, that would at the same time turn the budget restrictions into an advantage, and that would match the functions of art schools” (98). Nearly 50 years later educators are still using media education (rebranded as visual or media literacy) to make the case for fine arts and humanities education. While earlier iterations of visual literacy education were often too reliant on the idea of cracking the “code” of images, they did promote ways of learning that were a deep departure from the rote methods of previous generations. Next-gen curricula frame visual literacy as largely supplemental—a resource, but not a program. By the end of the 20th century, visual literacy had changed from a scholarly interest to a standard resource in the “teacher’s toolkit”, entering into school programs and influencing museum education, corporate training, and the development of public-oriented media (Literacy). An appreciation of image culture was seen as key to creating empathetic global citizens, but its scope was increasingly limited. With rising austerity in the education sector (a shift that preceded the 2008 recession by decades in some countries), art educators, museum enrichment staff, and design researchers need to make a case for why their disciplines were relevant in pedagogical models that are increasingly aimed at “skills-based” and “job ready” teaching. Arts educators worked hard to insert their fields into learning goals for secondary students as visual literacy, with the hope that “literacy” would carry the weight of an educational imperative and not a supplementary field of study. Conclusion For nearly a century, educational initiatives have sought to inculcate a cosmopolitan perspective with a variety of teaching materials and pedagogical reference points. Symbolic languages, like the Isotype, looked to unite disparate people with shared visual forms; while educational initiatives aimed to train the eyes of students to make them more discerning citizens. The term ‘visual literacy’ emerged in the 1960s and has since been deployed in programs with a wide variety of goals. Countercultural initiatives saw it as a prerequisite for popular education from the ground up, but, in the years since, it has been formalised and brought into more staid curricula, often as a sort of shorthand for learning from media and pictures. The grand cosmopolitan vision of a complete ‘visual language’ has been scaled back considerably, but still exists in trace amounts. Processes of globalisation require images to universalise experiences, commodities, and more for people without shared languages. Emoji alphabets and globalese (brands and consumer messaging that are “visual-linguistic” amalgams “increasingly detached from any specific ethnolinguistic group or locality”) are a testament to a mediatised banal cosmopolitanism (Jaworski 231). In this sense, becoming “fluent” in global design vernacular means familiarity with firms and products, an understanding that is aesthetic, not critical. It is very much the beneficiaries of globalisation—both state and commercial actors—who have been able to harness increasingly image-based technologies for their benefit. To take a humorous but nonetheless consequential example, Spanish culinary boosters were able to successfully lobby for a paella emoji (Miller) rather than having a food symbol from a less wealthy country such as a Senegalese jollof or a Morrocan tagine. This trend has gone even further as new forms of visual communication are increasingly streamlined and managed by for-profit media platforms. The ubiquity of these forms of communication and their global reach has made visual literacy more important than ever but it has also fundamentally shifted the endeavour from a graphic sorting practice to a critical piece of social infrastructure that has tremendous political ramifications. Visual literacy campaigns hold out the promise of educating students in an image-based system with the potential to transcend linguistic and cultural boundaries. This cosmopolitan political project has not yet been realised, as the visual literacy frame has drifted into specialised silos of art, design, and digital humanities education. It can help bridge the “incomplete connections” of an increasingly globalised world (Calhoun 112), but it does not have a program in and of itself. Rather, an evolving visual literacy curriculum might be seen as a litmus test for how we imagine the role of images in the world. References Brown, Neil. “The Myth of Visual Literacy.” Australian Art Education 13.2 (1989): 28-32. Calhoun, Craig. “Cosmopolitanism in the Modern Social Imaginary.” Daedalus 137.3 (2008): 105–114. Cronin, Paul. “Recovering and Rendering Vital Blueprint for Counter Education at the California Institute for the Arts.” Blueprint for Counter Education. Inventory Press, 2016. 36-58. Dondis, Donis A. A Primer of Visual Literacy. MIT P, 1973. Dworkin, M.S. “Toward an Image Curriculum: Some Questions and Cautions.” Journal of Aesthetic Education 4.2 (1970): 129–132. Eisner, Elliot. Cognition and Curriculum: A Basis for Deciding What to Teach. Longmans, 1982. Farocki, Harun. “Film Courses in Art Schools.” Trans. Ted Fendt. Grey Room 79 (Apr. 2020): 96–99. Fransecky, Roger B. Visual Literacy: A Way to Learn—A Way to Teach. Association for Educational Communications and Technology, 1972. Gardner, Howard. Frames Of Mind. Basic Books, 1983. Hawkins, Stephanie L. “Training the ‘I’ to See: Progressive Education, Visual Literacy, and National Geographic Membership.” American Iconographic. U of Virginia P, 2010. 28–61. Jaworski, Adam. “Globalese: A New Visual-Linguistic Register.” Social Semiotics 25.2 (2015): 217-35. Kant, Immanuel. Anthropology from a Pragmatic Point of View. Cambridge UP, 2006. Kant, Immanuel. “Perpetual Peace.” Political Writings. Ed. H. Reiss. Cambridge UP, 1991 [1795]. 116–130. Kress, G., and T. van Leeuwen. Reading images: The Grammar of Visual Design. Routledge, 1996. Literacy Teaching Toolkit: Visual Literacy. Department of Education and Training (DET), State of Victoria. 29 Aug. 2018. 30 Sep. 2020 <https://www.education.vic.gov.au:443/school/teachers/teachingresources/discipline/english/literacy/ readingviewing/Pages/litfocusvisual.aspx>. Lee, Jae Young. “Otto Neurath's Isotype and the Rhetoric of Neutrality.” Visible Language 42.2: 159-180. Little, D., et al. Looking and Learning: Visual Literacy across the Disciplines. Wiley, 2015. Messaris, Paul. “Visual Literacy vs. Visual Manipulation.” Critical Studies in Mass Communication 11.2: 181-203. DOI: 10.1080/15295039409366894 ———. “A Visual Test for Visual ‘Literacy.’” The Annual Meeting of the Speech Communication Association. 31 Oct. to 3 Nov. 1991. Atlanta, GA. <https://files.eric.ed.gov/fulltext/ED347604.pdf>. McLuhan, Marshall. Understanding Media: The Extensions of Man. McGraw-Hill, 1964. McLuhan, Marshall, Quentin Fiore, and Jerome Agel. The Medium Is the Massage, Bantam Books, 1967. McLuhan, Marshall, Kathryn Hutchon, and Eric McLuhan. City as Classroom: Understanding Language and Media. Agincourt, Ontario: Book Society of Canada, 1977. McTigue, Erin, and Amanda Flowers. “Science Visual Literacy: Learners' Perceptions and Knowledge of Diagrams.” Reading Teacher 64.8: 578-89. Miller, Sarah. “The Secret History of the Paella Emoji.” Food & Wine, 20 June 2017. <https://www.foodandwine.com/news/true-story-paella-emoji>. Munari, Bruno. Square, Circle, Triangle. Princeton Architectural Press, 2016. Newfield, Denise. “From Visual Literacy to Critical Visual Literacy: An Analysis of Educational Materials.” English Teaching-Practice and Critique 10 (2011): 81-94. Neurath, Otto. International Picture Language: The First Rules of Isotype. K. Paul, Trench, Trubner, 1936. Schor, Esther. Bridge of Words: Esperanto and the Dream of a Universal Language. Henry Holt and Company, 2016. Sloboda, Stacey. “‘The Grammar of Ornament’: Cosmopolitanism and Reform in British Design.” Journal of Design History 21.3 (2008): 223-36. Study of Communication Problems: Implementation of Resolutions 4/19 and 4/20 Adopted by the General Conference at Its Twenty-First Session; Report by the Director-General. UNESCO, 1983. Tanchis, Aldo, and Bruno Munari. Bruno Munari: Design as Art. MIT P, 1987. Warren, Gwendolyn, Cindi Katz, and Nik Heynen. “Myths, Cults, Memories, and Revisions in Radical Geographic History: Revisiting the Detroit Geographical Expedition and Institute.” Spatial Histories of Radical Geography: North America and Beyond. Wiley, 2019. 59-86.

It is time for the truth to be brought out ... . Behind the scenes high-ranking Air Force officers are soberly concerned about the UFOs. But through official secrecy and ridicule, many citizens are led to believe the unknown flying objects are nonsense. -- Rear Admiral Roscoe Hillenkoetter, Director of Central Intelligence (1947-50), signed statement to Congress, 22 Aug. 1960 As an avid UFO enthusiast, an enduring subject of frustration for me is the complacency and ignorance that tends to characterise public knowledge of the phenomenon itself and its social repercussions. Its hard for people like myself to understand how anyone could not be interested in UFOs, let alone Congressional statements from ex-Directors of the Central Intelligence Agency testifying to an official policy of secrecy and ridicule (in other words, propaganda), which aims to suppress public interest and belief in UFOs. As a student of cultural studies who also happens to be a conspiracy theorist, the idea of the Central Intelligence Agency seeking to manipulate one of the twentieth century's most significant icons -- the UFO -- is a fascinating one, because it allows for the possibility that the ways in which the UFO has come to be understood by the public may involve more than the everyday cultural processes described by cultural studies. A review of the history of the CIA's interest in UFO phenomena actually suggests, quite compellingly I think, that since the 1950s, American culture (and, indirectly and to a lesser degree, the rest of the western world) may have been subjected to a highly sophisticated system of UFO propaganda that originated from the Central Intelligence Agency. This is, of course, a highly contentious claim which would bring many important repercussions should it turn out to be true. There is no point pretending that it doesn't sound like a basic premise of The X-Files -- of course it does. So to extract the idea from its comfortable fictional context and attempt to place it into a real historical one (a completely legitimate endeavour) one must become familiar with the politics of the UFO phenomenon in Cold War America, a field of history which is, to understate the matter, largely ignored by academia. A cursory glance at the thousands of (now declassified) UFO-related documents that once circulated through some of the highest channels of US intelligence reveal that, rather than the nonsense topic it is often considered, the UFO phenomenon has been a matter of great concern for the US government since 1947. To get a sense of just how seriously UFOs were taken by the CIA in the 1950s, consider this declassified 'Secret' memorandum from H. Marshall Chadwell, Assistant Director of Scientific Intelligence, to the Director of Central Intelligence, General Walter Bedell Smith, dated 24 September 1952: a world-wide reporting system has been instituted and major Air Force bases have been ordered to make interceptions of unidentified flying objects ... . Since 1947, ATIC [Air Technical Intelligence Center, a branch of the US Air Force] has received approximately 1500 official reports of sightings ... . During 1952 alone, official reports totalled 250. Of the 1500 reports, Air Force carries 20 percent as unexplained and of those received from January through July 1952 it carries 28 percent as unexplained. (qtd. in Good 390) Fifteen-hundred reports in five years is roughly three-hundred reports per year, which is dangerously close to one per day. Although only twenty percent, or one-fifth of these reports were unexplained, equalling about 60 unexplained sightings per year, this still equalled more than one unexplained sighting per week. But these were just the unexplained, official sightings collected by ATIC, which was by no means a comprehensive database of all sightings occurring in the United States, or the rest of the world, for that matter. Extrapolation of these figures suggested that the UFO problem was probably much more extensive than the preliminary findings were indicating, hence the erection of a world-wide reporting system and the interception of UFOs by major US Air Force bases. The social consequences of the UFO problem quickly became a matter of major importance to the CIA. Chadwell went on to point out that: The public concern with the phenomena, which is reflected both in the United States press and in the pressure of inquiry upon the Air Force, indicates that a fair proportion of our population is mentally conditioned to the acceptance of the incredible. In this fact lies the potential for the touching-off of mass hysteria and panic. (qtd. in Good 393) By "acceptance of the incredible" Chadwell was probably referring to acceptance of the existence of intelligently controlled, disc-shaped craft which are capable of performing aerial manoeuvres far in excess of those possible with contemporary technology. Flying saucers were, and remain, incredible. Yet belief in them had permeated the US government as early as 1947, when a 'Secret' Air Materiel Command report (now declassified) from Lieutenant General Nathan Twining to the Commanding General, Army Air Forces, announced that: It is the opinion that: (a) The phenomenon reported is something real and not visionary and fictitious. There are objects probably approximating the shape of a disc, of such appreciable size as to appear to be as large as man-made aircraft. There is a possibility that some of the incidents may be caused by natural phenomena, such as meteors. (b) The reported operating characteristics such as extreme rates of climb, manoeuvrability (particularly in roll), and action which must be considered evasive when sighted or contacted by friendly aircraft or radar, lend belief to the possibility that some of the objects are controlled either manually, automatically, or remotely. -- (qtd. in Good 313-4) This report was compiled only two months after the term flying saucer had been invented, following pilot Kenneth Arnold's historic sighting of nine saucer-like objects in June 1947. The fact that a phenomenon which should have been ignored as a tabloid fad was being confirmed, extremely quickly, by the Air Materiel Command Headquarters suggested that those people mentally conditioned to accept the impossible were not restricted to the public domain. They also, apparently, held positions of considerable power within the government itself. This rapid acceptance, at the highest levels of America's defense agencies, of the UFO reality must have convinced certain segments of the CIA that a form of hysteria had already begun, so powerful that those whose job it was to not only remain immune from such psychosocial forces, but to manage them, were actually succumbing to it themselves. What the CIA faced, then, was nothing short of a nation on the verge of believing in aliens. Considering this, it should become a little clearer why the CIA might develop an interest in the UFO phenomenon at this point. Whether aliens were here or not did not, ultimately, matter. What did matter was the obvious social phenomenon of UFO belief. Walter Bedell Smith, Director of Central Intelligence, realised this in 1952, and wrote to the Executive Secretary of the National Security Council (in a letter previously classified 'Secret'): It is my view that this situation has possible implications for our national security which transcend the interests of a single service. A broader, coordinated effort should be initiated to develop a firm scientific understanding of the several phenomena which apparently are involved in these reports, and to assure ourselves that the incidents will not hamper our present efforts in the Cold War or confuse our early warning system in case of an attack. I therefore recommend that this Agency and the agencies of the Department of Defense be directed to formulate and carry out a program of intelligence and research activities required to solve the problem of instant positive identification of unidentified flying objects ... . This effort shall be coordinated with the military services and the Research and Development Board of the Department of Defense, with the Psychological Strategy Board and other Governmental agencies as appropriate. (qtd. in Good 400-1) What the Director was asserting, basically, was that the UFO problem was too big for the CIA to solve alone. Any government agencies it was deemed necessary to involve were to be called into action to deal with the UFOs. If this does not qualify UFOs as serious business, it is difficult to imagine what would. In the same year, Chadwell again reported to the CIA Director in a memo which suggests that he and his colleagues were on the brink of believing not only that UFOs were real, but that they represented an extraterrestrial presence: At this time, the reports of incidents convince us that there is something going on that must have immediate attention ... . Sightings of unexplained objects at great altitudes and traveling at high speeds in the vicinity of major US defense installations are of such nature that they are not attributable to natural phenomena or known types of aerial vehicles. (qtd. in Good 403) In 1953, these concerns eventually led to the CIA's most public investigation of the UFO phenomenon, the Robertson Panel. Its members were Dr H. P. Robertson (physics and radar); Dr Lloyd V. Berkner (geophysics); Dr Samuel Goudsmit (atomic structure and statistical problems); and Dr Thornton Page (astronomy and astrophysics). Associate members were Dr J. Allen Hynek (astronomy) and Frederick C. Durant (missiles and rockets). Twelve hours of meetings ensued (not nearly enough time to absorb all of the most compelling UFO data gathered at this point), during which the panel was shown films of UFOs, case histories and sightings prepared by the ATIC, and intelligence reports relating to the Soviet Union's interest in US sightings, as well as numerous charts depicting, for example, frequency and geographic location of sightings (Good 404). The report (not fully declassified until 1975) concluded with a highly skeptical, and highly ambiguous, view of UFO phenomena. Part IV, titled "Comments and Suggestions of the Panel", stated that: Reasonable explanations could be suggested for most sightings ... by deduction and scientific method it could be induced (given additional data) that other cases might be explained in a similar manner. (qtd. in Good 404) However, even if the panel's insistence that UFOs were not of extraterrestrial origin seemed disingenuous, it still noted the subjectivity of the public to mass hysteria and greater vulnerability to possible enemy psychological warfare (qtd. in Good 405). To remedy this, it recommended quite a profound method of propaganda: The debunking aim would result in reduction in public interest in flying saucers which today evokes a strong psychological reaction. This education could be accomplished by mass media such [as] television, motion pictures, and popular articles. Basis of such education would be actual case histories which had been puzzling at first but later explained. As in the case of conjuring tricks, there is much less stimulation if the secret is known. Such a program should tend to reduce the current gullibility of the public and consequently their susceptibility to clever hostile propaganda. The panel noted that the general absence of Russian propaganda based on a subject with so many obvious possibilities for exploitation might indicate a possible Russian official policy ... . It was felt strongly that psychologists familiar with mass psychology should advise on the nature and extent of the program ... . It was believed that business clubs, high schools, colleges, and television stations would all be pleased to cooperate in the showing of documentary type motion pictures if prepared in an interesting manner. The use of true cases showing first the mystery and then the explanation would be forceful ... . The continued emphasis on the reporting of these phenomena does, in these parlous times, result in a threat to the orderly functioning of the protective organs of the body politic ... . [It is recommended that] the national security agencies take immediate steps to strip the Unidentified Flying Objects of the special status they have been given and the aura of mystery they have unfortunately acquired; that the national security agencies institute policies on intelligence, training, and public education designed to prepare the material defenses and the morale of the country to recognise most promptly and to react most effectively to true indications of hostile intent or action. We suggest that these aims may be achieved by an integrated program designed to reassure the public of the total lack of evidence of inimical forces behind the phenomena, to train personnel to recognize and reject false indications quickly and effectively, and to strengthen regular channels for the evaluation of and prompt reaction to true indications of hostile measures. (qtd. in Good 405-6) The general aim of the Robertson Panel's recommendations, then, was to not only stop people believing in UFOs, but to stop people seeing UFOs, which constitutes an extreme manipulation of the public consciousness. It was the intention of the CIA to ensure, as subtly as was possible, that most people interpreted specific visual experiences (i.e. UFO sightings) in terms of a strict CIA-developed criterion. This momentous act basically amounts to an attempt to define, control and enforce a particular construction of reality which specifically excludes UFOs. In an ironic way, the Robertson Panel report advocated a type of modern exorcism, and may have been the very birthplace of the idea that such an obvious icon of wonder and potential as the UFO is, it can never be more than a misidentification or a hoax. We cannot be certain to what extent the recommendations of the Robertson Panel were put into practice, but we can safely assume that its findings were not ignored by the CIA. For example, Captain Edward J. Ruppelt, Chief of the ATIC's Aerial Phenomena Branch, has testified that "[We were] ordered to hide sightings when possible, but if a strong report does get out, we have to publish a fast explanation -- make up something to kill the report in a hurry, and also ridicule the witnesses, especially if we can't find a plausible answer. We even have to discredit our own pilots" (Good 407). Comments like these make one wonder just how extensive the program of debunking and ridicule actually was. What I have suggested here is that during the 1950s, and possibly throughout the four decades since, an objective of the CIA has been to downplay its own interest in the UFO phenomenon to the public whilst engaging in secret, complex investigations of the phenomenon itself and its social repercussions. If this is the case, as the evidence -- the best of which can be found in the government's own files (even though such evidence, as tens of thousands of conspiracy theorists continue to stress, can hardly be taken simply at face value) -- indicates, then the construction of the UFO in western popular culture will have to be revised as a process involving more than just the projection of popular hopes, desires and anxieties onto an abstract, mythical object. It will also need to be seen as involving the clandestine manipulation of this process by immeasurably powerful groups within the culture itself, such as the CIA. And since the CIAs major concerns about UFOs haved traditionally been explicitly related to the Cold War, the renewed prominence of the UFO in western popular culture since the demise of the Soviet Union requires immediate, serious investigation in a political context. For the UFO issue is, and has always been, a political issue. I suggest that until this fascinating chapter of American domestic history is explored more thoroughly, the cultural function of the UFO will remain just as poorly understood as its physical nature. References Good, Timothy. Beyond Top Secret: The Worldwide UFO Security Threat. London: MacMillan, 1996. Citation reference for this article MLA style: Adam Dodd. "Making It Unpopular: The CIA and UFOs in Popular Culture." M/C: A Journal of Media and Culture 2.4 (1999). [your date of access] <http://www.uq.edu.au/mc/9906/cia.php>. Chicago style: Adam Dodd, "Making It Unpopular: The CIA and UFOs in Popular Culture," M/C: A Journal of Media and Culture 2, no. 4 (1999), <http://www.uq.edu.au/mc/9906/cia.php> ([your date of access]). APA style: Adam Dodd. (1999) Making it unpopular: the CIA and UFOs in popular culture. M/C: A Journal of Media and Culture 2(4). <http://www.uq.edu.au/mc/9906/cia.php> ([your date of access]).

Responsibility frames in media coverage describe the mediated attribution of responsibility for causes and remedies (treatments, solutions) for health issues, mostly differentiating between individual and societal responsibility. Field of application/theoretical foundation: Media coverage of health topics, public opinion formation, attribution of responsibility, framing studies, social media on health issues Example studies: Gollust & Lantz (2009); Kim & Willis (2007); O’Hara & Smith (2007); Stefanik-Sidener (2013); Yoo & Kim (2012); Zhang & Jin (2015) Information on Kim & Willis, 2007 Authors: Sei-Hill Kim, Leigh Anne Willis Health topic: Obesity Research questions: How have the media presented the causes and solutions for obesity? Have certain causes and solutions appeared more often than others? How has media coverage of causal and solution responsibility changed over the years? Have mentions of certain causes and solutions increased or decreased? Object of analysis: Newspaper and television news data containing “obesity” or “obese” appearing in the headline, lead paragraphs, or index terms; articles published in The New York Times, The Washington Post, Chicago Sun-Times, The San Francisco Chronicle, The Houston Chronicle, and USA Today; news transcripts on obesity from three television networks (ABC, CBS, NBC); after conducting a systematic sampling, n = 300 articles and n = 200 transcripts were analyzed Time frame of analysis: January 1995 to August 2004 Info about variables Variables: Variables included attributions of causal and treatment responsibility, cause or treatment option was coded as ‘‘not present’’ (0) or ‘‘present’’ (1). Level of analysis: News article respectively tv transcript Causal responsibility Solution responsibility Personal causes (Scott’s pi= .81) Unhealthy diet: Consuming too much food, consuming too much unhealthy food, addictive or emotional eating. Sedentary lifestyle: Lack of exercise, Lack of physical activities. Genetic conditions: Genetic=biological factors that may produce obesity (e.g., imbalance of hunger hormones that may stimulate appetite). Others: E.g., poor adult role models. Personal solutions (Scott’s pi= .74) Healthy diet: Consuming less food, consuming healthy food. Physically activities: More exercise and physical activities. Medical treatments: Medications (e.g., diet pills), surgical treatments of obesity (e.g., gastric bypass, gastric stapling). Others: E.g., working with a support group, talking to a counselor, parents as role models. Societal causes (Scott’s pi= .86) The food industry: Obesity-promoting foods (fast=junk food), super-sizing, large increase in fast=junk food restaurants, other aggressive marketing promotions. Schools & education: Unhealthy foods in school cafeterias, lack of physical activity programs at schools, lack of public education about healthy eating and lifestyle. Socioeconomic factors: Low-income families may not be able to afford healthy food, exercise equipment, or a gym membership. They may be too busy to prepare their own healthy food. Others: E.g., automobile-oriented society (e.g., drive-thru stores and restaurants, big-box stores), unsafe community (crime, traffic, accident), and limited opportunities for outdoor activities. Societal solutions (Scott’s pi= .81) Regulations of the food industry: Regulating obesity-promoting foods, super-sizing, vending machines, and other aggressive marketing promotions, taxing unhealthy food. Changes in schools & education: Healthier food in school cafeteria, more physical activity programs at schools, more public education. Socioeconomic changes: Narrowing income gap, healthy food should be more affordable and available, more affordable exercise. Others: E.g., less automobile-oriented and more walking-oriented society (less drive-thru stores and restaurants, less big-box stores), safer community, and more opportunities for outdoor activities. Information on Stefanik-Sidener, 2013 Author: Kelsey Stefanik-Sidener Health topic: Diabetes Research questions: What was the dominant frame used in news stories about diabetes? What were the most common cause and solution frames used for each type of diabetes? Object of analysis: Diabetes coverage in the New York Times (N = 239) Time frame of analysis: 2000 to 2010 Info about variables Variables: The articles were coded for the presence of three types of frames for both causes of and solutions to diabetes, respectively: behavioral, societal, or medical, frames were not mutually exclusive Level of analysis: News article General cause frame (Krippendorff’s Alpha= .96) General solution frame (Krippendorff’s Alpha= .64) Behavioral causal frame Poor diet, lack of physical activity, or other individual-level issues Personal solutions Improving one’s diet or increasing activity levels Societal cause frames Poor food environments, car-centered culture, poor nutrition in schools, or other broad problems Societal solution frames Improving access to healthy foods, increasing nutrition education, or other public policy/societal-level solutions Medical cause frames Family history, genetics, age Medical solution frames Blood sugar control, medication, or surgery Information on Yoo & Kim, 2012 Authors: Jina H. Yoo, Junghyun Kim Health topic: obesity Research questions: What typifications (i.e., causal claims and solution claims) have been made in videos on YouTube with regard to the obesity issue? How do these typifications vary among different types of media formats on YouTube? Object of analysis: YouTube was searched with the keywords “obesity” and “obese” on 5 March 2010 and owing to capacity limits, the number of available videos was limited to 1,000 per each keyword; after a systematic random sampling and excluding irrelevant videos, total sample of N = 417 YouTube videos was analyzed Time frame of analysis: 2000 to 2010 Info about variables Variables: articles were coded for the presence of causal claims and solution typifications, behavioral, biological, and systematic causal factors on obesity being causal claims and behavioral solution, medical or pharmacological solution and systematic solution Reliability: Intercoder reliability was calculated for each category, and average intercoder reliability coefficient was .89. The Cohen’s kappa coefficient for each variable ranged between .77 and 1.00 Level of analysis: each whole video, including all of the video’s visual, audio, and text presentation Causal claims for obesity Solution typifications for obesity Behavioral causal claim Obesity is due to the individual’s lifestyle choices, including lack of exercise, wrong diet, lack of willpower and self-control, etc. Behavioral solution Improving one’s diet or increasing activity levels Biological causal claim Obesity is due to genetic or hormonal problems Medical or pharmacological solution To use diet pills or have a gastric bypass surgery as a means of treating obesity. Systematic causal claim Obesity is based on environmental influences and policy choices, including detrimental practices of corporations and government, such as the fast food industry’s marketing practices, school cafeterias’ unhealthy foods, inadequate or inaccurate information about food and nutrition, etc. Systematic solution A societal level of obesity treatment, such as implementing obesity-related policies, banning fast food marketing, removing vending machines from school, etc. Information on Zhang & Jin, 2015 Authors: Yuan Zhang, Yan Jin Health topic: Depression Research question: Do cultural values and organizational restraints shape the responsibility frames for health issues? Object of analysis: US (n = 228) and Chinese (n = 224) newspaper coverage on depression, including New York Times and USA Today, Philadelphia Inquirer, Houston Chronicle, Star Tribune and Denver Post; Chinese newspapers were not further specified, except for People’s Daily and Beijing Daily Time frame of analysis: 2000 to 2012 Info about variables Variables: News framing of causal and problem-solving responsibilities was measured at individual and societal levels, with individual-level and society-level causes and solutions. Each cause and solution included four subcategories which were measured nominally as 0 (absent) or 1 (present). Reliability: For the US data, a pretest in which two coders both coded a randomly selected 10% of the sample yielded Pearson’s r of 0.737 (p < 0.001) for individual causes, 0.862 (p < 0.001) for societal causes, 0.790 (p < 0.001) for individual solutions, and 0.907 (p < 0.001) for societal solutions. For the Chinese data, a pretest in which two bilingual coders both coded a randomly selected 10% of the sample yielded Pearson’s r of 0.861 (p < 0.001) for individual causes, 0.893 (p < 0.001) for societal causes, 0.807 (p < 0.001) for individual solutions, and 0.899 (p < 0.001) Level of analysis: Article Variables & operational definitions: In the appendix References Gollust, S. E., & Lantz, P. M. (2009). Communicating population health: Print news media coverage of type 2 diabetes. Social Science & Medicine (1982), 69(7), 1091–1098. https://doi.org/10.1016/j.socscimed.2009.07.009 Kim, S.?H., & Willis, A. (2007). Talking about obesity: News framing of who is responsible for causing and fixing the problem. Journal of Health Communication, 12(4), 359–376. https://doi.org/10.1080/10810730701326051 O’Hara, S. K., & Smith, K. C. (2007). Presentation of eating disorders in the news media: What are the implications for patient diagnosis and treatment? Patient Education and Counseling, 68(1), 43–51. https://doi.org/10.1016/j.pec.2007.04.006 Stefanik-Sidener, K. (2013). Nature, nurture, or that fast food hamburger: Media framing of diabetes in the New York Times from 2000 to 2010. Health Communication, 28(4), 351–358. https://doi.org/10.1080/10410236.2012.688187 Yoo, J. H., & Kim, J. (2012). Obesity in the new media: a content analysis of obesity videos on YouTube. Health Communication, 27(1), 86–97. https://doi.org/10.1080/10410236.2011.569003 Zhang, Y., & Jin, Y. (2015). Who's responsible for depression? The Journal of International Communication, 21(2), 204–225. https://doi.org/10.1080/13216597.2015.1052532 Zhang, Y., & Jin, Y. (2015). Who's responsible for depression? Journal of International Communication, 21(2), 204–225.

“What's the brief?” is an everyday question within the graphic design process. Moreover, the concept and importance of a design brief is overtly understood well beyond design practice itself—especially among stakeholders who work with designers and clients who commission design services. Indeed, a design brief is often an assumed and expected physical or metaphoric artefact for guiding the creative process. When a brief is lacking, incomplete or unclear, it can render an already ambiguous graphic design process and discipline even more fraught with misinterpretation. Nevertheless, even in wider design discourse, there appears to be little research on design briefs and the briefing process (Jones and Askland; Paton and Dorst). It seems astonishing that, even in Peter Phillips’s 2014 edition of Creating the Perfect Design Brief, he feels compelled to comment that “there are still no books available about design briefs” and that the topic is only “vaguely” covered within design education (21). While Phillips’s assertion is debatable if one draws purely from online vernacular sources or professional guides, it is supported by the lack of scholarly attention paid to the design brief. Graphic design briefs are often mentioned within design books, journals, and online sources. However, this article argues that the format, function and use of such briefs are largely assumed and rarely identified and studied. Even within the broader field of design research, the tendency appears to be to default to “the design brief” as an assumed shorthand, supporting Phillips’s argument about the nebulous nature of the topic. As this article contextualises, this is further problematised by insufficient attention cast on graphic design itself as a specific discipline. This article emerges from a wider, multi-stage creative practice study into graphic design practice, that used experimental performative design research methods to investigate graphic designers’ professional relationships with stakeholders (Meron, Strangely). The article engages with specific outcomes from that study that relate to the design brief. The article also explores existing literature and research and argues for academics, the design industry, and educationalists, to focus closer attention on the design brief. It concludes by suggesting that experimental and collaborative design methods offers potential for future research into the design brief. Contextualising the Design Brief It is critical to differentiate the graphic design brief from the operational briefs of architectural design (Blyth and Worthington; Khan) or those used in technical practices such as software development or IT systems design, which have extensive industry-formalised briefing practices and models such as the waterfall system (Petersen et al.) or more modern processes such as Agile (Martin). Software development and other technical design briefs are necessarily more formulaically structured than graphic design briefs. Their requirements are generally empirically and mechanistically located, and often mission-critical. In contrast, the conceptual nature of creative briefs in graphic design creates the potential for them to be arbitrarily interpreted. Even in wider design discourse, there appears to be little consistency about the form that a brief takes. Some sources indicate that a brief only requires one page (Elebute; Nov and Jones) or even a single line of text (Jones and Askland). At other times briefs are described as complex, high-level documents embedded within processes which designers respond to with the aim of producing end products to satisfy clients’ requirements (Ambrose; Patterson and Saville). Ashby and Johnson (40) refer to the design brief as a “solution neutral” statement, the aim being to avoid preconceptions or the narrowing of the creative possibilities of a project. Others describe a consultative (Walsh), collaborative and stakeholder-inclusive process (Phillips). The Scholarly Brief Within scholarly design research, briefs inevitably manifest as an assumed artefact or process within each project; but the reason for their use or antecedents for chosen formats are rarely addressed. For example, in “Creativity in the Design Process” (Dorst and Cross) some elements of the design brief are described. The authors also describe at what stage of the investigation the brief is introduced and present a partial example of the brief. However, there is no explanation of the form of the brief or the reasons behind it. They simply describe it as being typical for the design medium, adding that its use was considered a critical part of addressing the design problem. In a separate study within advertising (Johar et al.), researchers even admit that the omission of crucial elements from the brief—normally present in professional practice—had a detrimental effect on their results. Such examples indicate the importance of briefs for the design process, yet further illustrating the omission of direct engagement with the brief within the research design, methodology, and methods. One exception comes from a study amongst business students (Sadowska and Laffy) that used the design brief as a pedagogical tool and indicates that interaction with, and changes to, elements of a design brief impact the overall learning process of participants, with the brief functioning as a trigger for that process. Such acknowledgement of the agency of a design brief affirms its importance for professional designers (Koslow et al.; Phillips). This use of a brief as a research device informed my use of it as a reflective and motivational conduit when studying graphic designers’ perceptions of stakeholders, and this will be discussed shortly. The Professional Brief Professionally, the brief is a key method of communication between designers and stakeholders, serving numerous functions including: outlining creative requirements, audience, and project scope; confirming project requirements; and assigning and documenting roles, procedures, methods, and approval processes. The format of design briefs varies from complex multi-page procedural documents (Patterson and Saville; Ambrose) produced by marketing departments and sent to graphic design agencies, to simple statements (Jones and Askland; Elebute) from small to medium-sized businesses. These can be described as the initial proposition of the design brief, with the following interactions comprising the ongoing briefing process. However, research points to many concerns about the lack of adequate briefing information (Koslow, Sasser and Riordan). It has been noted (Murray) that, despite its centrality to graphic design, the briefing process rarely lives up to designers’ expectations or requirements, with the approach itself often haphazard. This reinforces the necessarily adaptive, flexible, and compromise-requiring nature of professional graphic design practice, referred to by design researchers (Cross; Paton and Dorst). However, rather than lauding these adaptive and flexible designer abilities as design attributes, such traits are often perceived by professional practitioners as unequal (Benson and Dresdow), having evolved by the imposition by stakeholders, rather than being embraced by graphic designers as positive designer skill-sets. The Indeterminate Brief With insufficient attention cast on graphic design as a specific scholarly discipline (Walker; Jacobs; Heller, Education), there is even less research on the briefing process within graphic design practice (Cumming). Literature from professional practice on the creation and function of graphic design briefs is often formulaic (Phillips) and fractured. It spans professional design bodies, to templates from mass-market printers (Kwik Kopy), to marketing-driven and brand-development approaches, in-house style guides, and instructional YouTube videos (David). A particularly clear summary comes from Britain’s Design Council. This example describes the importance of a good design brief, its requirements, and carries a broad checklist that includes the company background, project aims, and target audience. It even includes stylistic tips such as “don’t be afraid to use emotive language in a brief if you think it will generate a shared passion about the project” (Design Council). From a subjective perspective, these sources appear to contain sensible professional advice. However, with little scholarly research on the topic, how can we know that, for example, using emotive language best informs the design process? Why might this be helpful and desirable (or otherwise) for designers? These varied approaches highlight the indeterminate treatment of the design brief. Nevertheless, the very existence of such diverse methods communicates a pattern of acknowledgement of the criticality of the brief, as well as the desire, by professional bodies, commentators, and suppliers, to ensure that both designers and stakeholders engage effectively with the briefing process. Thus, with such a pedagogic gap in graphic design discourse, scholarly research into the design brief has the potential to inform vernacular and formal educational resources. Researching the Design Brief The research study from which this article emerges (Meron, Strangely) yielded outcomes from face-to-face interviews with eleven (deidentified) graphic designers about their perceptions of design practice, with particular regard to their professional relationships with other creative stakeholders. The study also surveyed online discussions from graphic design forums and blog posts. This first stage of research uncovered feelings of lacking organisational gravitas, creative ownership, professional confidence, and design legitimacy among the designers in relation to stakeholders. A significant causal factor pointed to practitioners’ perceptions of lacking direct access to and involvement with key sources of creative inspiration and information; one specific area being the design brief. It was a discovery that was reproduced thematically during the second stage of the research. This stage repurposed performative design research methods to intervene in graphic designers’ resistance to research (Roberts, et al), with the goal of bypassing practitioners’ tendency to portray their everyday practices using formulaic professionalised answers (Dorland, View). In aiming to understand graphic designers’ underlying motivations, this method replaced the graphic designer participants with trained actors, who re-performed narratives from the online discussions and designer interviews during a series of performance workshops. Performative methodologies were used as design thinking methods to defamiliarise the graphic design process, thereby enabling previously unacknowledged aspects of the design process to be unveiled, identified and analysed. Such defamiliarisation repurposes methods used in creative practice, including design thinking (Bell, Blythe, and Sengers), with performative elements drawing on ethnography (Eisner) and experimental design (Seago and Dunne). Binding these two stages of research study together was a Performative Design Brief—a physical document combining narratives from the online discussions and the designer interviews. For the second stage, this brief was given to a professional theatre director to use as material for a “script” to motivate the actors. In addition to identifying unequal access to the creative process as a potential point of friction, this study yielded outcomes suggesting that designers were especially frustrated when the design brief was unclear, insufficiently detailed, or even missing completely. The performative methodology enabled a refractive approach, using performative metaphor and theatre to defamiliarise graphic design practice, portraying the process through a third-party theatrical prism. This intervened in graphic designers’ habitual communication patterns (Dorland, The View). Thus, combining traditional design research methods with experimental interdisciplinary ones, enabled outcomes that might not otherwise have emerged. It is an example of engaging with the fluid, hybrid (Heller, Teaching), and often elusive practices (van der Waarde) of graphic design. Format, Function, and Use A study (Paton and Dorst) among professional graphic designers attempts to dissect practitioners’ perceptions of different aspects of briefing as a process of ‘framing’. Building on the broader theories of design researchers such as Nigel Cross, Bryan Lawson, and Donald Schön, Paton and Dorst suggest that most of the designers preferred a collaborative briefing process where both they and client stakeholders were directly involved, without intermediaries. This concurs with the desire, from many graphic designers that I interviewed, for unobstructed engagement with the brief. Moreover, narratives from the online discussions that I investigated suggest that the lack of clear frameworks for graphic design briefs is a hotly debated topic, as are perceptions of stakeholder belligerence or misunderstanding. For example, in a discussion from Graphic Design Forums designer experiences range from only ever receiving informal verbal instructions—“basically, we’ve been handed design work and they tell us ‘We need this by EOD’” (VFernandes)—to feeling obliged to pressure stakeholders to provide a brief—“put the burden on them to flesh out the details of a real brief and provide comprehensive material input” (HotButton) —to resignation to an apparent futility of gaining adequate design briefs from stakeholders because— “they will most likely never change” (KitchWitch). Such negative assumptions support Koslow et al.’s assertion that the absence of a comprehensive brief is the most “terrifying” thing for practitioners (9). Thus, practitioners’ frustrations with stakeholders can become unproductive when there is an inadequate design brief, or if the creative requirements of a brief are otherwise removed from the direct orbit of graphic designers. This further informs a narrative of graphic designers perceiving some stakeholders as gatekeepers of the design brief. For example, one interviewed designer believed that stakeholders ‘don’t really understand the process’ (Patricia). Another interviewee suggested that disorganised briefs could be avoided by involving designers early in the process, ensuring that practitioners had direct access to the client as a creative source, rather than having to circumnavigate stakeholders (Marcus). Such perceptions appeared to reinforce beliefs among these practitioners that they lack design capital within the creative process. These perceptions of gatekeeping of the design brief support suggestions of designers responding negatively when stakeholders approach the design process from a different perspective (Wall and Callister), if stakeholders assume a managerial position (Jacobs) and, in particular, if stakeholders are inexperienced in working with designers (Banks et al.; Holzmann and Golan). With such little clarity in the design briefing process, future research may consider comparisons with industries with more formalised briefing processes, established professional statuses, or more linear histories. Indeed, the uneven historical development of graphic design (Frascara; Julier and Narotzky) may influence the inconsistency of its briefing process. Inconsistency as Research Opportunity The inconsistent state of the graphic design brief is reflective of the broader profession that it resides within. Graphic design as a profession remains fluid and inconsistent (Dorland, Tell Me; Jacobs), with even its own practitioners unable to agree on its parameters or even what to call the practice (Meron, Terminology). Pedagogically, graphic design is still emerging as an independent discipline (Cabianca; Davis), struggling to gain capital outside of existing and broader creative practices (Poynor; Triggs). The inherent interdisciplinarity (Harland) and intangibility of graphic design also impact the difficulty of engaging with the briefing process. Indeed, graphic design’s practices have been described as “somewhere between science and superstition (or fact and anecdote)” (Heller, Teaching par. 3). With such obstacles rendering the discipline fractured (Ambrose et al.), it is understandable that stakeholders might find engaging productively with graphic design briefs challenging. This can become problematic, with inadequate stakeholder affinity or understanding of design issues potentially leading to creative discord (Banks et al.; Holzmann and Golan). Identifying potentially problematic and haphazard aspects of the design brief and process also presents opportunities to add value to research into broader relationships between graphic designers and stakeholders. It suggests a practical area of study with which scholarly research on collaborative design approaches might intersect with professional graphic design practice. Indeed, recent research suggests that collaborative approaches offer both process and educational advantages, particularly in the area of persona development, having the ability to discover the “real” brief (Taffe 394). Thus, framing the brief as a collaborative, educative, and negotiative process may allow creative professionals to elucidate and manage the disparate parts of a design process, such as timeframes, stakeholders, and task responsibilities, as well as the cost implications of stakeholder actions such as unscheduled amendments. It can encourage the formalisation of incomplete vernacular briefs, as well as allow for the influence of diverse briefing methods, such as the one-page creative brief of advertising agencies, or more formal project management practices while allowing for some of the fluidity of more agile approaches: acknowledging that changes may be required while keeping all parties informed and involved. In turn, collaborative approaches may contribute towards enabling the value of contributions from both graphic designers and stakeholders and it seems beneficial to look towards design research methodologies that promote collaborative pathways. Mark Steen, for example, argues for co-design as a form of design thinking for enabling stakeholders to combine knowledge with negotiation to implement change (27). Collaborative design methods have also been advocated for use between designers and users, with stakeholders on shared projects, and with external collaborators (Binder and Brandt). Others have argued that co-design methods facilitate stakeholder collaboration “across and within institutional structures” while challenging existing power relations, albeit leaving structural changes largely unaffected (Farr 637). The challenge for collaborative design research is to seek opportunities and methodologies to conduct design brief research within a graphic design process that often appears amorphous, while also manifesting complex designer–stakeholder dynamics. Doubly so, when the research focus—the graphic design brief—often appears as nebulous an entity as the practice it emerges from. Conclusion The research discussed in this article suggests that graphic designers distrust a creative process that itself symbolises an inconsistent, reactive, and often accidental historical development of their profession and pedagogy. Reflecting this, the graphic design brief emerges almost as a metaphor for this process. The lack of overt discussion about the format, scope, and process of the brief feeds into the wider framework of graphic design’s struggle to become an independent scholarly discipline. This, in turn, potentially undermines the professional authority of graphic design practice that some of its practitioners believe is deficient. Ultimately, the brief and its processes must become research-informed parts of graphic design pedagogy. Embracing the brief as a pedagogical, generative, and inseparable part of the design process can inform the discourse within education, adding scholarly value to practice and potentially resulting in increased agency for practitioners. The chameleon-like nature of graphic design’s constant adaptation to ever-changing industry requirements makes research into the role and influences of its briefing process challenging. Thus, it also follows that the graphic design brief is unlikely to quickly become as formalised a document or process as those from other disciplines. But these are challenges that scholars and professionals must surely embrace if pedagogy is to gain the research evidence to influence practice. As this article argues, the often obfuscated practices and inherent interdisciplinarity of graphic design benefit from experimental research methods, while graphic designers appear responsive to inclusive approaches. Thus, performative methods appear effective as tools of discovery and collaborative methodologies offer hope for organisational intervention. References Ambrose, Gavin. Design Thinking for Visual Communication. Fairchild, 2015. Ambrose, Gavin, Paul Harris, and Nigel Ball. The Fundamentals of Graphic Design. Bloomsbury, 2020. Ashby, M.F., and Kara Johnson. Materials and Design: The Art and Science of Material Selection in Product Design. Elsevier Butterworth-Heinemann, 2010. Banks, Mark, et al. "Where the Art Is: Defining and Managing Creativity in New Media SME’s." Creativity and Innovation Management 11.4 (2002): 255-64. Bell, Genevieve, Mark Blythe, and Phoebe Sengers. "Making by Making Strange: Defamiliarization and the Design of Domestic Technologies." ACM Transactions on Computer-Human Interaction 12.2 (2005): 149-73. Benson, Joy, and Sally Dresdow. "Design Thinking: A Fresh Approach for Transformative Assessment Practice." Journal of Management Education 38.3 (2014): 436-61. Binder, Thomas, and Eva Brandt. "The Design:Lab as Platform in Participatory Design Research." CoDesign 4.2 (2008). Blyth, Alastair, and John Worthington. Managing the Brief for Better Design. Routledge, 2010. Cabianca, David. "A Case for the Sublime Uselessness of Graphic Design." Design and Culture 8.1 (2016): 103-22. Cross, Nigel. Design Thinking: Understanding How Designers Think and Work. Berg, 2011. Cumming, Deborah. "An Investigation into the Communication Exchange between Small Business Client and Graphic Designer." Robert Gordon U, 2007. David, Gareth. "The Graphic Design Brief." 5 June 2021 <https://youtu.be/EMG6qJp_sPY 2017>. Davis, Meredith. "Tenure and Design Research: A Disappointingly Familiar Discussion." Design and Culture 8.1 (2016): 123-31. De Michelis, G., C. Simone and K. Schmidt, eds. An Ethnographic Study of Graphic Designers. Third European Conference on Computer-Supported Cooperative Work. 1993. U of Surrey, UK. Design Council. "How to Commission a Designer: Step 4: Brief Your Designer." Design Council. 3 June 2021 <https://www.designcouncil.org.uk/news-opinion/how-commissiondesigner-step-4-brief-your-designer>. Dorland, AnneMarie. Tell Me Why You Did That: Learning “Ethnography” from the Design Studio. Ethnographic Praxis in Industry Conference, 2016. ———. "The View from the Studio: Design Ethnography and Organizational Cultures."Ethnographic Praxis in Industry Conference Proceedings 2017. Vol. 1. 2017. 232-46. Dorst, Kees, and Nigel Cross. "Creativity in the Design Process: Co-Evolution of Problem–Solution." Design Studies 22 (2001): 425–37. Eisner, Elliot. Concerns and Aspirations for Qualitative Research in the New Millennium. Issues in Art and Design Teaching. RoutledgeFalmer, 2003. Elebute, Ayo. "Influence of Layout and Design on Strategy and Tactic for Communicating Advertising Messages." Global Journal of Arts Humanities and Social Sciences 4.6 (2016): 34-47. Farr, Michelle. "Power Dynamics and Collaborative Mechanisms in Co-Production and Co-Design Processes." Critical Social Policy 38.4 (2017): 623–644. DOI: 10.1177/0261018317747444. Frascara, Jorge. "Graphic Design: Fine Art or Social Science?" Design Issues 5.1 (1988): 18-29. DOI: 10.2307/1511556. Harland, Robert G. "Seeking to Build Graphic Design Theory from Graphic Design Research." Routledge Companion to Design Research. Eds. Paul Rodgers and Joyce Yee. Routledge, 2015. 87-97. Heller, Steven. The Education of a Graphic Designer. Allworth P, 2015. ———. "Teaching Tools." Teaching Graphic Design History. Allworth, 2019. 312. Holzmann, Vered, and Joseph Golan. "Leadership to Creativity and Management of Innovation? The Case of the 'Innovation Club' in a Production Company." American Journal of Industrial and Business Management 6 (2016): 60-71. HotButton. "Kind of a Design Brief?" 2016. 28 July 2018 <https://web.archive.org/web/20160310013457/http://www.graphicdesignforum.com/forum/forum/graphic-design/general/1619626-kind-of-a-designbrief?p=1619683#post1619683>. Jacobs, Jessica. "Managing the Creative Process within Graphic Design Firms: Literature Review." Dialectic 1.2 (2017): 155-78. Johar, Gita Venkataramani, Morris B. Holbrook, and Barbara B. Stern. "The Role of Myth in Creative Advertising Design: Theory, Process and Outcome." Journal of Advertising 30.2 (2001): 1-25. Jones, Wyn M., and Hedda Haugen Askland. "Design Briefs: Is There a Standard?" International Conference on Engineering and Product Design Education. 2012. Khan, Ayub. Better by Design: An Introduction to Planning and Designing a New Library Building. Facet, 2009. KitchWitch. "Kind of a Design Brief?" 2016. 28 July 2018 <https://web.archive.org/web/20160310013457/http://www.graphicdesignforum.com/forum/graphic-design/general/1619626-kind-of-a-design-brief?p=1619687#post1619687>. Kwik Kopy. "Design Brief." 2018. 5 June 2021 <https://www.kwikkopy.com.au/blog/graphic-designbrief-template>. Koslow, Scott, Sheila Sasser, and Edward Riordan. "What Is Creative to Whom and Why? Perceptions in Advertising Agencies." Journal of Advertising Research 43.1 (2003). “Marcus”. Interview by the author. 2013. Martin, Robert Cecil. Agile Software Development: Principles, Patterns, and Practices. Prentice Hall PTR, 2003. Meron, Yaron. "Strangely Familiar: Revisiting Graphic Designers’ Perceptions of Their Relationships with Stakeholders." RMIT University, 2019. ———. "Terminology and Design Capital: Examining the Pedagogic Status of Graphic Design through Its Practitioners’ Perceptions of Their Job Titles." International Journal of Art & Design Education 40.2 (2021): 374-88. “Patricia”. Interview by the author. 2013. Paton, Bec, and Kees Dorst. "Briefing and Reframing: A Situated Practice." Design Studies 32.6 (2011): 573-87. Patterson, Jacinta, and Joanne Saville. Viscomm: A Guide to Visual Communication Design VCE Units, 2012.1-4. Petersen, Kai, Claes Wohlin, and Dejan Baca. "The Waterfall Model in Large-Scale Development." . Proceedings of Product-Focused Software Process Improvement: 10th International Conference, Profes 2009, Oulu, Finland, June 15-17, 2009. Eds. Frank Bomarius et al. Lecture Notes in Business Information Processing. Springer, 2009. 386-400. Phillips, Peter L. Creating the Perfect Design Brief: How to Manage Design for Strategic Advantage. Allworth P, 2014. Poynor, Rick. "Does Graphic Design History Have a Future?" Print 65.4 (2011): 30-32. Roberts, Lucienne, Rebecca Wright, and Jessie Price. Graphic Designers Surveyed. Ed. Lucienne Roberts. London, UK: GraphicDesign&, 2015. Sadowska, Noemi, and Dominic Laffy. "The Design Brief: Inquiry into the Starting Point in a Learning Journey." Design Journal 20, Sup. 1 (2017): S1380-S89. Seago, Alex, and Anthony Dunne. "New Methodologies in Art and Design Research: The Object as Discourse." Design Issues 15.2 (1999): 11-17. Steen, Marc. "Co-Design as a Process of Joint Inquiry and Imagination." Design Issues 29.2 (2013): 16-28. DOI: 10.1162/DESI_a_00207. Taffe, Simone. "Who’s in Charge? End-Users Challenge Graphic Designers’ Intuition through Visual Verbal Co-Design." The Design Journal 20, Sup. 1 (2017): S390-S400. Triggs, Teal. "Graphic Design History: Past, Present, and Future." Design Issues 27.1 (2011): 3-6. Van der Waarde, Karel. "Graphic Design as Visual Arguments: Does This Make a Reliable Appraisal Possible?" Perspective on Design: Research, Education and Practice. Eds. Raposo, Daniel, João Neves, and José Silva. Springer Series in Design and Innovation. Springer, 2020. 89-101. VFernandes. "Kind of a Design Brief?" 2016. 28 July 2018 < https://web.archive.org/web/20160310013457/http://www.graphicdesignforum.com/forum/graphic-design/general/1619626-kind-of-a-design-brief#post1619626>. Walker, Sue. "Research in Graphic Design." Design Journal 20.5 (2017): 549-59. Wall, James A., Jr., and Ronda Roberts Callister. "Conflict and Its Management." Journal of Management 21.3 (1995). Walsh, Vivien. "Design, Innovation and the Boundaries of the Firm." Research Policy 25 (1996): 509-29.