Journal articles on the topic 'Collaborative Reading Annotation'

This article interrogates how digital text annotation tools and projects facilitate online engagement and virtual communities of practice. With the rise of the Web 2.0 movement and the proliferation of digital resources, annotation has evolved from an isolated practice to a collaborative one. This article unpacks the impact of this shift by providing an in-depth discussion of five web-based tools and two social reading projects. This article examines issues of design, usability, and applicability to pedagogical intervention as well as underscores how productive group dynamics can be fostered through digital, social annotation.

Drawing first on an annotated copy of the poetry of Felicia Hemans that my students discovered in the stacks of the University of Virginia's library, this essay goes on to examine the marks made by female readers in three nineteenth-century copies of Hemans's poetry to reveal the dynamics of sentiment in author-reader networks of Romantic and Victorian poetry. Seeing Hemans through the eyes of individual female readers surfaces a lost world in which poetry was valued as a collaborative, intimate language of the heart. Specific historical copies allow us best to apprehend this world, but, in the wake of wide-scale digitization, nineteenth-century books are simultaneously newly visible and newly at risk. This essay makes the case for retaining them and for integrating them into our accounts of nineteenth-century literary history.

In 2004, when the protein estimate from the finished human genome was only 24,000, the surprise was compounded as reviewed estimates fell to 19,000 by 2014. However, variability in the total canonical protein counts (i.e. excluding alternative splice forms) of open reading frames (ORFs) in different annotation portals persists. This work assesses these differences and possible causes. A 16-year analysis of Ensembl and UniProtKB/Swiss-Prot shows convergence to a protein number of ~20,000. The former had shown some yo-yoing, but both have now plateaued. Nine major annotation portals, reviewed at the beginning of 2017, gave a spread of counts from 21,819 down to 18,891. The 4-way cross-reference concordance (within UniProt) between Ensembl, Swiss-Prot, Entrez Gene and the Human Gene Nomenclature Committee (HGNC) drops to 18,690, indicating methodological differences in protein definitions and experimental existence support between sources. The Swiss-Prot and neXtProt evidence criteria include mass spectrometry peptide verification and also cross-references for antibody detection from the Human Protein Atlas. Notwithstanding, hundreds of Swiss-Prot entries are classified as non-coding biotypes by HGNC. The only inference that protein numbers might still rise comes from numerous reports of small ORF (smORF) discovery. However, while there have been recent cases of protein verifications from previous miss-annotation of non-coding RNA, very few have passed the Swiss-Prot curation and genome annotation thresholds. The post-genomic era has seen both advances in data generation and improvements in the human reference assembly. Notwithstanding, current numbers, while persistently discordant, show that the earlier yo-yoing has largely ceased. Given the importance to biology and biomedicine of defining the canonical human proteome, the task will need more collaborative inter-source curation combined with broader and deeper experimental confirmation in vivo and in vitro of proteins predicted in silico. The eventual closure could be well be below ~19,000.

Digital text is quickly becoming essential to modern daily life. The article you are reading right now is born digital; unlike texts of the not-so-distant past, it may never be printed at all. Worldwide, the trend is clear: Digital text is on the way in, and print is on its way out. Year-by-year, more and more readers are turning to ebooks, internet news, and other forms of ereading, while generation by generation, print is becoming less and less relevant. 1 1 Pew research shows 50% of Americans have a dedicated ereading device, with yearly gains in ereadership [1]; industry research, too, shows a definite trend toward ereading and non-traditional publishing, with ebooks making up 50% of fiction reading in 2016 [2], while journalism is also trending online [3]. These trends are not unique to English—to meet the demands and expectations of today's readers, Tibetan texts, too, are being digitized by many organizations and institutions with a shared appreciation for the Tibetan literary heritage. They include a variety of secular publishers, monastic institutions, and Buddhist foundations, among others. But while these organizations share common goals for common texts, their work is all too frequently completely disconnected from the community at large. This situation negatively impacts what is already a minoritized and under-resourced language. While competition—from other languages, as well as other publishers in the Tibetan etext world—has been a driver of innovation in the adoption of ereading technology, we believe that a rich, shared data source is not only in everyone's best interest but also the only practical way forward when we consider the time, effort, expertise, and money that quality digitization takes. That is why we have designed OpenPecha to be a public, open platform for collaborative etext curation and annotation sharing. Its aim is providing a wide range of users with the latest version of the exact “view” of any text needed, while maintaining the integrity of the text and its annotations and simultaneously allowing for community improvements and additions. In this article, we explore the details of how the project came to be, what it is, and how it works, while also presenting a few common use cases.

AbstractStudies suggest that the incorporation of online annotations in reading instruction can improve students’ reading comprehension. However, little research has addressed how students use online annotations in their reading processes and how such use may lead to their improvement. This study thus adopted Reciprocal Teaching (RT) as an instructional framework to support students’ reading comprehension progress and processes, facilitated by the use of online annotations. A total of 54 English language learners at a university were recruited to read with online annotations based on the RT procedure, namely predicting, clarifying, questioning, and summarizing. The data collected included the students’ scores on pre- and post-tests and their participation records in a collaborative learning environment. The results reveal that the students enhanced their reading comprehension after the intervention. Their reading processes were also analyzed, and the major differences between the groups making more and less progress were identified. Those who made more progress not only frequently reviewed their previously generated predictions, clarifications, questions, and summaries but also actively provided feedback to their peers in a reciprocal manner. Pedagogical implications and recommendations are discussed.

This article suggests a method for cultivating a collaborative method of shared visual note-taking on seminar readings and discussions, built on the method of creative ‘poaching’ of each other’s contributions, using pencil and simple tracing technique on transparent papers. The method was developed and tested in a decade of workshops with the author and varying groups of participants, students, researchers and professionals, in academic text-based discussions, lectures and seminars. The method, speculative and collaborative, aims to assemble the participants’ ideas and contributions in compossible ways, that is, possibilities that support each other to build more convivial forms of annotation and idea generation, and where contributions flow into each other and with no clear delineation of order or between authors/contributors. This method of collaborative poaching produced convincing results and could be used as an exercise in semi-structured discussions and their creative documentation, cultivating a multiplicity of perspectives on human values and also support what Martha Nussbaum calls a ‘narrative imagination’.

Given increasing criticism and dropping admissions, American legal education is likely to change, hopefully reversing the unsustainable trend of increasing expense without increasing value. Much debate focuses on restructuring the curriculum to make it more “practical” and skills-infused; here we instead propose a rethinking of the basic unit of law teaching, the casebook. Casebook authors and publishers are cautiously venturing into electronic editions, but they fail to harness the power of social learning to make textbooks dramatically smarter as well as cheaper. We are developing an online platform that reinvents both authorship and learning. The platform, which has progressed to alpha testing, provides an online system for crowdsourcing authorship by law professors (including shared and socially ranked case selections, edits, annotations, questions, and problems) and reading by law students and others (including shared and socially ranked highlights, notes, questions, answers, and other interactions, as well as live collaboration). Rather than settle for twentieth century casebooks in digital form, we aim to enable twentyfirst century coursebooks that originate in, and then grow increasingly useful and valuable through, social intelligence.

The availability of large image data sets has been a crucial factor in the success of deep learning-based classification and detection methods. Yet, while data sets for everyday objects are widely available, data for specific industrial use-cases (e.g., identifying packaged products in a warehouse) remains scarce. In such cases, the data sets have to be created from scratch, placing a crucial bottleneck on the deployment of deep learning techniques in industrial applications. We present work carried out in collaboration with a leading UK online supermarket, with the aim of creating a computer vision system capable of detecting and identifying unique supermarket products in a warehouse setting. To this end, we demonstrate a framework for using data synthesis to create an end-to-end deep learning pipeline, beginning with real-world objects and culminating in a trained model. Our method is based on the generation of a synthetic dataset from 3D models obtained by applying photogrammetry techniques to real-world objects. Using 100K synthetic images for 10 classes, an InceptionV3 convolutional neural network was trained, which achieved accuracy of 96% on a separately acquired test set of real supermarket product images. The image generation process supports automatic pixel annotation. This eliminates the prohibitively expensive manual annotation typically required for detection tasks. Based on this readily available data, a one-stage RetinaNet detector was trained on the synthetic, annotated images to produce a detector that can accurately localize and classify the specimen products in real-time.

Perusall is a collaborative annotation platform designed for pre-readings in a flipped classroom, but can also be used for stand-alone, asynchronous reading discussion components of courses. We examine the use of Perusall as a social constructivist learning tool in two upper year/graduate courses in Mechanical Engineering. Perusall was used to replace in-class discussion of readings during the shift to online teaching. Data was collected from student surveys and from the student and instructor annotations themselves. Annotations were coded for content, and examined for factors such as upvoting. We found substantial engagement from students, with collaborative annotation providing opportunities for: correction of misunderstanding; linking concepts from the course and between readings; discussing larger issues around research and research writing; sharing background information among peers; and critically analyzing the readings. Students reported deeper learning than in typical in-class discussions of readings; however, they also noted that annotation required much more time. Overall, collaborative annotation appears to be an effective method for course reading discussion.

International audience While online crowdsourced text transcription projects have proliferated in the last decade, there is a need within the broader field to understand differences in project outcomes as they relate to task design, as well as to experiment with different models of online crowdsourced transcription that have not yet been explored. The experiment discussed in this paper involves the evaluation of newly-built tools on the Zooniverse.org crowdsourcing platform, attempting to answer the research question: "Does the current Zooniverse methodology of multiple independent transcribers and aggregation of results render higher-quality outcomes than allowing volunteers to see previous transcriptions and/or markings by other users? How does each methodology impact the quality and depth of analysis and participation?" To answer these questions, the Zooniverse team ran an A/B experiment on the project Anti-Slavery Manuscripts at the Boston Public Library. This paper will share results of this study, and also describe the process of designing the experiment and the metrics used to evaluate each transcription method. These include the comparison of aggregate transcription results with ground truth data; evaluation of annotation methods; the time it took for volunteers to complete transcribing each dataset; and the level of engagement with other project elements such as posting on the message board or reading supporting documentation. Particular focus will be given to the (at times) competing goals of data quality, efficiency, volunteer engagement, and user retention, all of which are of high importance for projects that focus on data from galleries, libraries, archives and museums. Ultimately, this paper aims to provide a model for impactful, intentional design and study of online crowdsourcing transcription methods, as well as shed light on the associations between project design, methodology and outcomes.

03–438 Appel, Christine (Dublin City U., Ireland; Email: christine.appel@dcu.ie) and Mullen, Tony (U. of Groningen, The Netherlands). A new tool for teachers and researchers involved in e-mail tandem language learning. ReCALL (Cambridge, UK), 14, 2 (2002), 195–208.03–439 Atlan, Janet (IUT – Université Nancy 2, France; Email: janet.atlan@univ-nancy2.fr). La recherche sur les stratégies d'apprentissage appliquée à l'apprentissage des langues. [Learning strategies research applied to language learning.] Stratégies d'apprentissage (Toulouse, France), 12 (2003), 1–32.03–440 Aviezer, Ora (Oranim Teachers College & U. of Haifa, Israel; Email: aviezer@research.haifa.ac.il). Bedtime talk of three-year-olds: collaborative repair of miscommunication. First Language (Bucks., UK), 23, 1 (2003), 117–139.03–441 Block, David (Institute of Education, University of London). Destabilized identities and cosmopolitanism across language and cultural borders: two case studies. Hong Kong Journal of Applied Linguistics. (Hong Kong, China), 7, 2 (2002), 1–19.03–442 Brantmeier, Cindy (Washington U., USA). Does gender make a difference? Passage content and comprehension in second language reading. Reading in a Foreign Language (Hawaii, USA), 15, 1 (2003), 1–27.03–443 Cameron, L. (University of Leeds, UK; Email: L.J.Cameron@education.leeds.ac.uk). Challenges for ELT from the expansion in teaching children. ELT Journal, 57, 2 (2003), 105–112.03–444 Carter, Beverley-Anne (University of the West Indies, Trinidad and Tobago). Helping learners come of age: learner autonomy in a Caribbean context. Hong Kong Journal of Applied Linguistics (Hong Kong, China), 7, 2 (2002), 20–38.03–445 Cenos, Jasone (U. del País Vasco, Vitoria-Gasteiz, Spain; Email: fipceirj@vc.ehu.es). Facteurs déterminant l'acquisition d'une L3: âge, développement cognitive et milieu. [Factors determining the acquisition of an L3: age, cognitive development and environment.] Aile 18, 2002, 37–51.03–446 Chini, Danielle (Université de Pau et des Pays de l'Adour, France). La situation d'apprentissage: d'un lieu externe à un espace interne. [Learning situation: from external to internal space.] Anglais de Specialité37–38 (2002), 95–108.03–447 Condon, Nora and Kelly, Peter (U. Namur, Belgium). Does cognitive linguistics have anything to offer English language learners in their efforts to master phrasal verbs?ITL Review of Applied Linguistics (Leuven, Belgium), 137–138 (2002), 205–231.03–448 Crawford Camiciottoli, Belinda (Florence U., Italy). Metadiscourse and ESP reading comprehension: An exploratory study. Reading in a Foreign Language (Hawaii, USA), 15, 1 (2003), 28–44.03–449 Dykstra-Pruim, Pennylyn (Calvin College, Michigan, USA). Speaking, Writing, and Explicit Rule Knowledge: Toward an Understanding of How They Interrelate. Foreign Language Annals (New York, USA), 36, 1 (2003), 66–75.03–450 Giguère, Jacinthe, Giasson, Jocelyne and Simard, Claude (Université Laval, Canada; Email: jacinthegiguere@hotmail.com). Les relations entre la lecture et l'écriture: Représentations d'élèves de différents niveaux scolaires et de différents niveaux d'habilité. [Relationships between reading and writing: The perceptions of students of different grade levels and different ability levels.] The Canadian Journal of Applied Linguistics (Canada), 5, 1–2 (2003), 23–50.03–451 Gregersen, Tammy S. (Northern Iowa U., USA). To Err is Human: A Reminder to Teachers of Language-Anxious Students. Foreign Language Annals (New York, USA), 36, 1 (2003), 25–32.03–452 Haznedar, Belma (Bounaziçi U., Turkey; Email: haznedab@boun.edu.tr). The status of functional categories in child second language acquisition: evidence from the acquisition of CP.Second Language Research (London, UK), 19, 1 (2003), 1–41.03–453 Hesling, Isabelle (Université Victor Segalen Bordeaux 2, France). L'hémisphère cérébral droit: un atout en anglais de spécialité. [The right brain hemisphere: an advantage in specialised English.] Anglais de Specialité, 37–38 (2002), 121–140.03–454 Hilton, Heather (Université de Savoie). Modèles de l'acquisition lexicale en L2: où en sommes-nous? [Models of lexical acquisition for L2: where are we?] Anglais de Spécialité (Bordeaux, France), 35–36 (2000), 201–217.03–455 Iwashita, Noriko (Melbourne U., Australia; Email: norikoi@unimelb.edu.au). Negative feedback and positive evidence in task-based interaction. Differential effects on L2 development. Studies in Second Language Acquisition (Cambridge, UK), 25 (2003), 1–36.03–456 Johnson, Sharon P. and English, Kathryn (Virginia State U., USA). Images, myths, and realities across cultures. The French Review (Carbondale, IL, USA), 76, 3 (2003), 492–505.03–457 Kobayashi, Masaki (U. of British Columbia, Canada). The role of peer support in ESL students' accomplishment of oral academic tasks. The Canadian Modern Language Review/La Revue Canadienne des Langues Vivantes, 59, 3 (2003), 337–368.03–458 Lam, Agnes (University of Hong Kong). Language policy and learning experience in China: Six case histories. Hong Kong Journal of Applied Linguistics (Hong Kong, China), 7, 2 (2002), 57–72.03–459 Laufer, Batia (U. of Haifa, Israel; Email: batialau@research.haifa.ac.il). Vocabulary acquisition in a second language: do learners really acquire most vocabulary by reading? Some empirical evidence. The Canadian Modern Language Review/La Revue Ccanadienne des Langues Vivantes, 59, 4 (2003), 567–587.03–460 Lavoie, Natalie (Université du Québec à Rimouski, Email: natalie_lavoie@uqar.qc.ca). Les conceptions des parents de scripteurs débutants relativement à l'apprentissage de l'écriture. [The perceptions of beginner writers' parents relating to the process of learning to write.] The Canadian Journal of Applied Linguistics (Canada), 5, 1–2 (2003), 51–64.03–461 Leeman, Jennifer (George Mason U., Fairfax, USA; Email: jleeman@gmu.edu). Recasts and second language development: beyond negative evidence. Studies in Second Language Acquisition (Cambridge, UK), 25 (2003), 37–63.03–462 Loucky, John Paul (Seinan Women's U., Japan) Improving access to target vocabulary using computerized bilingual dictionaries. ReCALL (Cambridge, UK), 14, 2 (2002), 293–312.03–463 MacIntyre, Peter D. (U. College of Cape Breton, Sydney, Canada; Email: petermacintyre@uccb.ca), Baker, Susan C., Clément, Richard and Donovan, Leslie A. Talking in order to learn: willingness to communicate and intensive language programs. The Canadian Modern Language Review/La Revue canadienne des langues vivantes, 59, 4 (2003), 589–607.03–464 McAlpine, Janice and Myles, Johanne (Queens U., Ontario, Canada; Email: jm27@post.queensu.ca). Capturing phraseology in an online dictionary for advanced users of English as a second language: a response to user needs. System (Oxford, UK), 31, 1 (2003), 71–84.03–465 Mennim, P. (The University of Edinburgh, Scotland, UK). Rehearsed oral L2 output and reactive focus on form. ELT Journal, 57, 2 (2003), 130–138.03–466 Muñoz, Carmen (U. of Barcelona, Spain; Email: munoz@fil.ub.es). Le rythme d'acquisition des savoirs communicationnels chez des apprenants guidés: l'influence de l'âge. [Patterns of acquisition of communication skills in guided learning: the influence of age.] Aile, 18 (2002), 53–77.03–467 Newcombe, Lynda Pritchard (Cardiff University, Wales, UK). “A tough hill to climb alone” – Welsh learners speak. Hong Kong Journal of Applied Linguistics (Hong Kong, China), 7, 2 (2002), 39–56.03–468 Newman, Michael, Trenchs-Parera, Mireia and Pujol, Mercè (CUNY, USA; Email: mnewman@qc.edu). Core academic literacy principles versus culture-specific practices: a multi-case study of academic achievement. English for Specific Purposes (Amsterdam, NE), 22, 1 (2003), 45–71.03–469 Nsangou, Maryse. Problemursachen und Problemlösung in der zweitsprachlichen Kommunikation. [Problems in L2 communication: causes and solutions.] Deutsch als Fremdsprache, 39, 4 (2002), 232–237.03–470 O'Grady, William (U. of Hawaii, USA; Email: ogrady@hawaii.edu) and Yamashita, Yoshie. Partial agreement in second-language acquisition. Linguistics (Berlin, Germany), 40, 5 (2002), 1011–1019.03–471 Payne, J. Scott (Middlebury College, USA) and Whitney, Paul J. Developing L2 Oral Proficiency through Synchronous CMC: Output, Working Memory, and Interlanguage Development. CALICO Journal (Texas, USA), 20, 1 (2002), 7–32.03–472 Pekarek Doehler, Simona (U. of Basle, Switzerland). Situer l'acquisition des langues secondes dans les activités sociales: l'apport d'une perspective interactionniste. [Second-language acquisition through social activities: an interactionist perspective.] Babylonia (Comano, Switzerland), 4 (2002), 24–29.03–473 Philp, Jenefer (U. of Tasmania, Australia; Email: philos@tassie.net.au). Constraints on “noticing the gap”. Nonnative speakers' noticing of recasts in NS-NNS interaction. Studies in Second Language Acquisition (Cambridge, UK), 25 (2003), 99–126.03–474 Prévost, Philippe (U. Laval, Québec, Canada; Email: philippe.prevost@lli.ulaval.ca). Truncation and missing inflection in initial child L2 German. Studies in Second Language Acquisition (Cambridge, UK), 25 (2003), 65–97.03–475 Pujolá, Joan-Tomás (Universitat de Barcelona, Spain). CALLing for help: researching language learning strategies using help facilities in a web-based multimedia program. ReCALL (Cambridge, UK), 14, 2 (2002), 235–62.03–476 Rees, David (Institut National d'Horticulture d'Angers, France). Role change in interactive learning environments. Stratégies d'apprentissage (Toulouse, France), 12 (2003), 67–75.03–477 Rehner, Katherine, Mougeon, Raymond (York U., Toronto, Canada; Email: krehner@yorku.ca) and Nadasdi, Terry. The learning of sociolinguistic variation by advanced FSL learners. The case ofnousversusonin immersion French. Studies in Second Language Acquisition (Cambridge, UK), 25 (2003), 127–156.03–478 Richter, Regina. Konstruktivistiche Lern- und Mediendesign-Theorie und ihre Umsetzung in multimedialen Sprachlernprogrammen. [Constructivist learning- and media-design theory and its application in multimedia language-learning programmes.] Deutsch als Fremdsprache, 39, 4 (2002), 201–206.03–479 Rinder, Ann. Das konstruktivistische Lernparadigma und die neuen Medien. [The constructivist learning paradigm and the new media.] Info DaF (Munich, Germany), 30, 1 (2003), 3–22.03–480 Rott, Susanne and Williams, Jessica (U. of Chicago at Illinois, USA). Making form-meaning connections while reading: A qualitative analysis of word processing. Reading in a Foreign Language (Hawaii, USA), 15, 1 (2003), 45–75.03–481 Shinichi, Izumi (Sophia U., Japan; Email: s-izumi@hoffman.cc.sophia.ac.jp). Output, input enhancement, and the noticing hypothesis. Studies in Second Language Acquisition (Cambridge, UK), 24, 4 (2002), 541–577.03–482 Sifakis, N. C. (Hellenic Open U., Greece; Email: nicossif@hol.gr). Applying the adult education framework to ESP curriculum development: an integrative model. English for Specific Purposes (Amsterdam, NE), 22, 1 (2003), 195–211.03–483 Slabakova, Roumyana (U. of Iowa, USA; Email: roumyana-slabakova@uiowa.edu). Semantic evidence for functional categories in interlanguage grammars. Second Language Research (London, UK), 19, 1 (2003), 42–75.03–484 Soboleva, Olga and Tronenko, Natalia (LSE, UK; Email: O.Sobolev@lse.ac.uk). A Russian multimedia learning package for classroom use and self-study. Computer Assisted Language Learning (Lisse, NE), 15, 5 (2002), 483–499.03–485 Stockwell, Glenn (Kumamoto Gakuen U., Japan) and Harrington, Michael. The Incidental Development of L2 Proficiency in NS-NNS E-mail Interactions. CALICO Journal (Texas, USA), 20, 2 (2003), 337–359.03–486 Van de Craats, Ineke (Nijmegen U., Netherlands). The role of the mother tongue in second language learning. Babylonia (Comano, Switzerland), 4 (2002), 19–22.03–487 Vidal, K. (U. Autonoma de Madrid, Spain). Academic Listening: A Source of Vocabulary Acquisition?Applied Linguistics, 24, 1 (2003), 56–89.03–488 Wakabayashi, Shigenori (Gunma Prefectural Women's U., Japan; Email: waka@gpwu.ac.jp). Contributions of the study of Japanese as a second language to our general understanding of second language acquisition and the definition of second language acquisition research. Second Language Research (London, UK), 19, 1 (2003), 76–94.03–489 Ward, Monica (Dublin City U., Ireland). Reusable XML technologies and the development of language learning materials. ReCALL (Cambridge, UK), 14, 2 (2002), 283–92.03–490 Wendt, Michael (U. Bremen, Germany; Email: inform@uni-bremen.de). Context, culture, and construction: research implications of theory formation in foreign language methodology. Language, Culture and Curriculum (Clevedon, UK), 15, 3 (2002), 284–297.03–491 Wernsing, Armin Volkmar (Maria-Sybilla-Merian-Gymnasium/Studienseminar, Krefeld, Germany). Über die Zuversicht und andere Emotionen beim Fremdsprachenlernen. [Confidence and other emotions in foreign-language learning.] Fremdsprachenunterricht (Berlin, Germany), 2 (2003), 81–87.03–492 Wintergerst, Ann, DeCapua, Andrea and Verna, Marilyn (St. Johns U. New York, USA). An analysis of one learning styles instrument for language students. TESL Canada Journal (Burnaby, BC, Canada), 20, 1 (2002), 16–37.03–493 Yang, Anson and Lau, Lucas (City U. of Hong Kong; Email: enanson@cityu.edu.hk). Student attitudes to the learning of English at secondary and tertiary levels. System (Oxford, UK), 31, 1 (2003), 107–123.03–494 Yoshii, Makoto (Baiko Gakuin U., Japan) and Flaitz, Jeffra. Second Language Incident Vocabulary Retention: The Effect of Text and Picture Annotation Types. CALICO Journal (Texas, USA), 20, 1 (2002), 33–58.03–495 Yuan, F. (U. of Pennsylvania, USA) and Ellis, R. The Effects of Pre-Task Planning and On-Line Planning on Fluency, Complexity and Accuracy in L2 Monologic Oral Production. Applied Linguistics, 24, 1 (2003), 1–27.

04–573 Akker, Evelien (Nijmegen U., The Netherlands; Email: e.akker@nici.kun.nl) and Cutler, Anne. Prosodic cues to semantic structure in native and non-native listening. Bilingualism: Language and Cognition (Cambridge, UK), 6, 2 (2003), 81–96.04–574 Allen, Heather W. (University of Pittsburgh) and Herron, Carol A. mixed-methodology investigation of the linguistic and affective outcomes of summer study abroad. Foreign Language Annals (New York, USA), 36, 3 (2003), 370–385.04–575 Barcroft, Joe (Washington U., MO, USA; Email: barcroft@artsci.wustl.edu). Effects of questions about word meaning during L2 Spanish lexical learning. The Modern Language Journal (Madison, WI, USA), 87, 4 (2003), 546–561.04–576 Boehlke, Olaf (Creighton U., USA; Email: bohlke@creighton.edu). A comparison of student participation levels by group size and language stages during chatroom and face-to-face discussions in German. Calico Journal (Texas, USA), 21, 1 (2003), 67–87.04–577 Brandford, Verna and Wilson, Rebecca (Institute of Education, U. of London). Using PowerPoint to develop pupils' oral skills in modern foreign languages. Francophonie (London, UK), 28 (2003), 18–24.04–578 Brouwer, Catherine E. (U. of Southern Denmark, Denmark; Email: rineke@language.sdu.dk). Word searches in NNS-NS interaction: opportunities for language learning?The Modern Language Journal (Madison, WI, USA), 87, 4 (2003), 534–545.04–579 Carr, Jo (Queensland U. of Technology, Australia; Email: j.carr@qut.edu.au). Why boys into languages won't go: the problematic gender agenda in languages education. Babel, (Adelaide, Australia), 37, 2 (2002), 4–9.04–580 Chalhoub-Deville, Micheline (U. of Iowa, USA; Email: m-chalhoub-deville@uiowa.edu). Second language interaction: current perspectives and future trends. Language Testing (London, UK), 20, 4 (2003), 369–383.04–581 Chan, Victoria, Spratt, Mary and Humphreys, Gillian (Hong Kong Polytechnic U., Hong Kong). Autonomous language learning: Hong Kong tertiary students' attitudes and behaviours. Evaluation and Research in Education (Clevedon, UK), 16, 1 (2002), 1–16.04–582 Dam Jensen, Eva and Vinther, Thora (University of Copenhagen, Denmark; Email: dam@hum.ku.dk.). Exact repetition as input enhancement in second language acquisition. Language Learning (University of Michigan, USA), 53, 3 (2003), 373–428.04–583 De Carlo, Maddalena (Université de Cassino, Italy). Affectivité et acquisition du langage. [Affectivity and Language Acquisition.] Études de linguistique appliquée (Paris, France), 13, 1 (2003), 275–290.04–584 Derwing, Tracey M. (Alberta U., Canada) and Rossiter, Marian J. The effects of pronunciation instruction on the accuracy, fluency and complexity of L2 accented speech. Applied Language Learning (Monterey, CA, USA), 13, 1 (2003), 1–18.04–585 Dykstra-Pruim, Pennylyn (Calvin College, MI, USA). L2 acquisition of German plurals: how students form them and textbooks teach them. Die Unterrichtspraxis (Cherry Hill, NJ, USA), 36, 1 (2003), 43–55.04–586 Eckman, Fred (University of Wisconsin, USA; Email: eckman@uwm.edu), Elreyes, Abdullah and Iverson, Gregory. Some principles of second language phonology. Second Language Research (London, UK), 19, 3 (2003), 169–208.04–587 Egbert, Joy (Washington State U., USA; Email: jegbert@wsu.edu). A study of flow theory in the foreign language classroom. The Modern Language Journal (Madison, WI, USA), 87, 4 (2003), 499–518.04–588 Ehrman, Madeline (Foreign Service Institute, US Dept of State, Washington DC, USA; Email: ehrmann@aol.com) and Leaver, Betty Lou. Cognitive styles in the service of language learning. System, 31, 3 (2003), (Oxford), 393–415.04–589 Felser, Claudia (U. of Essex, UK; Email: felsec@essex.ac.uk), Roberts, Leah, Gross, Rebecca and Marinis, Theodore. The processing of ambiguous sentences by first and second language learners of English. Applied Psycholinguistics (Cambridge, UK), 24, 3 (2003), 453–490.04–590 Gass, Susan (Michigan State University, USA; Email: gass@msu.edu) and Svetics, Ildikó. Differential effects of attention. Language Learning (Michigan, USA), 53, 3 (2003), 497–545.04–591 Griffiths, Carol (Auckland Institute of Studies, Auckland, New Zealand; Email: carolg@ais.ac.nz). Patterns of language learning strategy use. System, (Oxford, UK), 31, 3 (2003), 367–383.04–592 Hertel, Tammy J. (Department of World Languages and Cultures, Juniata College, USA; Email: hertel@juniata.edu) Lexical and discourse factors in the second language acquisition of Spanish word order. Second Language Research (London, England), 19, 4 (2003), 273–304.04–593 Hertel, Tammy J. (Juniata College). Using an e-mail exchange to promote cultural learning. Foreign Language Annals (New York, USA), 36, 3 (2003), 386–396.04–594 Hu, Chieh-Fang (Taipei Municipal Teachers College, Taiwan; Email: cfhu@mail1.tmtc.edu.tw). Phonological memory, phonological awareness and foreign language word learning. Language Learning (University of Michigan, USA), 53, 3 (2003), 429–462.04–595 Izumi, Shinichi (Sophia University, Japan; Email: s-izumi@sophia.ac.jp). Processing difficulty in comprehension and production of relative clauses by learners of English as a second language. Language Learning (Michigan, USA), 53, 2 (2003), 285–323.04–596 Jones, Linda, J. (U. of Arkansas, USA; Email: lcjones@uark.edu). Supporting listening comprehension and vocabulary acquisition with multimedia annotation: the students' voice. Calico Journal (San Marcos Tex. USA), 21, 1 (2003), 41–65.04–597 Jung, Euen Hyuk (Sarah) (Yonsei U., South Korea; Email: jungehs@hotmail.com). The role of discourse signaling cues in second language listening comprehension. The Modern Language Journal (Madison, WI, USA), 87, 4 (2003), 562–577.04–598 Knutson, Sonja (Memorial U., Newfoundland, Canada). Experiential learning in second-language classrooms. TESL Canada Journal (Burnaby, B.C., Canada), 20, 2 (2003), 53–64.04–599 Littlemore, Jeannette (U. of Birmingham, UK). The communicative effectiveness of different types of communication strategy. System, (Oxford, UK), 31, 3 (2003), 331–34704–600 McCollum, Daniel L. (Pennsylvania State U., USA). Utilizing non-cognitive predictors of foreign language achievement. Applied Language Learning (Monterey, CA, USA), 13, 1 (2003), 19–32.04–601 Morris, Frank (University of Miami, USA; Email: fmorris@miami.edu.) and Tarone, Elaine. Impact of classroom dynamics on the effectiveness of recasts in second language acquisition. Language Learning (University of Michigan, USA), 53, 2 (2003), 325–368.04–602 Ntirampeba, Pascal (Université de Montréal, Québec, Canada). La progression en didactique du texte argumentatif écrit. [Progressive approach to written argumentative text.] Révue Canadienne de Linguistique Appliquée, 6, 2 (2003), 159–169.04–603 Parkinson, Brian, Benson, Cathy and Jenkins, Michael (U. of Edinburgh, Scotland, UK). Learner diary research with ‘Cambridge' examination candidates. Edinburgh Working Papers in Applied Linguistics (Edinburgh, Scotland, UK), 12 (2003), 45–63.04–604 Pérez, Luisa, C. (Emporia State U., USA; Email: perezlui@emporia.edu). Foreign language productivity in synchronous versus asynchronous computer-mediated communication. Calico Journal (Texas, USA), 21, 1 (2003), 89–104.04–605 Pulido, Diana (Washington State University, USA; Email: dpulido@wsu.edu.). Modeling the role of second language proficiency and topic familiarity in second language incidental vocabulary acquisition through reading. Language Learning (University of Michigan, USA), 53, 2 (2003), 233–284.04–606 Sasaki, Yoshinori (Ochanomizu U., Japan) and Hayakawa, Harumi. Does a quiz facilitate or spoil language learning? Instructional effects of lesson review quizzes. Applied Language Learning (Monterey, CA, USA), 13, 1 (2003), 33–56.04–607 Seus-Walker, Katia (IUT-Université de Toulouse III, France). Pour développer l'autonomie des apprenants. [Developing learner autonomy.] Les Cahiers de l'APLIUT, XXII, 2 (2003), 43–58.04–608 Sparks, Richard L. (College of Mount St. Joseph, Cincinnati, Ohio) Philips, Lois and Javorsky, James. College students classified as having learning disabilities and attention deficit hyperactivity disorder and the foreign language requirement. Foreign Language Annals (New York, USA), 36, 3 (2003), 325–337.04–609 Stotz, Daniel and Meuter, Tessa (Zürcher Hochschule Winterthur, Switzerland; Email: daniel.stotz@zhwin.ch). Embedded English: integrating content and language learning in a Swiss primary school project. Bulletin suisse de linguistique appliquée (Neuchâtel, Switzerland), 77 (2003), 83–101.04–610 Takeuchi, Osamu (Kansai U., Osaka, Japan; Email: takeuchi@ipcku.kansai-u.ac.jp). What can we learn from good foreign language learners? A qualitative study in the Japanese foreign language context. System, (Oxford, UK), 31, 3 (2003), 385–392.04–611 Vandergrift, Larry (University of Ottawa, Canada; Email: lvdgrift@uottawa.ca). Orchestrating strategy use: toward a model of the skilled second language listener. Language Learning (University of Michigan, USA), 53, 3 (2003), 463–496.04–612 Vann, Roberta J. (Iowa State U., USA) and Fairbairn, Shelley B. Linking our worlds: a collaborative academic literacy project. TESOL Journal (Alexandria, VA, USA), 12, 3 (2003), 11–16.04–613 Verspoor, Marjolijn and Lowie, Wander (University of Groningen, The Netherlands). Making sense of polysemous words. Language Learning (University of Michigan, USA), 53, 3 (2003), 547–586.04–614 Weldon, A. and Trautmann, G. (U. of North Carolina-Asheville, USA). Spanish and service-learning: pedagogy and praxis. Hispania (Ann Arbor, USA), 86, 3 (2003), 574–585.04–615 Wen, W. P. (Xiangtan U., Hunan, P.R. of China lw@xtu.edu.com) and Clément, R. A Chinese conceptualisation of willingness to communicate in ESL. Language, Culture and Curriculum, (Clevedon, UK) 16, 1 (2003), 18–38.04–616 Yeh, Yuli and Wang, Chai-wei. (National Tsing Hua U., Taiwan; Email: ylyeh@mx.nthu.edu.tw). Effects of multimedia vocabulary annotations and learning styles on vocabulary learning. Calico Journal (Texas, USA), 21, 1 (2003), 131–144.04–617 Yuet Hung Chan, C. (City U. of Hong Kong; Email: ctcych@cityu.edu.hk). Cultural content and reading proficiency: a comparison of mainland Chinese and Hong Kong learners of English. Language, Culture and Curriculum, (Clevedon, UK) 16, 1 (2003), 60–69.04–618 Zsiga, Elizabeth (Georgetown University, USA; Email: zsigae@georgetown.edu). Articulatory timing in a second language – evidence from Russian and English. Studies in Second Language Acquisition (New York, USA), 25, 3 (2003), 399–432.04–619 Zughoul, Muhammed Raji and Abdul-Fattah, Hussein (Yarmouk U., Jordan). Translational collocational strategies of Arab learners of English: a study in lexical semantics. Babel (Amsterdam, The Netherlands), 49, 1 (2003), 59–81.

At one point in Victor Hugo’s novel, The Hunchback of Notre Dame, the archdeacon, Claude Frollo, looked up from a book on his table to the edifice of the gothic cathedral, visible from his canon’s cell in the cloister of Notre Dame: “Alas!” he said, “this will kill that” (146). Frollo’s lament, that the book would destroy the edifice, captures the medieval cleric’s anxiety about the way in which Gutenberg’s print technology would become the new universal means for recording and communicating humanity’s ideas and artistic expression, replacing the grand monuments of architecture, human engineering, and craftsmanship. For Hugo, architecture was “the great handwriting of humankind” (149). The cathedral as the material outcome of human technology was being replaced by the first great machine—the printing press. At this point in the third millennium, some people undoubtedly have similar anxieties to Frollo: is it now the book’s turn to be destroyed by yet another great machine? The inclusion of “post print” in our title is not intended to sound the death knell of the book. Rather, we contend that despite the enduring value of print, digital publishing is “present and active” and is changing the way in which research, particularly in the humanities, is being undertaken. Our approach has three related parts. First, we consider how digital technologies are changing the way in which content is constructed, customised, modified, disseminated, and accessed within a global, distributed network. This section argues that the transition from print to electronic or digital publishing means both losses and gains, particularly with respect to shifts in our approaches to textuality, information, and innovative publishing. Second, we discuss the Children’s Literature Digital Resources (CLDR) project, with which we are involved. This case study of a digitising initiative opens out the transformative possibilities and challenges of digital publishing and e-scholarship for research communities. Third, we reflect on technology’s capacity to bring about major changes in the light of the theoretical and practical issues that have arisen from our discussion. I. Digitising in a “post-print age” We are living in an era that is commonly referred to as “the late age of print” (see Kho) or the “post-print age” (see Gunkel). According to Aarseth, we have reached a point whereby nearly all of our public and personal media have become more or less digital (37). As Kho notes, web newspapers are not only becoming increasingly more popular, but they are also making rather than losing money, and paper-based newspapers are finding it difficult to recruit new readers from the younger generations (37). Not only can such online-only publications update format, content, and structure more economically than print-based publications, but their wide distribution network, speed, and flexibility attract advertising revenue. Hype and hyperbole aside, publishers are not so much discarding their legacy of print, but recognising the folly of not embracing innovative technologies that can add value by presenting information in ways that satisfy users’ needs for content to-go or for edutainment. As Kho notes: “no longer able to satisfy customer demand by producing print-only products, or even by enabling online access to semi-static content, established publishers are embracing new models for publishing, web-style” (42). Advocates of online publishing contend that the major benefits of online publishing over print technology are that it is faster, more economical, and more interactive. However, as Hovav and Gray caution, “e-publishing also involves risks, hidden costs, and trade-offs” (79). The specific focus for these authors is e-journal publishing and they contend that while cost reduction is in editing, production and distribution, if the journal is not open access, then costs relating to storage and bandwith will be transferred to the user. If we put economics aside for the moment, the transition from print to electronic text (e-text), especially with electronic literary works, brings additional considerations, particularly in their ability to make available different reading strategies to print, such as “animation, rollovers, screen design, navigation strategies, and so on” (Hayles 38). Transition from print to e-text In his book, Writing Space, David Bolter follows Victor Hugo’s lead, but does not ask if print technology will be destroyed. Rather, he argues that “the idea and ideal of the book will change: print will no longer define the organization and presentation of knowledge, as it has for the past five centuries” (2). As Hayles noted above, one significant indicator of this change, which is a consequence of the shift from analogue to digital, is the addition of graphical, audio, visual, sonic, and kinetic elements to the written word. A significant consequence of this transition is the reinvention of the book in a networked environment. Unlike the printed book, the networked book is not bound by space and time. Rather, it is an evolving entity within an ecology of readers, authors, and texts. The Web 2.0 platform has enabled more experimentation with blending of digital technology and traditional writing, particularly in the use of blogs, which have spawned blogwriting and the wikinovel. Siva Vaidhyanathan’s The Googlization of Everything: How One Company is Disrupting Culture, Commerce and Community … and Why We Should Worry is a wikinovel or blog book that was produced over a series of weeks with contributions from other bloggers (see: http://www.sivacracy.net/). Penguin Books, in collaboration with a media company, “Six Stories to Start,” have developed six stories—“We Tell Stories,” which involve different forms of interactivity from users through blog entries, Twitter text messages, an interactive google map, and other features. For example, the story titled “Fairy Tales” allows users to customise the story using their own choice of names for characters and descriptions of character traits. Each story is loosely based on a classic story and links take users to synopses of these original stories and their authors and to online purchase of the texts through the Penguin Books sales website. These examples of digital stories are a small part of the digital environment, which exploits computer and online technologies’ capacity to be interactive and immersive. As Janet Murray notes, the interactive qualities of digital environments are characterised by their procedural and participatory abilities, while their immersive qualities are characterised by their spatial and encyclopedic dimensions (71–89). These immersive and interactive qualities highlight different ways of reading texts, which entail different embodied and cognitive functions from those that reading print texts requires. As Hayles argues: the advent of electronic textuality presents us with an unparalleled opportunity to reformulate fundamental ideas about texts and, in the process, to see print as well as electronic texts with fresh eyes (89–90). The transition to e-text also highlights how digitality is changing all aspects of everyday life both inside and outside the academy. Online teaching and e-research Another aspect of the commercial arm of publishing that is impacting on academe and other organisations is the digitising and indexing of print content for niche distribution. Kho offers the example of the Mark Logic Corporation, which uses its XML content platform to repurpose content, create new content, and distribute this content through multiple portals. As the promotional website video for Mark Logic explains, academics can use this service to customise their own textbooks for students by including only articles and book chapters that are relevant to their subject. These are then organised, bound, and distributed by Mark Logic for sale to students at a cost that is generally cheaper than most textbooks. A further example of how print and digital materials can form an integrated, customised source for teachers and students is eFictions (Trimmer, Jennings, & Patterson). eFictions was one of the first print and online short story anthologies that teachers of literature could customise to their own needs. Produced as both a print text collection and a website, eFictions offers popular short stories in English by well-known traditional and contemporary writers from the US, Australia, New Zealand, UK, and Europe, with summaries, notes on literary features, author biographies, and, in one instance, a YouTube movie of the story. In using the eFictions website, teachers can build a customised anthology of traditional and innovative stories to suit their teaching preferences. These examples provide useful indicators of how content is constructed, customised, modified, disseminated, and accessed within a distributed network. However, the question remains as to how to measure their impact and outcomes within teaching and learning communities. As Harley suggests in her study on the use and users of digital resources in the humanities and social sciences, several factors warrant attention, such as personal teaching style, philosophy, and specific disciplinary requirements. However, in terms of understanding the benefits of digital resources for teaching and learning, Harley notes that few providers in her sample had developed any plans to evaluate use and users in a systematic way. In addition to the problems raised in Harley’s study, another relates to how researchers can be supported to take full advantage of digital technologies for e-research. The transformation brought about by information and communication technologies extends and broadens the impact of research, by making its outputs more discoverable and usable by other researchers, and its benefits more available to industry, governments, and the wider community. Traditional repositories of knowledge and information, such as libraries, are juggling the space demands of books and computer hardware alongside increasing reader demand for anywhere, anytime, anyplace access to information. Researchers’ expectations about online access to journals, eprints, bibliographic data, and the views of others through wikis, blogs, and associated social and information networking sites such as YouTube compete with the traditional expectations of the institutions that fund libraries for paper-based archives and book repositories. While university libraries are finding it increasingly difficult to purchase all hardcover books relevant to numerous and varied disciplines, a significant proportion of their budgets goes towards digital repositories (e.g., STORS), indexes, and other resources, such as full-text electronic specialised and multidisciplinary journal databases (e.g., Project Muse and Proquest); electronic serials; e-books; and specialised information sources through fast (online) document delivery services. An area that is becoming increasingly significant for those working in the humanities is the digitising of historical and cultural texts. II. Bringing back the dead: The CLDR project The CLDR project is led by researchers and librarians at the Queensland University of Technology, in collaboration with Deakin University, University of Sydney, and members of the AustLit team at The University of Queensland. The CLDR project is a “Research Community” of the electronic bibliographic database AustLit: The Australian Literature Resource, which is working towards the goal of providing a complete bibliographic record of the nation’s literature. AustLit offers users with a single entry point to enhanced scholarly resources on Australian writers, their works, and other aspects of Australian literary culture and activities. AustLit and its Research Communities are supported by grants from the Australian Research Council and financial and in-kind contributions from a consortium of Australian universities, and by other external funding sources such as the National Collaborative Research Infrastructure Strategy. Like other more extensive digitisation projects, such as Project Gutenberg and the Rosetta Project, the CLDR project aims to provide a centralised access point for digital surrogates of early published works of Australian children’s literature, with access pathways to existing resources. The first stage of the CLDR project is to provide access to digitised, full-text, out-of-copyright Australian children’s literature from European settlement to 1945, with selected digitised critical works relevant to the field. Texts comprise a range of genres, including poetry, drama, and narrative for young readers and picture books, songs, and rhymes for infants. Currently, a selection of 75 e-texts and digital scans of original texts from Project Gutenberg and Internet Archive have been linked to the Children’s Literature Research Community. By the end of 2009, the CLDR will have digitised approximately 1000 literary texts and a significant number of critical works. Stage II and subsequent development will involve digitisation of selected texts from 1945 onwards. A precursor to the CLDR project has been undertaken by Deakin University in collaboration with the State Library of Victoria, whereby a digital bibliographic index comprising Victorian School Readers has been completed with plans for full-text digital surrogates of a selection of these texts. These texts provide valuable insights into citizenship, identity, and values formation from the 1930s onwards. At the time of writing, the CLDR is at an early stage of development. An extensive survey of out-of-copyright texts has been completed and the digitisation of these resources is about to commence. The project plans to make rich content searchable, allowing scholars from children’s literature studies and education to benefit from the many advantages of online scholarship. What digital publishing and associated digital archives, electronic texts, hypermedia, and so forth foreground is the fact that writers, readers, publishers, programmers, designers, critics, booksellers, teachers, and copyright laws operate within a context that is highly mediated by technology. In his article on large-scale digitisation projects carried out by Cornell and University of Michigan with the Making of America collection of 19th-century American serials and monographs, Hirtle notes that when special collections’ materials are available via the Web, with appropriate metadata and software, then they can “increase use of the material, contribute to new forms of research, and attract new users to the material” (44). Furthermore, Hirtle contends that despite the poor ergonomics associated with most electronic displays and e-book readers, “people will, when given the opportunity, consult an electronic text over the print original” (46). If this preference is universally accurate, especially for researchers and students, then it follows that not only will the preference for electronic surrogates of original material increase, but preference for other kinds of electronic texts will also increase. It is with this preference for electronic resources in mind that we approached the field of children’s literature in Australia and asked questions about how future generations of researchers would prefer to work. If electronic texts become the reference of choice for primary as well as secondary sources, then it seems sensible to assume that researchers would prefer to sit at the end of the keyboard than to travel considerable distances at considerable cost to access paper-based print texts in distant libraries and archives. We considered the best means for providing access to digitised primary and secondary, full text material, and digital pathways to existing online resources, particularly an extensive indexing and bibliographic database. Prior to the commencement of the CLDR project, AustLit had already indexed an extensive number of children’s literature. Challenges and dilemmas The CLDR project, even in its early stages of development, has encountered a number of challenges and dilemmas that centre on access, copyright, economic capital, and practical aspects of digitisation, and sustainability. These issues have relevance for digital publishing and e-research. A decision is yet to be made as to whether the digital texts in CLDR will be available on open or closed/tolled access. The preference is for open access. As Hayles argues, copyright is more than a legal basis for intellectual property, as it also entails ideas about authorship, creativity, and the work as an “immaterial mental construct” that goes “beyond the paper, binding, or ink” (144). Seeking copyright permission is therefore only part of the issue. Determining how the item will be accessed is a further matter, particularly as future technologies may impact upon how a digital item is used. In the case of e-journals, the issue of copyright payment structures are evolving towards a collective licensing system, pay-per-view, and other combinations of print and electronic subscription (see Hovav and Gray). For research purposes, digitisation of items for CLDR is not simply a scan and deliver process. Rather it is one that needs to ensure that the best quality is provided and that the item is both accessible and usable by researchers, and sustainable for future researchers. Sustainability is an important consideration and provides a challenge for institutions that host projects such as CLDR. Therefore, items need to be scanned to a high quality and this requires an expensive scanner and personnel costs. Files need to be in a variety of formats for preservation purposes and so that they may be manipulated to be useable in different technologies (for example, Archival Tiff, Tiff, Jpeg, PDF, HTML). Hovav and Gray warn that when technology becomes obsolete, then content becomes unreadable unless backward integration is maintained. The CLDR items will be annotatable given AustLit’s NeAt funded project: Aus-e-Lit. The Aus-e-Lit project will extend and enhance the existing AustLit web portal with data integration and search services, empirical reporting services, collaborative annotation services, and compound object authoring, editing, and publishing services. For users to be able to get the most out of a digital item, it needs to be searchable, either through double keying or OCR (optimal character recognition). The value of CLDR’s contribution The value of the CLDR project lies in its goal to provide a comprehensive, searchable body of texts (fictional and critical) to researchers across the humanities and social sciences. Other projects seem to be intent on putting up as many items as possible to be considered as a first resort for online texts. CLDR is more specific and is not interested in simply generating a presence on the Web. Rather, it is research driven both in its design and implementation, and in its focussed outcomes of assisting academics and students primarily in their e-research endeavours. To this end, we have concentrated on the following: an extensive survey of appropriate texts; best models for file location, distribution, and use; and high standards of digitising protocols. These issues that relate to data storage, digitisation, collections, management, and end-users of data are aligned with the “Development of an Australian Research Data Strategy” outlined in An Australian e-Research Strategy and Implementation Framework (2006). CLDR is not designed to simply replicate resources, as it has a distinct focus, audience, and research potential. In addition, it looks at resources that may be forgotten or are no longer available in reproduction by current publishing companies. Thus, the aim of CLDR is to preserve both the time and a period of Australian history and literary culture. It will also provide users with an accessible repository of rare and early texts written for children. III. Future directions It is now commonplace to recognize that the Web’s role as information provider has changed over the past decade. New forms of “collective intelligence” or “distributed cognition” (Oblinger and Lombardi) are emerging within and outside formal research communities. Technology’s capacity to initiate major cultural, social, educational, economic, political and commercial shifts has conditioned us to expect the “next big thing.” We have learnt to adapt swiftly to the many challenges that online technologies have presented, and we have reaped the benefits. As the examples in this discussion have highlighted, the changes in online publishing and digitisation have provided many material, network, pedagogical, and research possibilities: we teach online units providing students with access to e-journals, e-books, and customized archives of digitised materials; we communicate via various online technologies; we attend virtual conferences; and we participate in e-research through a global, digital network. In other words, technology is deeply engrained in our everyday lives. In returning to Frollo’s concern that the book would destroy architecture, Umberto Eco offers a placatory note: “in the history of culture it has never happened that something has simply killed something else. Something has profoundly changed something else” (n. pag.). Eco’s point has relevance to our discussion of digital publishing. The transition from print to digital necessitates a profound change that impacts on the ways we read, write, and research. As we have illustrated with our case study of the CLDR project, the move to creating digitised texts of print literature needs to be considered within a dynamic network of multiple causalities, emergent technological processes, and complex negotiations through which digital texts are created, stored, disseminated, and used. Technological changes in just the past five years have, in many ways, created an expectation in the minds of people that the future is no longer some distant time from the present. Rather, as our title suggests, the future is both present and active. References Aarseth, Espen. “How we became Postdigital: From Cyberstudies to Game Studies.” Critical Cyber-culture Studies. Ed. David Silver and Adrienne Massanari. New York: New York UP, 2006. 37–46. An Australian e-Research Strategy and Implementation Framework: Final Report of the e-Research Coordinating Committee. Commonwealth of Australia, 2006. Bolter, Jay David. Writing Space: The Computer, Hypertext, and the History of Writing. Hillsdale, NJ: Erlbaum, 1991. Eco, Umberto. “The Future of the Book.” 1994. 3 June 2008 ‹http://www.themodernword.com/eco/eco_future_of_book.html>. Gunkel, David. J. “What's the Matter with Books?” Configurations 11.3 (2003): 277–303. Harley, Diane. “Use and Users of Digital Resources: A Focus on Undergraduate Education in the Humanities and Social Sciences.” Research and Occasional Papers Series. Berkeley: University of California. Centre for Studies in Higher Education. 12 June 2008 ‹http://www.themodernword.com/eco/eco_future_of_book.html>. Hayles, N. Katherine. My Mother was a Computer: Digital Subjects and Literary Texts. Chicago: U of Chicago P, 2005. Hirtle, Peter B. “The Impact of Digitization on Special Collections in Libraries.” Libraries & Culture 37.1 (2002): 42–52. Hovav, Anat and Paul Gray. “Managing Academic E-journals.” Communications of the ACM 47.4 (2004): 79–82. Hugo, Victor. The Hunchback of Notre Dame (Notre-Dame de Paris). Ware, Hertfordshire: Wordsworth editions, 1993. Kho, Nancy D. “The Medium Gets the Message: Post-Print Publishing Models.” EContent 30.6 (2007): 42–48. Oblinger, Diana and Marilyn Lombardi. “Common Knowledge: Openness in Higher Education.” Opening up Education: The Collective Advancement of Education Through Open Technology, Open Content and Open Knowledge. Ed. Toru Liyoshi and M. S. Vijay Kumar. Cambridge, MA: MIT Press, 2007. 389–400. Murray, Janet H. Hamlet on the Holodeck: The Future of Narrative in Cyberspace. Cambridge, MA: MIT Press, 2001. Trimmer, Joseph F., Wade Jennings, and Annette Patterson. eFictions. New York: Harcourt, 2001.

This paper provides embedded, reflective practice-based insight arising from my experience collaborating to produce online and print-on-demand editions of a magazine showcasing the photography of members of haphazart! Contemporary Abstracts group (hereafter referred to as haphazart!). The group’s online visual, textual and activity-based practices via the photo sharing social networking site Flickr are portrayed as achieving cohesive visual identity. Stylistic analysis of pictures in support of this claim is not attempted. Rather negotiation, that Elliot has previously described in M/C Journal as innate in collaboration, is identified as the unifying factor. However, the collaborators’ adherence to Flickr’s communication platform proves problematic in the editorial context. Some technical incoherence with possible broader cultural implications is encountered during the process of repurposing images from screen to print. A Scan of Relevant Literature The photographic gaze perceives and captures objects which seem to ‘carry within them ready-made’ a work of art. But the reminiscences of the gaze are only made possible by knowing and associating with groups that define a tradition. The list of valorised subjects is not actually defined with reference to a culture, but rather by familiarity with a limited group. (Chamboredon 144) As part of the array of socio-cultural practices afforded by Web 2.0 interoperability, sites of produsage (Bruns) are foci for studies originating in many disciplines. Flickr provides a rich source of data that researchers interested in the interface between the technological and the social find useful to analyse. Access to the Flickr application programming interface enables quantitative researchers to observe a variety of means by which information is propagated, disseminated and shared. Some findings from this kind of research confirm the intuitive. For example, Negoecsu et al. find that “a large percentage of users engage in sharing with groups and that they do so significantly” ("Analyzing Flickr Groups" 425). They suggest that Flickr’s Groups feature appears to “naturally bring together two key aspects of social media: content and relations.” They also find evidence for what they call hyper-groups, which are “communities consisting of groups of Flickr groups” ("Flickr Hypergroups" 813). Two separate findings from another research team appear to contradict each other. On one hand, describing what they call “social cascades,” Cha et al. claim that “content in the form of ideas, products, and messages spreads across social networks like a virus” ("Characterising Social Cascades"). Yet in 2009 they claim that homocity and reciprocity ensure that “popularity of pictures is localised” ("Measurement-Driven Analysis"). Mislove et al. reflect that the affordances of Flickr influence the growth patterns they observe. There is optimism shared by some empiricists that through collation and analysis of Flickr tag data, the matching of perceptual structures of images and image annotation techniques will yield ontology-based taxonomy useful in automatic image annotation and ultimately, the Semantic Web endeavour (Kennedy et al.; Su et al.; Xu et al.). Qualitative researchers using ethnographic interview techniques also find Flickr a valuable resource. In concluding that the photo sharing hobby is for many a “serious leisure” activity, Cox et al. propose that “Flickr is not just a neutral information system but also value laden and has a role within a wider cultural order.” They also suggest that “there is genuinely greater scope for individual creativity, releasing the individual to explore their own identity in a way not possible with a camera club.” Davies claims that “online spaces provide an arena where collaboration over meanings can be transformative, impacting on how individuals locate themselves within local and global contexts” (550). She says that through shared ways of describing and commenting on images, Flickrites develop a common criticality in their endeavour to understand images, each other and their world (554).From a psychologist’s perspective, Suler observes that “interpersonal relationships rarely form and develop by images alone” ("Image, Word, Action" 559). He says that Flickr participants communicate in three dimensions: textual (which he calls “verbal”), visual, and via the interpersonal actions that the site affords, such as Favourites. This latter observation can surely be supplemented by including the various games that groups configure within the constraints of the discussion forums. These often include submissions to a theme and voting to select a winning image. Suler describes the place in Flickr where one finds identity as one’s “cyberpsychological niche” (556). However, many participants subscribe to multiple groups—45.6% of Flickrites who share images share them with more than 20 groups (Negoescu et al., "Analyzing Flickr Groups" 420). Is this a reflection of the existence of the hyper-groups they describe (2009) or, of the ranging that people do in search of a niche? It is also probable that some people explore more than a singular identity or visual style. Harrison and Bartell suggest that there are more interesting questions than why users create media products or what motivates them to do so: the more interesting questions center on understanding what users will choose to do ultimately with [Web2.0] capabilities [...] in what terms to define the success of their efforts, and what impact the opportunity for individual and collaborative expression will have on the evolution of communicative forms and character. (167) This paper addresseses such questions. It arises from a participatory observational context which differs from that of the research described above. It is intended that a different perspective about online group-based participation within the Flickr social networking matrix will avail. However, it will be seen that the themes cited in this introductory review prove pertinent. Context As a university teacher of a range of subjects in the digital media field, from contemporary photomedia to social media to collaborative multimedia practice, it is entirely appropriate that I embed myself in projects that engage, challenge and provide me with relevant first-hand experience. As an academic I also undertake and publish research. As a practicing new media artist I exhibit publically on a regular basis and consider myself semi-professional with respect to this activity. While there are common elements to both approaches to research, this paper is written more from the point of view of ‘reflective practice’ (Holmes, "Reconciling Experimentum") rather than ‘embedded ethnography’ (Pink). It is necessarily and unapologetically reflexive. Abstract Photography Hyper-Group A search of all Flickr groups using the query “abstract” is currently likely to return around 14,700 results. However, only in around thirty of them does the group name, its stated rules and, the stream of images that flow through the pool arguably reflect a sense of collective concept and aesthetic that is coherently abstract. This loose complex of groups comprises a hyper-group. Members of these groups often have co-memberships, reciprocal contacts, and regularly post images to a range of groups and comment on others’ posts to be found throughout. Given that one of Flickr’s largest groups, Black and White, currently has around 131,150 members and hosts 2,093,241 items in its pool, these abstract special interest groups are relatively small. The largest, Abstract Photos, has 11,338 members and hosts 89,306 items in its pool. The group that is the focus of this paper, haphazart!, currently has 2,536 members who have submitted 53,309 items. The group pool is more like a constantly flowing river because the most recently added images are foremost. Older images become buried in an archive of pages which cannot be reverse accessed at a rate greater than the seven pages linked from a current view. A member’s presence is most immediate through images posted to a pool. This structural feature of Flickr promotes a desire for currency; a need to post regularly to maintain presence. Negotiating Coherence to the Abstract The self-managing social dynamics in groups has, as Suler proposes to be the case for individuals, three dimensions: visual, textual and action. A group integrates the diverse elements, relationships and values which cumulatively constitute its identity with contributions from members in these dimensions. First impressions of that identity are usually derived from the group home page which consists of principal features: the group name, a selection of twelve most recent posts to the pool, some kind of description, a selection of six of the most recent discussion topics, and a list of rules (if any). In some of these groups, what is considered to constitute an abstract photographic image is described on the group home page. In some it is left to be contested and becomes the topic of ongoing forum debates. In others the specific issue is not discussed—the images are left to speak for themselves. Administrators of some groups require that images are vetted for acceptance. In haphazart! particular administrators dutifully delete from the pool on a regular basis any images that they deem not to comply with the group ethic. Whether reasons are given or not is left to the individual prosecutor. Mostly offending images just disappear from the group pool without trace. These are some of the ways that the coherence of a group’s visual identity is established and maintained. Two groups out of the abstract photography hyper-group are noteworthy in that their discussion forums are particularly active. A discussion is just the start of a new thread and may have any number of posts under it. At time of writing Abstract Photos has 195 discussions and haphazart! — the most talkative by this measure—has 333. Haphazart! invites submissions of images to regularly changing themes. There is always lively and idiosyncratic banter in the forum over the selection of a theme. To be submitted an image needs to be identified by a specific theme tag as announced on the group home page. The tag can be added by the photographer themselves or by anyone else who deems the image appropriate to the theme. An exhibition process ensues. Participant curators search all Flickr items according to the theme tag and select from the outcome images they deem to most appropriately and abstractly address the theme. Copies of the images together with comments by the curators are posted to a dedicated discussion board. Other members may also provide responses. This activity forms an ongoing record that may serve as a public indicator of the aesthetic that underlies the group’s identity. In Abstract Photos there is an ongoing discussion forum where one can submit an image and request that the moderators rule as to whether or not the image is ‘abstract’. The same group has ongoing discussions labelled “Hall of Appropriate” where worthy images are reposted and celebrated and, “Hall of Inappropriate” where images posted to the group pool have been removed and relegated because abstraction has been “so far stretched from its definition that it now resides in a parallel universe” (Askin). Reasons are mostly courteously provided. In haphazart! a relatively small core of around twelve group members regularly contribute to the group discussion board. A curious aspect of this communication is that even though participants present visually with a ‘buddy icon’ and most with a screen name not their real name, it is usual practice to address each other in discussions by their real Christian names, even when this is not evident in a member’s profile. This seems to indicate a common desire for authenticity. The makeup of the core varies from time to time depending on other activities in a member’s life. Although one or two may be professionally or semi-professionally engaged as photographers or artists or academics, most of these people would likely consider themselves to be “serious amateurs” (Cox). They are internationally dispersed with bias to the US, UK, Europe and Australia. English is the common language though not the natural tongue of some. The age range is approximately 35 to 65 and the gender mix 50/50. The group is three years old. Where Do We Go to from Here? In early January 2009 the haphazart! core was sparked into a frenzy of discussion by a post from a member headed “Where do we go to from here?” A proposal was mooted to produce a ‘book’ featuring images and texts representative of the group. Within three days a new public group with invited membership dedicated to the idea had been established. A smaller working party then retreated to a private Flickr group. Four months later Issue One of haphazart! magazine was available in print-on-demand and online formats. Following however is a brief critically reflective review of some of the collaborative curatorial, editorial and production processes for Issue Two which commenced in early June 2009. Most of the team had also been involved with Issue One. I was the only newcomer and replaced the person who had undertaken the design for Issue One. I was not provided access to the prior private editorial ruminations but apparently the collaborative curatorial and editorial decision-making practices the group had previously established persisted, and these took place entirely within the discussion forums of a new dedicated private Flickr group. Over a five-month period there were 1066 posts in 54 discussions concerning matters such as: change of format from the previous; selection of themes, artists and images; conduct of and editing of interviews; authoring of texts; copyright and reproduction. The idiom of those communications can be described as: discursive, sporadic, idiosyncratic, resourceful, collegial, cooperative, emphatic, earnest and purposeful. The selection process could not be said to follow anything close to a shared manifesto, or articulation of style. It was established that there would be two primary themes: the square format and contributors’ use of colour. Selection progressed by way of visual presentation and counter presentation until some kind of consensus was reached often involving informal votes of preference. Stretching the Limits of the Flickr Social Tools The magazine editorial collaborators continue to use the facilities with which they are familiar from regular Flickr group participation. However, the strict vertically linear format of the Flickr discussion format is particularly unsuited to lengthy, complex, asynchronous, multithreaded discussion. For this purpose it causes unnecessary strain, fatigue and confusion. Where images are included, the forums have set and maximum display sizes and are not flexibly configured into matrixes. Images cannot readily be communally changed or moved about like texts in a wiki. Likewise, the Flickrmail facility is of limited use for specialist editorial processes. Attachments cannot be added. This opinion expressed by a collaborator in the initial, open discussion for Issue One prevailed among Issue Two participants: do we want the members to go to another site to observe what is going on with the magazine? if that’s ok, then using google groups or something like that might make sense; if we want others to observe (and learn from) the process - we may want to do it here [in Flickr]. (Valentine) The opinion appears socially constructive; but because the final editorial process and production processes took place in a separate private forum, ultimately the suggested learning between one issue and the next did not take place. During Issue Two development the reluctance to try other online collaboration tools for the selection processes requiring visual comparative evaluation of images and trials of sequencing adhered. A number of ingenious methods of working within Flickr were devised and deployed and, in my opinion, proved frustratingly impractical and inefficient. The digital layout, design, collation and formatting of images and texts, all took place on my personal computer using professional software tools. Difficulties arose in progressively sharing this work for the purposes of review, appraisal and proofing. Eventually I ignored protests and insisted the team review demonstrations I had converted for sharing in Google Documents. But, with only one exception, I could not tempt collaborators to try commenting or editing in that environment. For example, instead of moving the sequence of images dynamically themselves, or even typing suggestions directly into Google Documents, they would post responses in Flickr. To Share and to Hold From the first imaginings of Issue One the need to have as an outcome something in one’s hands was expressed and this objective is apparently shared by all in the haphazart! core as an ongoing imperative. Various printing options have been nominated, discussed and evaluated. In the end one print-on-demand provider was selected on the basis of recommendation. The ethos of haphazart! is clearly not profit-making and conflicts with that of the printing organisation. Presumably to maintain an incentive to purchase the print copy online preview is restricted to the first 15 pages. To satisfy the co-requisite to make available the full 120 pages for free online viewing a second host that specialises in online presentation of publications is also utilised. In this way haphazart! members satisfy their common desires for sharing selected visual content and ideas with an online special interest audience and, for a physical object of art to relish—with all the connotations of preciousness, fetish, talisman, trophy, and bookish notions of haptic pleasure and visual treasure. The irony of publishing a frozen chunk of the ever-flowing Flickriver, whose temporally changing nature is arguably one of its most interesting qualities, is not a consideration. Most of them profess to be simply satisfying their own desire for self expression and would eschew any critical judgement as to whether this anarchic and discursive mode of operation results in a coherent statement about contemporary photographic abstraction. However there remains a distinct possibility that a number of core haphazart!ists aspire to transcend: popular taste; the discernment encouraged in camera clubs; and, the rhetoric of those involved professionally (Bourdieu et al.); and seek to engage with the “awareness of illegitimacy and the difficulties implied by the constitution of photography as an artistic medium” (Chamboredon 130). Incoherence: A Technical Note My personal experience of photography ranges from the filmic to the digital (Holmes, "Bridging Adelaide"). For a number of years I specialised in facsimile graphic reproduction of artwork. In those days I became aware that films were ‘blind’ to the psychophysical affect of some few particular paint pigments. They just could not be reproduced. Even so, as I handled the dozens of images contributed to haphazart!2, converting them from the pixellated place where Flickr exists to the resolution and gamut of the ink based colour space of books, I was surprised at the number of hue values that exist in the former that do not translate into the latter. In some cases the affect is subtle so that judicious tweaking of colour levels or local colour adjustment will satisfy discerning comparison between the screenic original and the ‘soft proof’ that simulates the printed outcome. In other cases a conversion simply does not compute. I am moved to contemplate, along with Harrison and Bartell (op. cit.) just how much of the experience of media in the shared digital space is incomparably new? Acknowledgement Acting on the advice of researchers experienced in cyberethnography (Bruckman; Suler, "Ethics") I have obtained the consent of co-collaborators to comment freely on proceedings that took place in a private forum. They have been given the opportunity to review and suggest changes to the account. References Askin, Dean (aka: dnskct). “Hall of Inappropriate.” Abstract Photos/Discuss/Hall of Inappropriate, 2010. 12 Jan. 2010 ‹http://www.flickr.com/groups/abstractphotos/discuss/72157623148695254/>. Bourdieu, Pierre, Luc Boltanski, Robert Castel, Jean-Claude Chamboredeon, and Dominique Schnapper. Photography: A Middle-Brow Art. 1965. Trans. Shaun Whiteside. Stanford: Stanford UP, 1990. Bruckman, Amy. Studying the Amateur Artist: A Perspective on Disguising Data Collected in Human Subjects Research on the Internet. 2002. 12 Jan. 2010 ‹http://www.nyu.edu/projects/nissenbaum/ethics_bru_full.html>. Bruns, Axel. “Towards Produsage: Futures for User-Led Content Production.” Proceedings: Cultural Attitudes towards Communication and Technology 2006. Perth: Murdoch U, 2006. 275–84. ———, and Mark Bahnisch. Social Media: Tools for User-Generated Content. Vol. 1 – “State of the Art.” Sydney: Smart Services CRC, 2009. Cha, Meeyoung, Alan Mislove, Ben Adams, and Krishna P. Gummadi. “Characterizing Social Cascades in Flickr.” Proceedings of the First Workshop on Online Social Networks. ACM, 2008. 13–18. ———, Alan Mislove, and Krishna P. Gummadi. “A Measurement-Driven Analysis of Information Propagation in the Flickr Social Network." WWW '09: Proceedings of the 18th International Conference on World Wide Web. ACM, 2009. 721–730. Cox, A.M., P.D. Clough, and J. Marlow. “Flickr: A First Look at User Behaviour in the Context of Photography as Serious Leisure.” Information Research 13.1 (March 2008). 12 Dec. 2009 ‹http://informationr.net/ir/13-1/paper336.html>. Chamboredon, Jean-Claude. “Mechanical Art, Natural Art: Photographic Artists.” Photography: A Middle-Brow Art. Pierre Bourdieu. et al. 1965. Trans. Shaun Whiteside. Stanford: Stanford UP, 1990. 129–149. Davies, Julia. “Display, Identity and the Everyday: Self-Presentation through Online Image Sharing.” Discourse: Studies in the Cultural Politics of Education 28.4 (Dec. 2007): 549–564. Elliott, Mark. “Stigmergic Collaboration: The Evolution of Group Work.” M/C Journal 9.2 (2006). 12 Jan. 2010 ‹http://journal.media-culture.org.au/0605/03-elliott.php>. Harrison, Teresa, M., and Brea Barthel. “Wielding New Media in Web 2.0: Exploring the History of Engagement with the Collaborative Construction of Media Products.” New Media & Society 11.1-2 (2009): 155–178. Holmes, Ashley. “‘Bridging Adelaide 2001’: Photography and Hyperimage, Spanning Paradigms.” VSMM 2000 Conference Proceedings. International Society for Virtual Systems and Multimedia, 2000. 79–88. ———. “Reconciling Experimentum and Experientia: Reflective Practice Research Methodology for the Creative Industries”. Speculation & Innovation: Applying Practice-Led Research in the Creative Industries. Brisbane: QUT, 2006. Kennedy, Lyndon, Mor Naaman, Shane Ahern, Rahul Nair, and Tye Rattenbury. “How Flickr Helps Us Make Sense of the World: Context and Content in Community-Contributed Media Collections.” MM’07. ACM, 2007. Miller, Andrew D., and W. Keith Edwards. “Give and Take: A Study of Consumer Photo-Sharing Culture and Practice.” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2007. 347–356. Mislove, Alan, Hema Swetha Koppula, Krishna P. Gummadi, Peter Druschel and Bobby Bhattacharjee. “Growth of the Flickr Social Network.” Proceedings of the First Workshop on Online Social Networks. ACM, 2008. 25–30. Negoescu, Radu-Andrei, and Daniel Gatica-Perez. “Analyzing Flickr Groups.” CIVR '08: Proceedings of the 2008 International Conference on Content-Based Image and Video Retrieval. ACM, 2008. 417–426. ———, Brett Adams, Dinh Phung, Svetha Venkatesh, and Daniel Gatica-Perez. “Flickr Hypergroups.” MM '09: Proceedings of the Seventeenth ACM International Conference on Multimedia. ACM, 2009. 813–816. Pink, Sarah. Doing Visual Ethnography: Images, Media and Representation in Research. 2nd ed. London: Sage, 2007. Su, Ja-Hwung, Bo-Wen Wang, Hsin-Ho Yeh, and Vincent S. Tseng. “Ontology–Based Semantic Web Image Retrieval by Utilizing Textual and Visual Annotations.” 2009 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology – Workshops. 2009. Suler, John. “Ethics in Cyberspace Research: Consent, Privacy and Contribution.” The Psychology of Cyberspace. 1996. 12 Jan. 2010 ‹http://www-usr.rider.edu/~suler/psycyber/psycyber.html>. ———. “Image, Word, Action: Interpersonal Dynamics in a Photo-Sharing Community.” Cyberpsychology & Behavior 11.5 (2008): 555–560. Valentine, Mark. “HAPHAZART! Magazine/Discuss/image selections…” [discussion post]. 2009. 12 Jan. 2010 ‹http://www.flickr.com/groups/haphazartmagazin/discuss/72157613147017532/>. Xu, Hongtao, Xiangdong Zhou, Mei Wang, Yu Xiang, and Baile Shi. “Exploring Flickr’s Related Tags for Semantic Annotation of Web Images.” CIVR ’09. ACM, 2009.

ObjectiveLANL has built a software program that automatically collectsglobal notifiable disease data—particularly data stored in files—andmakes it available and shareable within the Biosurveillance Ecosystem(BSVE) as a new data source. This will improve the prediction andearly warning of disease events and other applications.IntroductionMost countries do not report national notifiable disease data in amachine-readable format. Data are often in the form of a file thatcontains text, tables and graphs summarizing weekly or monthlydisease counts. This presents a problem when information is neededfor more data intensive approaches to epidemiology, biosurveillanceand public health as exemplified by the Biosurveillance Ecosystem(BSVE).While most nations do likely store their data in a machine-readableformat, the governments are often hesitant to share data openly fora variety of reasons that include technical, political, economic, andmotivational issues [1]. For example, an attempt by LANL to obtaina weekly version of openly available monthly data, reported by theAustralian government, resulted in an onerous bureaucratic reply. Theobstacles to obtaining data included: paperwork to request data fromeach of the Australian states and territories, a long delay to obtaindata (up to 3 months) and extensive limitations on the data’s use thatprohibit collaboration and sharing. This type of experience whenattempting to contact public health departments or ministries of healthfor data is not uncommon.A survey conducted by LANL of notifiable disease data reportingin 52 countries identified only 10 as being machine-readable and42 being reported in pdf files on a regular basis. Within the 42 nationsthat report in pdf files, 32 report in a structured, tabular format and10 in a non-structured way.As a result, LANL has developed a tool-Epi Archive (formerlyknown as EPIC)-to automatically and continuously collect globalnotifiable disease data and make it readily accesible.MethodsWe conducted a survey of the national notifiable disease reportingsystems notating how the data is reported in two important dimensions:date standards and case definitions.The development of software to regularly ingests notifiabledisease data frand makes this data available involved four main stepsscraping, extracting, parsing and persisting.For scraping: we would examine website designs and determinereporting mechanisms for each country/website as well as what variesacross the reporting mechanisms. We then designed and wrote codeto automate the downloading of report pdf files, for each country.We stored report pdfs along with appropriate metadata for extractingand parsing.For extracting: we developed software that can extract notifiabledisease data presented in tabular form from a pdf file. We combinedthe methodology of figure placement detection with the in-housedeveloped table extraction and annotation heuristics.For parsing: we determined what to extract from each pdf dataset from the survey conducted. We then parsed the extracted datainto uniform data structures correctly accommodating the dimensionssurveyed and the various human languages. This task involvedingesting notifiable disease data in many disparate formats extractedfrom pdf files and coalescing the data into a standardized format.For persisting: We then store the data in the Epi ArchivePostgreSQL database and make it available through the BSVE.ResultsThe EpiArchive tool currently contains subnational notifiabledisease data from 10 nations. When a user accesses the EpiArchivesite, they are prompted with four fields: country, region, disease,and date duration. These fields allow the user to specify the location(down to the state level), the disease of interest, and the durationof interest. Upon form submission, a time series is generated fromthe users’ specifications. The generated time series can then bedownloaded into a csv file if a user is interested in performingpersonal analysis. Additionally, the data from EpiArchive can bereached through an API.ConclusionsLANL as part of a currently funded DTRA effort so that it willautomatically and continuously collect global notifiable diseasedata—particularly data stored in pdf files—and make it available andshareable within the Biosurveillance Ecosystem (BSVE) as a newdata source. This will provide data to analytics and users that willimprove the prediction and early warning of disease events and otherapplications.