Language, Context and Location

Similar documents
Attribution and impact for social science data

Can Linguistics Lead a Digital Revolution in the Humanities?

A Computer-Supported Methodology for Recording and Visualising Visitor Behaviour in Museums

13. The Digital Archive and Catalogues of the Vanuatu Cultural Centre: Overview, Collaboration and Future Directions

Knowledge Management for Command and Control

Image Extraction using Image Mining Technique

PYBOSSA Technology. What is PYBOSSA?

Years 5 and 6 standard elaborations Australian Curriculum: Design and Technologies

CHAPTER I INTRODUCTION. consists of organization of the paper as the general description of the research

TITLE: Using collections and worksets in large-scale corpora: Preliminary findings from the Workset Creation for Scholarly Analysis project

Using Qualitative Data Software: An introduction to NVivo. Gareth Harris

J A M E S C O S U L L I VA N J O S U L L I VA N. O R G U N I V E R S I T Y O F S H E F F I E L D

A Demo for efficient human Attention Detection based on Semantics and Complex Event Processing

Human-computer Interaction Research: Future Directions that Matter

Years 9 and 10 standard elaborations Australian Curriculum: Design and Technologies

SPACES FOR CREATING CONTEXT & AWARENESS - DESIGNING A COLLABORATIVE VIRTUAL WORK SPACE FOR (LANDSCAPE) ARCHITECTS

Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives

TV Categories. Call for Entries Deadlines Pricing. National:

DISCUSSION. 12th IAPR International Workshop on Graphics Recognition Kyoto, Japan - November Josep Lladós

2 Development of multilingual content and systems

TV Categories. Call for Entries Deadlines Pricing. National: 1 Actress in a Leading Role - Comedy or Musical [TV National]

REAL TIME, REAL LIVES,

Canadian Clay & Glass Gallery. Strategic Plan

PHOTOGRAPHY Course Descriptions and Outcomes

Funding line 1: Cultural Heritage and History

Trenton Public Schools. Eighth Grade Technological Literacy 2013

Introduction. Description of the Project. Debopam Das

Loughborough University Institutional Repository. This item was submitted to Loughborough University's Institutional Repository by the/an author.

Argumentative Interactions in Online Asynchronous Communication

Selected Research Signal & Information Processing Group

Management Operations Control Applications (MOCA) Mission Update

Address by Mr Koïchiro Matsuura, Director-General of UNESCO, on the occasion of the Opening ceremony of the UNESCO Future Forum

Using Imagery for Intelligence Analysis. Jim Michel Renee Bernstein

Good Benchmarks are Hard To Find: Toward the Benchmark for Information Retrieval Applications in Software Engineering ABSTRACT 1. WHY?

ECMA TR/105. A Shaped Noise File Representative of Speech. 1 st Edition / December Reference number ECMA TR/12:2009

Years 3 and 4 standard elaborations Australian Curriculum: Design and Technologies

COMPREHENSIVE COMPETITIVE INTELLIGENCE MONITORING IN REAL TIME

Haptic messaging. Katariina Tiitinen

GLOSSARY for National Core Arts: Media Arts STANDARDS

Project Example: wissen.de

Using forced alignment and HTML5 media syntax to share speech archive data. John Coleman. Phonetics Laboratory, Oxford

This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore.

Data users and data producers interaction: the Web-COSI project experience

Marketing and Designing the Tourist Experience

Nichesourcing the Uralic languages for the benefit of research and societies

Joining Forces University of Art and Design Helsinki September 22-24, 2005

The concept of memory is integral to theorizations of both displacement and placelessness, especially when a sense of place exists only in memory or

TITLE OF PRESENTATION. Elsevier s Challenge. Dynamic Knowledge Stores and Machine Translation. Presented By Marius Doornenbal,, Anna Tordai

University of Huddersfield Repository

Chapter 1 Virtual World Fundamentals

Challenges in Software Evolution

CHAPTER 8 RESEARCH METHODOLOGY AND DESIGN

A Kinect-based 3D hand-gesture interface for 3D databases

PART III. Experience. Sarah Pink

Sharing Data Between CAD and GIS Systems. Lien Alpert Phil Sanchez

Exploring the New Trends of Chinese Tourists in Switzerland

Digital Preservation Analyst

Greece. Stefanos Kollias NTUA Greek NRG Representative. Map of Greece, late 17 th -early 18 th century Egg tempera on panel Benaki Museum

Ranking the annotators: An agreement study on argumentation structure

Clinical Open Innovation

Automation: Assessing the Impact on Qualitative Research

immersive visualization workflow

COSTUME DESIGN & RENDERING INTEGRATED DRAMA & DESIGN PROJECT

THE IMPACT OF INTERACTIVE DIGITAL STORYTELLING IN CULTURAL HERITAGE SITES

2. STARTING GAMBIT. 2.1 Startup Procedures

Connecting museum collections and creator communities: The Virtual Museum of the Pacific project

Design and technology

WSC WORLD SPORTS World Sports Council COUNCIL

INVESTIGATING UNDERSTANDINGS OF AGE IN THE WORKPLACE

The Socio-Cultural Construction of Ubiquitous Computing. What is UbiComp?

The 2020 Census A New Design for the 21 st Century

Rec. ITU-R SM RECOMMENDATION ITU-R SM.1048 DESIGN GUIDELINES FOR A BASIC AUTOMATED SPECTRUM MANAGEMENT SYSTEM (BASMS) (Question ITU-R 68/1)

EDUCATION GIS CONFERENCE Geoprocessing with ArcGIS Pro. Rudy Prosser GISP CTT+ Instructor, Esri

Strategies for the 2010 Population Census of Japan

3 EVALUATING INTERFACE DESIGN

Technology Needs Assessments under GEF Enabling Activities Top Ups

DreamCatcher Agile Studio: Product Brochure

SAFETY BEFORE SANCTIONS, SANCTIONS BEFORE BARRIERS: DIGITAL ACCESS PROTOCOL FOR ANINDILYAKWA PEOPLE OF GROOTE EYLANDT

Why visualize library data? Why invest

H3: Here s to Your (Digital Archive s) Good Health:

Center for Open Data in the Humanities (CODH): Activities and Future Plans

Years 9 and 10 standard elaborations Australian Curriculum: Digital Technologies

Convergence of Knowledge and Culture

M2M Communications and IoT for Smart Cities

CENTRE FOR JAWAHARLAL NEHRU STUDIES JAMIA MILLIA ISLAMIA, New Delhi. VIGYAN PRASAR, Department of Science & Technology, Government of India

Our digital future. SEPA online. Facilitating effective engagement. Enabling business excellence. Sharing environmental information

Situational Awareness Object (SAO), A Simple, Yet Powerful Tool for Operational C2 Systems

REPORT FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT AND THE COUNCIL. on the evaluation of Europeana and the way forward. {SWD(2018) 398 final}

INVOLVING THE PUBLIC IN NOISE SURVEYS VIA MOBILE TECHNOLOGY

Design and Technology Subject Outline Stage 1 and Stage 2

User Interaction and Perception from the Correlation of Dynamic Visual Responses Melinda Piper

Contextual Design Observations

TELLING STORIES OF VALUE WITH IOT DATA

Economic and Social Council

TRACING THE EVOLUTION OF DESIGN

Visualising Emotions Defining Urban Space through Shared Networks. Héctor Giró Margit Tamas Delft University of Technologie The Netherlands

Religion Studies Subject Outline Stage 1 and Stage 2

Chapter 4. Research Objectives and Hypothesis Formulation

Evaluating Naïve Users Experiences Of Novel ICT Products

Programme TOC. CONNECT Platform CONNECTION Client MicroStation CONNECT Edition i-models what is comming

Transcription:

Language, Context and Location Svenja Adolphs

Language and Context Everyday communication has evolved rapidly over the past decade with an increase in the use of digital devices. Techniques for capturing and representing language in context are also changing. Contexts are dynamic and always changing. They can be defined as everything outside the expression itself that is necessary for unambiguous interpretation of [that] expression (Heylighen and Dewaele 2003: 293).

Language and Context Although the notion of language in context has long been perceived to be of critical importance to linguistic research, facilities for examining this relationship in terms of conventional corpus linguistic methodology are limited. There is now a need to take account of this change and to develop corpora which include information about context and its dynamic nature.

Language and Context This presentation will discuss some of the different ways in which we may relate measurements of different aspects of context gathered from multiple sensors (e.g. position, movement and time) to people s use of language: Design (record) Representation Analysis (replay)

DReSS I: Multimodal Corpora

DReSS II: Ubiquitous Corpora

Recording of discourse beyond the text. Record Adding video and audio to basic transcription records in multimodal corpora represents a step towards enriching the textual rendering of a discourse event with further contextual data (in multimodal corpora). The development of heterogeneous corpora depends on our ability to record and represent different modes of discourse and different types of contextual information in an integrated manner.

(Re)present DRS provides a framework for the organization and representation of qualitative fieldwork data, supporting: Synchronisation Transcription Coding Annotation Visualisation Filtering Thick description

VIDEO 23 Replay: DRS

VIDEO 25 Replay: DRS

Thrill A 55,000 word corpus of fairground discourse, comprised of synchronised records of audio, video and sensory (i.e. heart rate) data. 55 participants (mainly recorded in pairs) 19 women, 26 men Ages range from teens to late 50s Over 11 hours video

Thrill Data has been transcribed and divided into 4 key phases: Aims: Pre-ride phase The elevation of the ride Start of the ride Ride terminus To examine whether any patterns emerge in specific language used within/ across the phases. To outline and test an appropriate to the analysis of heterogeneous data sets for linguistic enquiry.

VIDEO 26 SEGMENT Thrill

Thrill

Thrill

Thrill

Thrill

Thrill

(Oh) my God Phase 3 (Oh) my god is used 85 times by 21 different speakers. It occurs most often at phases 2 and 3 of the ride- ride elevation and movement.

Location based data Provides the means for exploring patterns of language use across speakers, modes of interaction (i.e. with the use of computer devices), time and place. This provides the foundations for providing a better understanding of the importance of contextual features of discourse.

Location based data Early efforts: utilising separate recording devices to collect data on the move

Early visions

Early visions

Early visions

Field Work Tracker A bespoke mobile application which creates detailed location based logs. This was developed to support the capture for qualitative analysis of fieldwork data, providing a cheap and simple multi-function recorder which allows for automated synchronisation of data. Studies can be tracked from the users perspective or the researchers perspective. Users can take photographs, audio recordings or movies and make textual notes as well as the recorded locations.

DRS and Field Work Tracker Fieldwork Tracker application

Location data in DRS DRS supports the analysis and creation of descriptive categories of location: in a cafe, at home and so on. These can be searched, sorted, filtered and queried using the DRS analysis tools. Logs from the measured locations (obtained using the Fieldwork Tracker) can have descriptive labels assigned to them in DRS (as a form of metadata), allowing the analyst to the investigate patterns across a larger and more context relevant dataset.

VIDEO 2 SEGMENT Location data in DRS

British Art Show

British Art Show 10+ hours of transcribed audio data collected from 3 pairs of visitors (1 M-M, 1 M-F, 1 F-F), capturing: Physical movements Interactions focused on planning, logistics Interactions focused on the socially negotiated goal of seeing art How they plan, negotiate & find each other Variation in language through changing contexts (home, street, gallery, friends & strangers)

British Art Show Video clips were recorded by participants and researcher. Photographs were also taken by participants. The BAS study data was collected using the Fieldwork Tracker application, thus have all the necessary synchronisation to enable DRS to, with one click, import all data from a Fieldwork Tracker session into a project in DRS.

VIDEOS 3, 28, 29, 30 British Art Show

DRS allows users: To generate word frequency lists Analysing data Run concordance searches over multiple different data sources. View specific concordance outputs on a map. Add metadata codes to map, allowing users to query data by searching for co-occurrences of codes and/or lexical items. Tabulate coded features. Use coded elements of the map as a means for drilling into the data.

VIDEO 9 Analysing data

VIDEO 10 Analysing data

Crowdsourcing Crowd sourcing is a method by which we can gather a large amount of data collected by the population at large. People contribute in some way to a large database of information that is made publically available. As researchers, this gives us access to potentially incredibly rich and varied datasets.

Crowdsourcing The OED provides one of the earliest examples of crowd sourcing. An open call was made to the community for contributions by volunteers to index all words in the English language and example quotations for each of their usages. In the 70 year project, they received over 6 million submissions. With the advent pervasive technology, crowd sourcing is an increasingly viable approach to data gathering.

Crowdsourcing Ushahidi is a crowdsourcing website which was used to collect messages from a wide range of individuals following the Haiti earthquake in 2009. Users can send messages to the site to report incidents which occur at a specific time and place. 3600 incidents were reported on this site. The database is stored as a CSV file which can be accessed by anyone.

VIDEO 16 SEGMENT Crowdsourcing

VIDEO 17 SEGMENT Crowdsourcing

Concluding remarks Developing a better, multifaceted picture of context (Bazzanella, 2002: 239) is an ongoing challenge. This is crucial to the development of better descriptions of language-in-use and to the development of applications based on those descriptions. The ability to generate more contextually sensitive descriptions of language in use will shed new light on the relationship between form and function.

Concluding remarks Access to heterogeneous corpora inevitably requires us to rethink the notion of the unit of analysis in corpus linguistics research. As we develop a better understanding of the nature of the co-dependencies between language and context, the focus of the unit of analysis may shift from the word or sequence of words, to a contextually defined episode of interaction which may include multiple modes of discourse and which is dynamic in nature.

Concluding remarks Ongoing developments in this research space would represent a departure from traditional corpus linguistic approaches but it should strengthen the explanatory power of any results that emerge from the study of large principled collections of text in context.

Acknowledgements Research team The Digital Records for e-social Science Project is funded by the ESRC.