From USCOAST

Main: VisitsAndInternships

We quantified the effect of delay on user behaviour in real-time collaborative editing, necessary for demonstrating the value-added of SCORE collaborative editing algorithms designed to reduce delay. The specific questions were: does delay reduce group performance? are user conflicts more frequent in the presence of delay? do users adapt to the delay? is group performance depending on the task? To answer these questions, we designed and ran three different experimental tasks for twenty groups of four users each (proofreading, sorting and note taking) each with a different time-constant, and examined alternative methods for measuring group performance. SCORE specified the initial tasks and the critical experimental manipulation, designed the experimental software and ensured the collection of performance measures. Our partner, Prof. Valerie SHALIN provided complementary expertise in experimental design such as the assignment of experimental delay conditions to participants, the collection of co-variates necessary for valid statistical analysis and adherence to policies for the ethical treatment of participants.

We focused on the effect of delay for the sorting task in collaborative editing. In this task groups of users had to locate the release dates of an alphabetized list of movies, and sort them accordingly. We recovered quantitative performance measures from the sequence of behaviors within a group using several methods including time-series analyses, rank correlation and insertion sort. We quantified qualitative phenomena, such as the presence of user conflicts by reviewing the twenty videos registered during the experiments. The SCORE team provided the software for computing the quantitative measures and together with the internship student analysed the videos. Professor Shalin supervised statistical analysis conducted by the internship student.

The goal of this visit was to present in the Computer Science Department at Wright State University the current work of SCORE team on massive collaborative editing with a focus on consistency maintenance for strings "Supporting adaptable granularity of changes for massive scale collaborative editing". Additionally, the aim was to exploit possible applications of this work for clouds and mobile phones and possible collaborations with the projects of KNOESIS http://www.knoesis.org/projects.

Prof. Valerie SHALIN began a 9 month sabbatical in collaboration with the SCORE team. Our goal was to develop an experimental design for testing SCORE's trust-based collaboration model for a large community of users. To ground our findings in existing social science theory, we examined the game theory literature that spans cognitive science, psychology and economics. Some of the questions we worked on were: is there a game theory model that could reflect document sharing in collaborative editing? is there a game theory model that deals with user reputation? what task scenario can be proposed for experimental studies? Our paradigm builds on game theory methods in three ways. First, we adapted a well-established trust game that best suits to a trust-based collaboration. Second, we accommodated the need for a large community of users by involving simulated users as well as human participants in the experiment. Third, we added user attributes for reputation, as required in the SCORE model, in order to determine their effect on the decision to collaborate.

During this part of the sabbatical, Professor Shalin worked with the SCORE team on new analyses on the sorting task, on the design of quantitative and qualitative measures for the note-taking task and on preliminary analyses for the note-taking task. She also participated in the supervision of a master thesis on the trust-based collaboration.

The goal of this internship was statistical analyses on the sorting and note-taking tasks. The student also helped with extraction of needed measures from video analysis. Prof. Valerie Shalin supervised the statistical analysis conducted by the intern student.

The goal of this visit was to finalize the analyses of the note-taking task and draft a paper on the results. Design of the tasks of a user study for trust-based collaboration were discussed.

The goal of this visit was to settle up some collaboration in the domain of crisis management.

During this visit, Professor Shalin worked with the Coast team on analysing data from the experiments with users on the trust game.

The goal of this visit was finalisation of analysis of data from the experiments on trust game and the writing of a paper including all these results that was submitted at CHI 2017. Claudia gave in this period two talks on "Large scale trust based collaboration", one in the Department of Psychology and the other in the Department of Computer Science & Knoesis (talk available at https://www.youtube.com/watch?v=HlrREBd6vZo). She attended the Collaborative Institutional Training Initiative (CITI Program), the Human Research module on Social/Behavioral research.

Gérald gave in this period a talk on "Distributed Real-time Collaborative Editing Systems" in the Department of Computer Science & Knoesis (talk available at https://www.youtube.com/watch?v=VT8MYJq_cck). He attended the Collaborative Institutional Training Initiative (CITI Program), the Human Research module on Social/Behavioral research.

During this visit, Professor Shalin worked with the Coast team on analysis of data collected during the experiments on the trust game.

The aim of the visit of Be ́atrice Linot at Wright State was the definition of the trust in the communication of information.

The purpose of this visit was to establish the requirements for a crisis response situation management application, concerning trust, relevance and data provenance. A secondary purpose was to refine Béatrice Linot’s dissertation proposal.

The purpose of this visit is data analysis of interview data pertaining to a crisis management scenario, and preparation of a journal submission that addresses design requirements for a crisis response situation management application.

Retrieved from http://uscoast.loria.fr/uscoast-wiki/index.php/Main/VisitsAndInternships
Page last modified on October 05, 2018, at 05:25 PM