Helena M. Mentis

The introduction of Augmented Reality (AR) Head Mounted Displays (HMDs) in collaboration between remote and local workers, introduces new challenges given that camera views are now mobile. We introduce HoloMentor, an AR HMD-based collaborative system designed for remote instruction over live mobile views during physical tasks. Through Actionport, we provide a world-stabilized area where remote helpers can dynamically place a pointer and annotations on the physical environment. Through Actionpad, we provide an indirect input mechanism with an absolute position to the Actionport. We show how these innovations worked for participants engaged in a remote instructional task and how they supported effective and efficient communication. Finally, we provide the next steps for addressing AR on mobile views for remote instruction.

Rehabilitation is vital for individuals to build compensatory strategies for, and recover from, physical and cognitive impairments. Unfortunately, the COVID-19 pandemic disrupted patients from receiving traditional co-located rehabilitation. Thus, a monumental transition occurred requiring Physical Medicine & Rehabilitation (PM&R) clinicians and patients to transition to telerehabilitation. Our interdisciplinary research team of technologists and clinicians performed a case study of PM&R clinicians (physicians, therapists, and psychologists) deploying and transitioning their workflows to telerehabilitation. We found that after clinicians’ constant reflection and workflow changes, they successfully adapted most co-located rehabilitation practices to telerehabilitation. Furthermore, because of their adaptation experience, they all alluded that the future workflows of PM&R care involves continuing to leverage telerehabilitation …

This workshop focuses on remote care and wellbeing as we transition into a world increasingly adopting hybrid lifestyles and modes of operation. Care and care work have predominantly been researched in traditionally in-person interpersonal contexts. The burgeoning uptake and incorporation of information and communication technologies towards remote care have created new workflows and resulted in emerging questions around the definitions and scope of care practice in response. The confluence of technological, sociocultural, geopolitical, and climatic realities of the current day brings into focus the need to unpack the idea of “care,” and the role that HCI researchers could play in creating equitable futures of remote and hybrid care. This workshop will focus on questions such as “What does holistic wellbeing look like in the era of hybrid caregiving?” and “How does environmental care factor into our …

Although Augmented Reality (AR) has been touted as the future of surgery, its contribution to distributed collaboration such as in surgical teleconsulting has not been articulated. We propose AR-Head Mounted Displays (AR-HMD) to tackle two previously-identified challenges: operating surgeons needing to view and interact with imaging systems that reside away from the operative field, and, their lack of gesturing tools to point and annotate on the shared images and physical environment. We report on a controlled lab experiment where 12 expert gynecology surgeons perform a tumor localisation task guided by a remote radiologist (confederate) via an AR-HMD. We find that bringing the shared images to the place of work reduces the need for clarifications and provides opportunistic access to information when required, and, that pointing and annotating provides opportunities to further support verbal instruction in …

Digital technological advancements have been a driving force in the continued evolution of the modern workplace. One notable change is an increased reliance on informal chatting tools in support of both distributed and co-located work. However, while researchers have recognized the growing prominence of these tools in work, little is known about how to best support youth who have grown up with access to interconnected technologies in acquiring and practicing the relevant skills needed to effectively communicate using these tools. In this study, we studied youth's utilization of Slack, a popular workplace chatting tool, in an after-school 3D print shop. Using in-depth semi-structured interviews, we uncovered the factors that supported or hindered youth employees' Slack use in a technical work context. This work offers implications for how to design youth workplace communication and coordination protocols that …

MARCH 2023| VOL. 66| NO. 3| COMMUNICATIONS OF THE ACM 7 there are three main reasons why information might be disclosed. The first is a matter of procedural equity. Disclosures to respondents, claimants, witnesses, and victims are important to allow individuals to decide how to best navigate our processes given their individual circumstances. The second is a matter of harm prevention. Certainly, limited disclosure of information is necessary to implement sanctions. For example, an editor must learn whether an individual has been barred from publishing in ACM journals. More extensive disclosure of information allows individuals and communities to take steps to reduce the chances of some forms of harm. Additional disclosure might include disclosure of information to other professional societies or even public disclosure by ACM. The third type of disclosure is as part of a sanction. For example, the papers …

Older adults face unique risks in trying to secure their online activities. They are not only the frequent targets of scams and fraud; they are the targets of a barrage of cybersafety communiqués whose impact is unclear. AARP, the United States advocacy group focusing on issues facing older adults over the age of 50, is among those educators whose strategies remain underexplored, yet their reach makes it imperative that we understand what they are saying, to whom, and to what effect. Drawing on an analysis of AARP publications about cybersafety and privacy, we sought to better understand their discourse on the topic. We report on findings that AARP's language may have the effect of portraying bad actors ("fraudsters") as individuals, rather than enterprises, which at the target end, personalizes interactions, placing too much onus on individual users to assess and deflect threats. AARP's positioning of, and …

This Special Interest Group (SIG) will collaboratively explore potential futures of the ACM Special Interest Group on Computer-Human Interaction (SIGCHI) on the organization’s 40th anniversary. Taking stock of where we are now, forty years after inception, our goal will be to engage members of the SIGCHI community in a participatory approach towards imagining how SIGCHI might evolve, and how it can ensure that the elements it values most, such as connection, inclusion, and equity, among others, can be nurtured as the field evolves, and technologies come and go.

In the following position paper we introduce the use of AR HMD for remote instruction in healthcare and present the challenges our team has faced in achieving this application in two contexts: surgical telementoring and paramedic teleconsulting. After the presentation of how these challenges come to be and indications on how to address them, we argue that those who wish to pursue this area of research must be grounded in best practices from the field of CSCW integrated with technical innovations in AR interaction development. This is a truly interdisciplinary research and development area that has many challenging topics to tackle through collaborative efforts.

We studied the impact of introducing first-year computer science (CS) students to ethical thinking about the social justice impacts of data collection, tracking, bias, internet privacy, and competitive “real world” system design and critique activities. While basic content was consistent for all, one group was involved throughout the course in peer discussions designed to foster greater engagement, with the anticipation that this would enable students to reach new levels of sensitivity through peer-to-peer interaction. This article reports on our observation of this design, interview, and project data collected throughout the course as well interviews conducted eight months later to learn about how students were retaining and applying what they learned. We found that students are sensitive to the technology-related risks and vulnerabilities encountered by individuals based on race, gender, and, to some extent, age, but they …

The Executive Committee (EC) of ACM Special Interest Group on Computer-Human Interaction (SIGCHI) organized a series of ten equity talks from March 2021 to August 2021. These were hour-long recorded virtual roundtable sessions, for which we solicited participation from the SIGCHI community on concerns and questions relating to equity, in a number of areas relevant to SIGCHI. Many concerns were listed, some were repeated across topics, and the EC followed due diligence when it came to presenting this information to the community. What comes next?

Advances in computing technology, changing policies, and slow crises are rapidly changing the way we work. Human-computer interaction (HCI) is a critical aspect of these trends, to understand how workers contend with emerging technologies and how design might support workers and their values and aspirations amidst technological change. This SIG invites HCI researchers across diverse domains to reflect on the range of approaches to future of work research, recognize connections and gaps, and consider how HCI can support workers and their wellbeing in the future.

In this special interest group (SIG), we follow up on previous conversations around hybrid models for conferences, conducted in open sessions by the ACM Special Interest Group on Computer-Human Interaction (SIGCHI) Executive Committee (EC). The COVID-19 pandemic led to a sudden shift to virtual conferences; as we start to go back to in-person events, it is important to reflect on the types of events we desire, and design these accordingly. With this SIG, we hope to share experiences from previous conferences (successful or not) and discuss potential solutions to pending issues. This SIG will be led by VP at Large Adriana S. Vivacqua, with the participation of other EC members.

Telerehabilitation systems for stroke survivors have been predominantly designed to measure and quantify movement in order to guide and encourage rehabilitation regular exercises at home. We set out to study what aspect of the movement data was essential, to better inform sensor design. We investigated face-to-face stroke rehabilitation sessions through a series of interviews and observations involving 16 stroke rehabilitation specialists including physiatrists, physical therapists, and occupational therapists. We found that specialists are not solely interested in movement data, and that experiential information about stroke survivors’ lived experience plays an essential role in specialists interpreting movement data and creating a rehabilitation plan. We argue for a reconceptualization in stroke telerehabilitation that is more inclusive of non-movement data, and present design implications to better account for …

Designing technologies that support the mutual cybersecurity and autonomy of older adults facing cognitive challenges requires close collaboration of partners. As part of research to design a Safety Setting application for older adults with memory loss or mild cognitive impairment (MCI), we use a scenario-based participatory design. Our study builds on previous findings that couples’ approach to memory loss was characterized by a desire for flexibility and choice, and an embrace of role uncertainty. We find that couples don't want a system that fundamentally alters their relationship and are looking to maximize self-surveillance competence and minimize loss of autonomy for their partners. All desire Safety Settings to maintain their mutual safety rather than designating one partner as the target of oversight. Couples are open to more rigorous surveillance if they have control over what types of activities trigger various …

Background Touchless interaction devices have increasingly garnered attention for intraoperative imaging interaction, but there are limited recommendations on which touchless interaction mechanisms should be implemented in the operating room. The objective of this study was to evaluate the efficiency, accuracy, and satisfaction of 2 current touchless interaction mechanisms—hand motion and body motion for intraoperative image interaction. Methods We used the TedCas plugin for ClearCanvas DICOM viewer to display and manipulate CT images. Ten surgeons performed 5 image interaction tasks—step-through, pan, zoom, circle measure, and line measure—on the 3 input interaction devices—the Microsoft Kinect, the Leap Motion, and a mouse. Results The Kinect shared similar accuracy with the Leap Motion for most of the tasks. But it had an increased error rate in the step-through task. The Leap Motion led …

Study ObjectiveOur study explores whether providing surgeon mentors with formal training on a novel telementoring software improves the experience of teaching laparoscopic oophorectomy remotely.DesignMentor, in a separate room, used the telementoring technology - a shared screen for annotations and a microphone to enable verbal instruction - to remotely coach the trainee through a simulated laparoscopic oophorectomy. A between-subject study was conducted. Mentors assessed their Cognitive Load using Paas 9-point likert scale, and trainees’ performance using Global Rating scale (GRS). Trainees evaluated Quality of Instruction (QoI). GRS and QoI are validated 5-point Likert scales. Linear mixed model analysis was conducted to compare the two conditions.SettingA lab-developed telementoring technology was utilized. Stryker laparoscopic boxes were used for oophorectomy simulations on plastic …

The rapid evolution of technology has enabled us to perform complex, interdependent, and geographically distributed work. As a result, the effective use of communication and coordination technologies is increasingly crucial to success in the workplace, raising at the same time concerns about workplace privacy. In this paper, we present a case study showing how we adapted and used a participatory toolkit to elicit the privacy perspectives of a 3D print shop’s youth employees. Participants expected their managers and co-workers, rather than other third-parties, to see their data, and yet prioritized keeping their co-workers informed rather than being overly concerned about third-parties accessing their data. We found this approach effective at creating an expressive space for the youth to reflect on and share their expectations and preferences on workplace data privacy, a practice that can enhance both their …

Designing technologies that support the cybersecurity of older adults with memory concerns involves wrestling with an uncomfortable paradox between surveillance and independence and the close collaboration of couples. This research captures the interactions between older adult couples where one or both have memory concerns—a primary feature of cognitive decline—as they make decisions on how to safeguard their online activities using a Safety Setting probe we designed, and over the course of several informal interviews and a diary study. Throughout, couples demonstrated a collaborative mentality to which we apply a frame of citizenship in opensource collaboration, specifically (a) histories of participation, (b) lower barriers to participation, and (c) maintaining ongoing contribution. In this metaphor of collaborative enterprise, one partner (or member of the couple) may be the service provider and the …

In this paper, we show how surgeons can interact with medical images using finger and hand gestures in two situations: one hand-free and no hands-free interaction. We explain how interaction with only one hand or a couple of fingers is beneficial and can help surgeons have continuous interaction, without the need to release their tools and leave the operating table, saving valuable patient time. To this end, we present RadSense, an end-to-end and unobtrusive system that uses Doppler radar-sensing to recognize hand and finger gestures when either one or both hands are busy. Our system permits the following important capabilities: (1) touch-less input for sterile interaction with connected health applications, (2) hand and finger gesture recognition when either one or both hands are busy holding tools, extending multitasking capabilities for health professionals, and (3) mobile and networked, allowing for custom …