ABC2024の看護行動ビデオからの行動認識チャレンジですが、参加申し込み締め切りが3/6です。

十分申し込みは集まっておりますが、今一度アナウンスさせていただきます。

*** Call For Challenge Participants ***

Dear Researchers/Authors,

You are invited to participate in the 6th ABC Challenge (https://abc-research.github.io/challenge2024), in conjunction with the 6th International Conference on Activity and Behavior Computing at Nakatsu and Kitakyushu, Japan (Hybrid), on May 28 - 31, 2024. 　


The 6th ABC Challenge is the Activity Recognition of Nurse Training Activity Using Skelton and Video Dataset with Generative AI. Activity types are each action of Endotracheal suctioning.

https://abc-research.github.io/challenge2024/


The dataset will provide the skeleton data for training/testing and the video data only during the training.
The skeleton data include many data which recognized only partial parts of the body due to camera location limitations.
Participants are required to use a Generative AI or LLMs (hereafter, Generative AI) in a creative way.

Participants are required to recognize activities based on skeletal data. Since the data collection was a practical experiment, camera locations were limited by not showing the face, the size of the room, etc. Therefore, it is not possible to recognize all of the body parts, and many skeleton data had missing body parts. Additionally, Generative AI has been a hot topic in recent years and its momentum will continue to increase. In order to explore the potential for use in the field of activity recognition, participants are required to utilize Generative AIs in a creative way.

Endotracheal suctioning (ES) is a necessary practice carried out in such as intensive care units or even in a home by the family of patients. It involves the removal of pulmonary secretions from a patient with an artificial airway in place. The procedure is associated with complications and risks including bleeding, and infection.  Therefore, there is a need to develop an activity recognition system that can ensure the safety of patients as well as reflect to improve their skills while they conduct this complicated procedure. Activity recognition can be used to aid nurses in better managing and increasing the quality of their work, as well as evaluate their performance when they conduct ES. The activity recognition is the initial stage to determine the order of actions and assess the nurse’s skills.
CHALLENGE GOAL & TASK
The goal of this challenge is to recognize 9 activities in Endotracheal suctioning (ES) by using skeleton data for training/testing and video only for training. In this challenge, participants are required to use a Generative AI in a creative way. For evaluation, we will consider the F1 score and the paper contents. We will consider the average F1 score for all the subjects.

The data we provide is a part of the dataset used in our previous work, entitled “Toward Recognizing Nursing Activity in Endotracheal Suctioning Using Video-based Pose Estimation” [1]. The authors of this work proposed an algorithm to define and track the main subject. Also, missing keypoints problems due to the performance of the pose estimation algorithm are improved by smoothing keypoints.

[1] Hoang Anh Vy Ngo, Quynh N Phuong Vu, Noriyo Colley, Shinji Ninomiya, Satoshi Kanai, Shunsuke Komizunai, Atsushi Konno, Misuzu Nakamura, Sozo Inoue: “Toward Recognizing Nursing Activity in Endotracheal Suctioning Using Video-based Pose Estimation”, The 5th International Conference on Activity and Behavior Computing, 2023, (Germany).
DATASET OVERVIEW

There are two types of data in this dataset:
Video: recorded from the front side of the nurse beyond the patient mannequin. This video will be published only during training.
Pose Skeleton (keypoints): extracted from videos by using YOLOv7. This data will be published for training and testing.

There are a total of 9 activities in the ES procedure. All the activities are listed in the below table.

9 Activity types in endotracheal suctioning and their id are below,
{ 0: “Catheter preparation”, 1: “Temporal removement of an artificial airway”, 2: “Suctioning phlegm”, 3: “Refitting the artificial airway”, 4: “Catheter disinfection”, 5: “Discarding gloves”, 6: “Positioning”, 7: “Auscultation”, 8: “Others” }

IMPORTANT DATES

Registration closes: Mar 6, 2024
Submission of results: Mar 20, 2024
Submission of paper: Mar 27, 2024
Review sent to participants: Apr 10, 2024
Camera-ready papers: Apr 17, 2024
Conference: May 29 - 31, 2024

PRIZES
The winning team will be awarded 100,000 JPY.
The registration fee for the 1st and 2nd runner-up teams will be waived.
Each of the participating teams will be awarded with a participation certificate.


ORGANIZERS
Haru Kaneko, Kyushu Institute of Technology
Anh Vy Ngô, Kyushu Institute of Technology
Ryuya Munemoto, Kyushu Institute of Technology
Iqbal Hassan, Kyushu Institute of Technology
Tahera Hossain, Aoyama Gakuin University
Sozo Inoue, Kyushu Institute of Technology

FAQ
Submit your questions to abc2024@sozolab.jp with the subject *Challenge title*