DBJAPANの皆様 ABC2024の看護行動ビデオからの行動認識チャレンジですが、参加申し込み締め切りが3/6です。 十分申し込みは集まっておりますが、今一度アナウンスさせていただきます。 *** Call For Challenge Participants *** Dear Researchers/Authors, You are invited to participate in the 6th ABC Challenge ( https://abc-research.github.io/challenge2024), in conjunction with the 6th International Conference on Activity and Behavior Computing at Nakatsu and Kitakyushu, Japan (Hybrid), on May 28 - 31, 2024. The 6th ABC Challenge is the Activity Recognition of Nurse Training Activity Using Skelton and Video Dataset with Generative AI. Activity types are each action of Endotracheal suctioning. https://abc-research.github.io/challenge2024/ The dataset will provide the skeleton data for training/testing and the video data only during the training. The skeleton data include many data which recognized only partial parts of the body due to camera location limitations. Participants are required to use a Generative AI or LLMs (hereafter, Generative AI) in a creative way. Participants are required to recognize activities based on skeletal data. Since the data collection was a practical experiment, camera locations were limited by not showing the face, the size of the room, etc. Therefore, it is not possible to recognize all of the body parts, and many skeleton data had missing body parts. Additionally, Generative AI has been a hot topic in recent years and its momentum will continue to increase. In order to explore the potential for use in the field of activity recognition, participants are required to utilize Generative AIs in a creative way. Endotracheal suctioning (ES) is a necessary practice carried out in such as intensive care units or even in a home by the family of patients. It involves the removal of pulmonary secretions from a patient with an artificial airway in place. The procedure is associated with complications and risks including bleeding, and infection. Therefore, there is a need to develop an activity recognition system that can ensure the safety of patients as well as reflect to improve their skills while they conduct this complicated procedure. Activity recognition can be used to aid nurses in better managing and increasing the quality of their work, as well as evaluate their performance when they conduct ES. The activity recognition is the initial stage to determine the order of actions and assess the nurse’s skills. CHALLENGE GOAL & TASK The goal of this challenge is to recognize 9 activities in Endotracheal suctioning (ES) by using skeleton data for training/testing and video only for training. In this challenge, participants are required to use a Generative AI in a creative way. For evaluation, we will consider the F1 score and the paper contents. We will consider the average F1 score for all the subjects. The data we provide is a part of the dataset used in our previous work, entitled “Toward Recognizing Nursing Activity in Endotracheal Suctioning Using Video-based Pose Estimation” [1]. The authors of this work proposed an algorithm to define and track the main subject. Also, missing keypoints problems due to the performance of the pose estimation algorithm are improved by smoothing keypoints. [1] Hoang Anh Vy Ngo, Quynh N Phuong Vu, Noriyo Colley, Shinji Ninomiya, Satoshi Kanai, Shunsuke Komizunai, Atsushi Konno, Misuzu Nakamura, Sozo Inoue: “Toward Recognizing Nursing Activity in Endotracheal Suctioning Using Video-based Pose Estimation”, The 5th International Conference on Activity and Behavior Computing, 2023, (Germany). DATASET OVERVIEW There are two types of data in this dataset: Video: recorded from the front side of the nurse beyond the patient mannequin. This video will be published only during training. Pose Skeleton (keypoints): extracted from videos by using YOLOv7. This data will be published for training and testing. There are a total of 9 activities in the ES procedure. All the activities are listed in the below table. 9 Activity types in endotracheal suctioning and their id are below, { 0: “Catheter preparation”, 1: “Temporal removement of an artificial airway”, 2: “Suctioning phlegm”, 3: “Refitting the artificial airway”, 4: “Catheter disinfection”, 5: “Discarding gloves”, 6: “Positioning”, 7: “Auscultation”, 8: “Others” } IMPORTANT DATES Registration closes: Mar 6, 2024 Submission of results: Mar 20, 2024 Submission of paper: Mar 27, 2024 Review sent to participants: Apr 10, 2024 Camera-ready papers: Apr 17, 2024 Conference: May 29 - 31, 2024 PRIZES The winning team will be awarded 100,000 JPY. The registration fee for the 1st and 2nd runner-up teams will be waived. Each of the participating teams will be awarded with a participation certificate. ORGANIZERS Haru Kaneko, Kyushu Institute of Technology Anh Vy Ngô, Kyushu Institute of Technology Ryuya Munemoto, Kyushu Institute of Technology Iqbal Hassan, Kyushu Institute of Technology Tahera Hossain, Aoyama Gakuin University Sozo Inoue, Kyushu Institute of Technology FAQ Submit your questions to abc2024@sozolab.jp with the subject *Challenge title*