日本データベース学会の皆様
(重複して受け取られた場合にはご容赦ください)
兵庫県立大学の山本岳洋です.
12月に開催されるNTCIR-17カンファレンスおよびEVIA 2023のご案内です.
情報アクセス技術(情報検索,データベース,自然言語処理等)に
関わるさまざまな共有タスクへの取り組み・評価技術が
紹介・議論される場となっております.
会議ではNTCIR-17で選定された9のタスクについて,
タスクの概要,参加者の発表,議論などがなされます.
また,LLM時代の情報アクセス技術に関する
キーノートやパネルが複数予定されております.
キーノートではMicrosoftのPaul Thomas博士より,
BingにおけるGPT-4を用いた文書の適合性自動評価
についてお話いただきます.
パネルではLLMベースの情報アクセス技術の
公平性やサステナビリティなどに関する議論が行われます.
併設のEVIA 2023でも,LLMの評価に関するパネルが予定されています.
チュートリアルでは情報アクセスシステム
の評価方法について酒井哲也先生にお話いただきます.
早期登録が「11月13日(月)」までとなっております.
この機会にぜひ参加をご検討いただければ幸いです.
=========================================================
Call for Participation: NTCIR-17 Conference
and
The 10th International Workshop on Evaluating Information
Access (EVIA 2023)
December 12 (Tue) - 15 (Fri), 2024, Tokyo & Online
https://research.nii.ac.jp/ntcir/ntcir-17/conference.html
=========================================================
The Seventeenth NTCIR conference (NTCIR-17) and the Tenth
International Workshop on Evaluating Information Access
(EVIA 2023) would like to welcome all of you who are
working on or interested in information access research.
The conference finally returns to an in-person meeting after
three years!! Participants are encouraged to discuss diverse
information access in person in Tokyo.
The conference also provides an online participation option.
There will be introductions and discussions on various kinds
of shared tasks in the field of information access at the
conference.
* Program at a glance
https://research.nii.ac.jp/ntcir/ntcir-17/prog-at-glance.html
* Keynote 1
Title: Using Language Models for Relevance Labelling
Speaker: Paul Thomas (Microsoft)
https://research.nii.ac.jp/ntcir/ntcir-17/keynote.html#keynote1
* Panel
Theme: Responsible Information Access: Fairness, Harmlessness,
Sustainability, and More
Panelists: Haruka Maeda (Kyoto University), Paul Thomas (Microsoft), and
Mark Sanderson (RMIT University)
Moderator: Tetsuya Sakai (Waseda University)
https://research.nii.ac.jp/ntcir/ntcir-17/keynote.html#panel
* Tutorial
Title: A Practical Guide to Computing Evaluation Measures and
Comparing Systems: Twelve Small Tips
Speaker: Tetsuya Sakai (Waseda University)
https://research.nii.ac.jp/ntcir/ntcir-17/keynote.html#tutorial
* Pre-NTCIR Seminar (on December 11th)
Title: Three decades of web search, how goes the retrieval revolution?
Speaker: Mark Sanderson (RMIT University)
https://research.nii.ac.jp/ntcir/ntcir-17/keynote.html#seminar
* Reports from nine shared tasks
NTCIR-17 welcomes all of you who are interested in and/or
working on information access research. This sesquiannual
event was first held in 1999, and has grown steadily ever since.
More than 300 people from 35 countries attended NTCIR-16 and
we are hoping that the event will be even more successful
this time. NTCIR covers diverse information access tasks
including, but not limited to, information retrieval,
question answering, text summarization, and text mining,
with an emphasis on East Asian languages and English.
At the NTCIR-17 conference, we will hear reports from
the following nine shared tasks:
- FairWeb-1 ("FairWeb-1")
- Fine-grained Argument Understanding in Financial Analysis ("FinArg-1")
- Medial Natural Language Processing for Social media and Clinical
texts ("MedNLP-SC")
- Personal Lifelog Organisation & Retrieval ("Lifelog-5")
- QA Lab for Political Information-4 ("QA Lab-PoliInfo-4")
- Resource Transfer Based Dense Retrieval ("Transfer")
- Session Search ("SS-2")
- Unbiased Learning to Rank Evaluation Task 2 ("ULTRE-2")
- Understanding of non-Financial Objects in Financial Reports ("UFO")
* EVIA 2023: The Tenth International Workshop on Evaluating Information
Access,
a Satellite Workshop of the NTCIR-17 Conference
- Keynote Speaker: Ian Soboroff (NIST, USA)
- Panel on Evaluation of Large Language Models
- Four accepted papers with intensive discussion for each talk.
https://research.nii.ac.jp/ntcir/evia2023/index.html
* Registration & Fee
https://research.nii.ac.jp/ntcir/ntcir-17/participation.html
* Venue & Travel
https://research.nii.ac.jp/ntcir/ntcir-17/travel.html
* Accommodation
https://research.nii.ac.jp/ntcir/ntcir-17/hotel-accommodation.html
* VISA application support document & Invitation letters
https://research.nii.ac.jp/ntcir/ntcir-17/VISA.html
We are searching the sponsors to support the student travel to NTCIR.
If you are interested in, please email ntc17-sponsor(a)nii.ac.jp
We are looking forward to seeing you very soon in Tokyo!
------
NTCIR-17 General Co-Chairs:
Charles Clarke (University of Waterloo, Canada)
Noriko Kando (National Institute of Informatics, Japan)
Makoto P. Kato (University of Tsukuba, Japan)
Yiqun Liu (Tsinghua University, China)
NTCIR-17 Program Co-Chairs:
Takehiro Yamamoto (University of Hyogo, Japan)
Zhicheng Dou (Renmin University of China, China)
EVIA 2023 Co-chairs:
Qingyao Ai (Tsinghua University, China)
Douglas W. Oard (University of Maryland, USA)
NTCIR-17 Conference Organizing Committee Co-Chairs:
Noriko Kando (National Institute of Informatics, Japan)
Emi Ishita (Kyushu University, Japan)
--
Takehiro Yamamoto, Associate Professor
Graduate School of Information Science, University of Hyogo
Email: t.yamamoto(a)sis.u-hyogo.ac.jp
Tel: 078-794-5212
Lab:
https://yamamotolab.net/
HP:
https://rerank-lab.org/