Important dates

  • Nov 30, 2016 — Dry run data release
  • Dec 15, 2016 — Task Registration Due
  • Feb 15, 2017 — Formal run data release
  • Feb 28, 2017 — Formal run submission due
  • Mar 15, 2017 — Paper submission due
  • Apr 15, 2017 — Notification of Acceptance
  • Apr 30, 2017 — Camera ready papers due
  • Jun 12—16, 2017 — ICAIL 2017 Conference with COLIEE-2017 and assessment returned to participants

Call for Participation: Competition on Legal Information Extraction/Entailment (COLIEE) 2017

As an associated event of ICAIL 2017, we are happy to announce the 4th Competition on Legal Information Extraction and Entailment (COLIEE-2017), derived from Japanese bar exams.

There are two tasks in the competition. One is to extract articles from Japanese civil codes which contribute to solving a bar exam yes/no question; the second task is to check entailment of a question from given civil code article(s). We also provide various NLP tools' outputs for training data to help your information retrieval and textual entailment.

Detailed description can be found in the URL below.

All the data are available both in Japanese and English (translation from Japanese bar exams and civil code). And you can choose either (or both) of them to accomplish the above tasks.

The intention is to build a community of practice regarding legal textual entailment, so that the adoption and adaptation of general methods from a variety of fields is considered, and that participants share their approaches, problems, and results.

Participants are required to submit a paper on their method and experimental results. We plan to publish a selection of the papers in a volume of the CEUR-WS proceeding series. At least one of the authors of an accepted paper has to present the paper at the special COLIEE session of ICAIL 2017. The paper(s) by the winner(s) of the competition will be included in the main ICAIL 2017 proceedings, and a cash prize will be awarded to the winner(s).

Live demonstration

In addition to the publication of winning papers, the intention is to have a live demonstration competition during the ICAIL 2017 Conference. The details of the live demonstration competition are being developed, and will be made available well in advance of the conference. Participants should declare their intention to participate and prepare their software accordingly. Another cash prize will be awarded to the top live demonstration competitor(s).

Our intention for the demonstration competition is to showcase the methods and results obtained by COLIEE participants, in order to help attract a broad community of support. We welcome suggestions for how COLIEE competitors would like to deliver their results in a live demonstration (e.g., will you have the ability to display a live running of your system on a laptop, what are your data requirements to enable real time output, etc). To exchange details on possible requirements, please contact Mi-Young Kim (miyoung2(at)

Paper format and submission

Papers should not exceed 10 pages in the approved style. Please use the paper2 style (two column style without page number) in the CEUR-WS style templates. While papers can be prepared using LaTeX, all papers should be converted to PDF prior to submission. You can submit your paper to the COLIEE 2017 EasyChair submission webpage.

Important Dates

  • Dry run data release: November 30, 2016
  • Task Registration Due: December 15, 2016
  • Formal run data release: February 15, 2017
  • Formal run submission due: February 28, 2017
  • Paper submission due: March 15, 2017
  • Notification of Acceptance: April 15, 2017
  • Camera ready papers due: April 30, 2017
  • ICAIL 2017 Conference with COLIEE-2017 and assessment returned to participants: June 12—16, 2017

Application details

Potential participants to COLIEE-2017 should respond to this call for participation by submitting an application. To apply, submit the application and memorandums of the following URL to miyoung2(at) .


Memorandum for Japanese Data

Memorandum for English Data

We will send an acknowledgement to the email address supplied in the form once we have processed the form.

Task coordinators

  • Mi-Young Kim, University of Alberta, Canada
  • Randy Goebel, University of Alberta, Canada
  • Ken Satoh, National Institute of Informatics, Japan
  • Yoshinobu Kano, Shizuoka University, Japan

Questions and further information