Evaluating a legal argument program: The BankXX experiments [Book Review]

Artificial Intelligence and Law 5 (1-2):1-74 (1997)
  Copy   BIBTEX


In this article we evaluate the BankXX program from several perspectives. BankXX is a case-based legal argument program that retrieves cases and other legal knowledge pertinent to a legal argument through a combination of heuristic search and knowledge-based indexing. The program is described in detail in a companion article in Artificial Intelligence and Law 4: 1--71, 1996. Three perspectives are used to evaluate BankXX:(1) classical information retrieval measures of precision and recall applied against a hand-coded baseline; (2) knowledge-representation and case-based reasoning, where the baseline is provided by the functionality of a well-known case-based argument program, HYPO (Ashley, 1990); and (3) search, in which the performance of BankXX run with various parameter settings, for instance, resource limits, is compared. In this article we report on an extensive series of experiments performed to evaluate the program. We also describe two additional experiments concerning(1) the program's search behavior; and (2) the use of a modified form of precision and recall based on case similarity. Finally we offer some general conclusions that might be drawn from these particular experiments.



    Upload a copy of this work     Papers currently archived: 92,347

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library


Added to PP

89 (#192,717)

6 months
14 (#185,919)

Historical graph of downloads
How can I increase my downloads?

References found in this work

The New Rhetoric: A Treatise on Argumentation.Chaïm Perelman & Lucie Olbrechts-Tyteca - 1969 - Notre Dame, IN, USA: Notre Dame University Press. Edited by Lucie Olbrechts-Tyteca.
The Uses of Argument.Stephen E. Toulmin - 1958 - Philosophy 34 (130):244-245.
Lattice Theory.Garrett Birkhoff - 1940 - Journal of Symbolic Logic 5 (4):155-157.

View all 9 references / Add more references