A half-day workshop will be held in conjunction with the LREC Conference in  Athens on May 29, 2000.  The theme of the workshop is Machine Translation  Evaluation. Machine Translation is taken in the broad sense here, referring to all types of  tools used to aid in the translation process  (e.g.machine  translation,  translation memory systems, terminology  management systems,  etc.).

 This Workshop will be the first in a series of workshops on the topic,  that have as goals:

• to discuss the establishment of a theory of the methodology of evaluation  of MT;
• to develop a general framework in which existing evaluation measures for any particular application of MT can be used in a systematic and  organized way;
• to illustrate the theory and methodology, and to take further the previous work of EAGLES, by creating a specific framework for evaluating several machine translation systems and other tools for translation. This  work involves not only taxonomizing pertinent aspects of the nature and use of MT, but also gathering and classifying individual evaluation measures in the most suitable groupings, and creating criteria for the application of  each measure.

 The results of this workshop will be a first step toward outlining a general framework to guide MT evaluators, which ill ultimately include a taxonomy of the most important aspects pertinent to MT evaluation, evaluation measures ssociated with each aspect, and a set of example studies.  The work begun in this workshop will be augmented and further elaborated in future workshops.

 In addition, this workshop will be linked to the international MT System Certification initiative, currently being developed by the International Association for Machine Translation (IAMT).

 We are inviting contributions to the discussion of the themes above.
 

 Submission of papers

 Submissions should consist of an abstract of about one page, plus a title page providing the following information: official title of the paper; names and affiliations of the authors; full address of the first author including phone, fax, mail, URL; presentation facilities required.  Only electronic submissions in ASCII, RTF or Word format will be accepted.  The submissions should be sent to: cst @ cst.dk

Reception of the submission will be acknowledged within 3 days.  If you do not get an acknowledgement, please check the email address of your submission.

 Proceedings

 The workshop organizers will produce proceedings.  Therefore, print-ready  versions of the papers have to be submitted according to LREC Guidelines for Authors which can be found at  www.elda.fr/lrec2000.html  They should not exceed 5 pages.  These final versions should be submitted electronically to the same email address: cst @ cst.dk.

 Important Dates
 

 Deadline for submissions of papers:              March 17
 Notification of acceptance:                            April 3
 Final versions of papers for proceedings:      May 12
 Workshop                                                        May 29

 Further information

 Information about the workshop such as call, schedule, and program can be found on the LREC web-page: http://www.elda.fr/lrec2000.html  where you will also find information about the LREC conference itself.

 Registration

 The registration fee for the workshop is:
         - 60 EURO for those not attending LREC
         - 40 EURO for those attending LREC

Registration and payment is explained on the LREC web-page.

 Included in the registration fee are the proceedings and coffee at the breaks.

 Questions

 For all questions with respect to the workshop focus, please contact the workshop organisers, emails below.  For all questions with respect to  organisational issues, accommodation, etc., please contact the LREC  secretariat: LREC2000@ilsp.gr.

 Organising Committee

  Bente Maegaard, Center for Sprogteknologi, Copenhagen, email: bente @ cst.dk
  Maghi King, TIM/ISSCO, ETI, Geneva, email: Margaret.King@issco.unige.ch
  Eduard Hovy, USC/ISI, Los Angeles, email: hovy@isi.edu
 
 
 
 

Back to EAGLES-II Home Page