lrec workshop , pre-final programme pre-final programme and call for participation towards a european evaluation infrastructure for nl and speech . a workshop jointly organised by the european network of excellence in language and speech elsnet and the ec language engineering-4 project else to be held on wednesday may 27 , 9 : 00-13 : 00 at the first international conference on language resources and evaluation granada , spain right now , a generic framework for semi-automatic quantitative black-box evaluation of speech and nlp systems does not exist in europe . when confronted to a choice , developers and users prefer to ask the opinion of local experts as any other way of processing is either unrealistic or too costly . the le - 4 project else aims at providing developers with a generic strategy and definition of the primary building blocks needed to implement a semi-automatic quantitative black-box evaluation scheme . prominent speakers from field the have been invited to present papers addressing motivation , advantages , but also problems in connection with the implementation of such an evaluation scheme at an international scale . programme : 09 : 00-09 : 10 opening ( steven krauwer / joseph mariani ) 09 : 10-09 : 30 " the darpa experience " ( charles wayne ) 09 : 30-09 : 40 " ethnology and sociology of evaluation " ( lynette hirschman ) 09 : 40-09 : 50 " the aupelf experience " ( joseph mariani ) 09 : 50-10 : 00 " experience in grace tagging evaluation " ( patrick paroubek ) 10 : 00-10 : 10 " experiences in bilingual text alignment evaluation and word sense disambiguation " ( jean veronis ) 10 : 10-10 : 20 " best practice and evaluation " ( ole bernsen / laila dybkjaer ) 10 : 20-10 : 40 break 10 : 40-10 : 50 " confidence measures and evaluation " ( lin chase ) 10 : 50-11 : 00 " evaluation within eagles " ( maghi king ) 11 : 00-11 : 10 " technology vs user - evaluation " ( marc blasband ) 11 : 10-11 : 20 " evaluation for better products " ( christian dugast ) 11 : 20-11 : 30 " resources for evaluation " ( mark liberman ) 11 : 30-11 : 40 " organising parser evaluation " ( richard sutcliffe ) 11 : 40-11 : 50 " specification and infrastructure for text summarization evaluation " ( beth sundheim ) 11 : 50-12 : 00 break 12 : 00-12 : 10 " else " ( patrick paroubek ) 12 : 10-13 : 00 panel session ( chair : rob gaizauskas ) 13 : 00 closing the selected topics include the multilingual nature of evaluation , lessons from the past ( in europe and the us ) , and the need for language resources . at the workshop the first intermediate results of the else project will be presented and discussed . this call serves to invite interested parties to active participation in the workshop . during the workshop , ample opportunity will be provided for the participants to react to the presentation of the else project , and to the talks by the invited speakers . furthermore participants will be given the opportunity to give brief position statements . the workshop is very timely as it takes place when the ec 's 5th framework programme is taking shape . it is clear that the availability of a european evaluation infrastucture can be an important factor in european r&d activities , and that it can only be successful if it is organized and implemented on a european scale . programme committee the workshop is coorganized by elsnet and else . the programme committee are the participants in the else le - 4 project : niels ole bernsen jean - pierre chanod khalid choukri robert gaizauskas steven krauwer isabelle de lamberterie joseph mariani klaus netter patrick paroubek martin rajman antonio zampolli contact steven krauwer trans 10 , 3512 jk utrecht , the netherlands phone : + 31 30 253 6050 fax : + 31 30 253 6000 email : steven . krauwer @ let . ruu . nl registration information for lrec and pre and post conference workshops conference the registration fees will be 25 . 000 pesetas ( about 150 ecu ) per participant , with reduced fees of 20 . 000 pesetas ( about 120 ecu ) for early registration by march 9 , 1998 , and 12 . 000 pesetas ( about 70 ecu ) for students . the fees cover the following services : a copy of the proceedings , a social dinner , coffee breaks and refreshments . for accompanying persons , the social dinner will be 6 . 000 pesetas ( about 35 ecu ) . pre conference workshops pre conference workshops are 5 , 000 pesetas each for those attending lrec and 10 , 000 pesetas each for those not attending lrec , and include a copy of the proceedings of the workshop and a coffee break . post conference workshop the 2 - day post conference workshop is 10 , 000 pesetas for those attending lrec and 20 , 000 pesetas for those not attending lrec , and includes a copy of the proceedings of the workshop and coffee breaks . registration willbe made only for those persons who have been invited to participate by the organizers . advance registration payment can be made using the registration forms below . registration can be made on-site and must be paid in cash , using pesetas . registration forms first international conference on language resources and evaluation granada , spain , 28-30 may 1998 e-mail or fax to : lrec secretariat facultad de traduccion e interpretacion dpto . de traduccion e interpretacion c / puentezuelas , 55 18002 granada , spain , tel + 34 58 24 41 00 , fax + 34 58 24 41 04 , reli98 @ goliat . ugr . es last name : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ first name : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ affiliation : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ address : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ city : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ state / province : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ country : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ postal / zip code : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ phone : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ fax : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ e - mail : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ web : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ registration payment form registration fees full participant * after march 9 , 1998 25 . 000 pesetas ( about 150 ecu ) sub total : _ _ _ _ _ _ _ _ _ _ student * 12 . 000 pesetas ( about 70 ecu ) sub total : _ _ _ _ _ _ _ _ _ _ * registration fees include one copy of the proceedings , a social dinner , coffee breaks and refreshments . social dinner for accompanying persons 6 . 000 pesetas ( about 35 ecu ) sub total : _ _ _ _ _ _ _ _ _ _ pre conference workshops , may 26 - 27 , 1998 5 , 000 pesetas each for those attending lrec 10 , 000 pesetas each for those not attending lrec please indicate the workshops you plan to attend ( x ) _ _ _ _ _ " linguistic coreference " may 26 , morning session _ _ _ _ _ " adapting lexical and corpus resources to sublanguages and applications " may 26 , morning session _ _ _ _ _ " the evaluation of parsing systems " may 26 , afternoon session _ _ _ _ _ " minimizing the effort for language resource acquisition " may 26 , afternoon session _ _ _ _ _ " towards an open european evaluation infrastructure for nl and speech " may 27 , morning session _ _ _ _ _ " language resources for european minority languages " may 27 , morning session _ _ _ _ _ " speech database development for central and eastern europeanlanguages " may 27 , afternoon session _ _ _ _ _ " distributing and accessing linguistic resources " may 27 , afternoon session total number : _ _ _ _ _ _ _ _ _ _ x 5 , 000 ( if attending lrec ) _ _ _ _ _ _ _ _ _ _ x 10 , 000 ( if not attending lrec ) _ _ _ _ _ _ _ _ _ _ sub total : _ _ _ _ _ _ _ _ _ _ post conference workshop , may 31 - june 1 * _ _ _ _ _ _ _ " translingual information management : current levels and future abilities " * register only if you have been asked to participate and have confirmed with the organizers 10 , 000 ( if attending lrec ) 20 , 000 ( if not attending lrec ) sub total : _ _ _ _ _ _ _ _ _ _ grand total : _ _ _ _ _ _ _ _ _ _ method of payment you may pay by credit card ( visa , mastercard or eurocard only ; we cannot accept american express , diners club , etc . ) . you may also pay by banker 's cheque , bank transfer or by eurocheque . all payments must be in spanish pesetas . if payment is by banker 's cheque , bank transfer or by eurocheque , please send it by regular mail . if payment is by credit card , it may be faxed . please do not e-mail credit card numbers , as we cannot guarantee the security of our e-mail system , and because we require signatures . please indicate ( x ) one of the following four payment options : a ) _ _ _ _ i enclose a banker 's cheque in spanish pesetas payable to " first international conference on language resources and evaluation " . b ) _ _ _ _ i have transferred the full fees by bank transfer to your account at : banco central hispano , c / recogidas , 13 , 18002 granada . account name : first international conference on language resources and evaluation . account number : 0049 - 0372 - 18 - 2210856078 . i have told my bank to charge me / us with all bank charges so that " first international conference on language resources and evaluation " will receive the full fees . i enclose a copy of the bank transferpapers with the person ( s ) name written on the transfer . c ) _ _ _ _ please debit my visa / mastercard / eurocard account : amount : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ card no : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ valid from : _ _ _ / _ _ _ to _ _ _ / _ _ _ ( as printed on your card ) cardholder 's name and address : last name : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ first name : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ affiliation : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ street address : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ city : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ state / province : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ country : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ postal / zip code : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ e - mail : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ web : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ signature as on card : _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ credit card charges will be processed in spanish pesetas . d ) _ _ _ _ i enclose eurocheque ( s ) for the full fees . i have written my eurocheque number on the back of each eurocheque . mail or fax to : lrec secretariat facultad de traduccion e interpretacion dpto . de traduccion e interpretacion c / puentezuelas , 55 18002 granada , spain reli98 @ goliat . ugr . es + 34 58 24 41 04 fax visit our website for further information http : / / ceres . ugr . es / ~ rubio / elra . html conference addresses the conference chair is antonio zampolli ( istituto di linguistica computazionale del cnr and president of elra ) . antonio zampolli - lrec istituto di linguistica computazionale del cnr via della faggiola , 32 56126 pisa , italy + 39 50 560 481 tel . + 39 50 555 013 fax pisa @ ilc . pi . cnr . it the secretariat of the conference , who will provide general information on the conference , is : lrec secretariat facultad de traduccion e interpretacion dpto . de traduccion e interpretacion c / puentezuelas , 55 18002 granada , spain + 34 58 24 41 00 tel . + 34 58 24 41 04 fax reli98 @ goliat . ugr . es conference program committee harald hoege , siemens , munich , germany bente maegaard , cst , copenhagen , denmark joseph mariani , limsi-cnrs , orsay , france angel martin municio , president of the real academia de ciencias , madrid , spain antonio zampolli , istituto di linguistica computazionale , pisa , italy exhibition an exhibition will be organised by elra . this exhibition is open to companies and projects wishing to promote , present and demonstrate their language resources products and prototypes to the wide range of experts and representatives from all over the world participating in the conference . for more information on this , please contact the elda office on elra-elda @ calva . net . elra for more information about elra ( the european language resources association ) , please contact : khalid choukri , elra ceo 55-57 , rue brillat savarin f - 75013 paris , france tel . + 33 1 43 13 33 33 fax . + 33 1 43 13 33 39 e - mail : elra @ calva . net web : http : / / www . icp . grenet . fr / elra / home . html