special report assess structur fund intervent period commiss repli submit pursuant articl ec treati introduct reform structur fund sf commiss member state requir evalu european structur polici requir strengthen amend regul introduc context revis sf reform standard claus commun support framework csf singl program document spd evalu essenti tool sound manag sf defin main provis regul evalu effect level impact structur measur object set articl treati impact measur laid csf specif impact oper intervent programm form intervent main phase evalu prior apprais enabl correct identif socio econom problem resolv object achiev hand hand strategi adopt mean purpos ongo assess carri implement programm make check object desir result achiev post evalu carri programm complet aim analys result impact obtain consid posit bear mind long term effect structur measur appreci year complet version regul reiter respons member state commiss regard assess stress carri partnership system context commiss initi supervis gener coordin implement evalu accord articl regul eec submit year evalu report progress achiev econom social cohes contribut made fund nation financ scope audit gener aim court audit check progress achiev evalu commun structur intervent term system evalu procedur methodolog level audit look method evalu structur intervent commiss partnership system examin legal regular utilis appropri earmark evalu budget european commun qualiti financi manag appropri audit involv apprais techniqu evalu socio econom impact structur measur aim evalu programm directli intent produc scientif result made result work expert obtain understand relationship econom polici instrument result obtain specif audit carri post evalu csf oper programm op object no program period ongo assess csf spd op program period post evalu object csf account approxim post evalu report object csf ongo assess report csf select basi geograph distribut natur intervent csf spd op addit court analys evalu report dealt macroeconom aspect audit carri commiss member state belgium greec spain franc ireland itali netherland portug auditor consult assessor nation author concern summari main observ evalu develop spread commiss initi program period context erdf lead recognit field manag program begin program period evalu systemat appli phase prior apprais ongo assess appli end period post evalu paragraph commiss figur direct expenditur evalu access inform expenditur evalu carri partnership system paragraph commiss made consider contribut spread idea evalu introduc adequ framework evalu indic method programm method evalu activ structur natur mean view complex natur methodolog aspect evalu singl methodolog appli specif situat import commiss posit suppli methodolog framework provid guidelin implement evalu suit specif situat paragraph qualiti indic close link reliabl inform gain monitor exist intervent statist base member state respons inadequ member state improv qualiti paragraph evalu complet late proportion delai adjust programm decis make system evalu result perform effect intervent scheme account futur programm paragraph regard object evalu commiss make spot check consist reliabl indic system produc paragraph signific shortcom commiss procedur award evalu contract consult choic consult justifi contract specif gener term methodolog techniqu indic achiev result lead delai disturb submiss evalu report qualit variabl analys vagu recommend paragraph implement post evalu methodolog object no statist shortcom lack object absenc quantifi forward indic ineffect monitor impact suffici stringent evalu reveal sf contribut commun ad term achiev result effect csf op measur point view program organis monitor coordin partnership addition paragraph regard ongo assess sf intervent carri partnership aegi monitor committe examin physic financi result plai import role mid term assess variat prioriti grant evalu object evalu effect hamper problem indic model effect type evalu rel term decis make process manag project reprogram prepar futur intervent paragraph specif case object evalu reveal weak mismatch programm implement commun fund signific carri over appropri programm averag shift period paragraph success short program period permit optimum evalu result paragraph indirect effect measur suffici determin impact structur intervent employ paragraph fail program implement monitor system macroeconom evalu reveal posit result respect impact structur measur increas gdp effect suppli demand improv term employ converg effect csf instrument paragraph evalu programm measur continu inadequ technic difficulti caus dispers inconsist measur programm paragraph gener issu introduct aim evalu determin socioeconom effect measur implement examin result obtain compar resourc invest analys cost point look relat forecast evalu task presuppos good statist basi quantifi object establish basi system indic develop methodolog analyt framework time support analysi relationship mean final result intermedi result court found fail level real progress help consolid system evalu limit us evalu carri connect structur fund reform evalu explicitli includ partnership system articl regul eec fulli amend regul juli program period evalu carri commiss initi evalu post hamper lack specif develop strategi inadequ monitor gener speak consider discuss detail monitor committe commiss initi concentr set evalu mechan csf cover reform prioriti object commiss initi connect develop evalu evalu method mention made creation technic group evalu region polici methodolog level launch programm method evalu activ structur natur mean period commiss respons evalu system systemat appli phase prior apprais ongo assess appli post phase ongo assess explicitli provid sf regul appli csf spd op program period concret term fall partnership system allow monitor committe turn integr manag tool contribut broad awar idea evalu commiss set system phase implement ongo assess member state system actual procedur definit project specif criteria select assessor structur evalu report data collect qualiti standard timet time commiss organis seri event accompani number public bring sf manag expert field evalu event contribut develop idea evalu help rais manag awar subject evalu present primarili process learnt experi job context preliminari draft budget european commun financi year commiss present evalu report work paper describ evalu activ carri list evalu implement underwai suppli summari result evalu implement period expenditur evalu work financ directli commiss financ member state tabl show expenditur directli settl dg xvi field evalu program period period tabl show mio ecu spent evalu third expenditur occur field directli commiss jurisdict directli respons hand commun initi articl regul eec amount mio ecu hand cross disciplinari themat evalu amount mio ecu sme telecommun environ human resourc amount earmark evalu object no structur fund small fact period partnership develop field evalu shown tabl amount earmark evalu period amount mio ecu april increas previou period due develop ongo assess methodolog partnership system regard spend field commiss member state increas consider commiss fulli inform evalu includ technic assist measur oper programm involv form expenditur specif alloc cover evalu provid initi program phase make expenditur transpar refer framework mean programm mio ecu plai specif role process develop evalu procedur appli aim encourag develop uniform consist methodolog inventori method member state identif valid exampl essenti empir exhortatori approach enabl commiss decid actual procedur implement evalu method dictat choic indic measur socioeconom impact field region develop view complex methodolog aspect evalu singl method applic specif situat import commiss posit suppli methodolog framework enabl guidelin drawn implement evalu suit specif situat result mean programm lai foundat evalu procedur introduc common languag enabl prepar ongo assess partnership system tabl show gener accept evalu procedur mean programm provid detail answer question practic oper aspect evalu fundament question remain unansw firstli system indic formul assess commun structur programm evalu approach suitabl measur socio econom impact structur programm context region develop commiss draw precis instruct actual techniqu appli specif evalu situat absenc instruct felt ongo assess intervent program period statist base inform object evalu prior apprais ongo assess post evalu confront object formul gener regard object measur question level develop exist statist base impedi monitor evalu programm measur financ structur fund shortcom evid point includ lack statist coverag limit area concern absenc statist aspect collect inform interv inappropri relat monitor evalu indic exist reliabl system indic essenti element plan process evalu purpos structur programm inform financi physic achiev result perform indic provid manag inform long term effect action provid measur progress achiev relat object programm region growth reduct unemploy reliabl financi indic close link expenditur certif commiss prior relev commun payment physic indic consid sourc supplementari inform reliabl consist exist databas provid record actual physic progress final recipi provid manag period inform physic state oper ongo assess lisboa vale de tejo op portug report physic indic strict proport expenditur mention variat link delai implement member state improv monitor system databas indic base measur result impact programm measur level measur impact programm level hamper fact causal relationship level object object measur project horizont effect complementar synergi measur object identifi certainti difficult defin specif effect measur region develop impact invest demand fortiori suppli context regard csf search indic serv tool evalu result impact complet paragraph prior apprais csf essenti subsequ evalu ensur result impact indic quantifi enabl judgement made estim impact programm concern comparison drawn actual effect context manag object approach appli uniform satisfactori fashion impact term indic evalu italian csf small number indic fact hamper subsequ evalu hand portugues csf approv commiss major includ indic complic evalu variat establish indic csf highlight lack consist program system indic approv commiss prior apprais number gener unquantifi object revis purpos ongo assess found badli defin insuffici function structur intervent socioeconom situat brought bear give rise wide varieti indic develop local partial list indic region nation author subject debat commiss drawn list indic consid essenti repres term region develop connect type measur quantif result impact indic develop connect monitor time quantif reliabl fact unreli fail prevent case job count distinct made gross net effect employ discov compar ongo assess report brandenburg op statist peopl regist social secur offic take evalu account contribut evalu term effici utilis commun fund larg depend qualiti content result receiv decis made strategi number ongo assess csf spd op program period finalis late delai regard object success shorter program period compar object mean date program decis coincid evalu result make imposs learn past adapt subsequ intervent object program evalu cycl extent step final version summari report post evalu object period submit commiss summer prior apprais program period underwai post evalu period start budgetari appropri structur programm subsequ programm rare influenc programm result shown evalu report program period decis take system rare account evalu programm gener base primarili degre financi absorpt case recommend made head consult context post evalu object csf paragraph qualit aspect perform programm effect identifi ongo assess implement report suffici impact oper manag sf develop sens respons partner affect develop programm monitor result ongo assess object spd csf op reveal diverg financ plan implement programm situat utilis appropri main concern result import role evalu analysi area question estim consist object resourc alloc impact structur intervent evalu conclus recommend evid intervent manag parti involv case post evalu paragraph ongo assess partnership system object evalu lack precis frame refer hindranc applic suitabl techniqu object appli specif evalu situat produc easili verifi result guarante independ assessor occas recommend method object justifi assessor adapt approach difficulti encount select indic basi inform independ manag guarante field inform paragraph evalu report give sourc inform observ base fail rais doubt reliabl valid inform submit evalu report object guarante verif system base qualiti indic implement result impact reliabl basic inform degre implement methodolog commiss depart analys inform result submit evalu procedur carri spot check verif evalu system member state work evalu contract award commiss audit commiss procedur award evalu contract show number shortcom unsatisfactori select procedur excess vagu specif delai low qualiti report minut meet call tender judgement analyt factor determin commiss choic consult court audit provid evid show expert field compet select case post evalu object csf object select procedur appoint chief consult accompani nation consult coordin consult subcontract evalu work consult chain consult commiss lose control evalu procedur suppos guarante consist uniform qualiti result specif vagu term descript work carri oblig achiev result word contract gener procedur carri evalu work left open pend agreement commiss methodolog framework delai respect schedul submit report case evalu object csf contract provid report submit februari actual fact complet novemb commiss provid penalti failur compli contractu oblig deadlin contrari made final payment juli term articl contract contract clear precis guidelin methodolog result expect consequ commiss depart react report wai report approv simpl descript vagu analys us work carri base gener statement person question produc gener recommend case post evalu ireland csf depart recommend termin consult contract bad qualiti report depart approv case post evalu portugues csf depart concern agre provid assess report reiter aspect physic implement present nation author similarli point post evalu report spanish csf descript suffici analyt post evalu northern ireland csf judg incomplet report post evalu italian csf consid badli structur organis evalu report greek csf chapter chapter conclus gener conclus post evalu object no csf introduct assessor face difficulti initi program carri hastili prior apprais programm intrins econom fundament regard object region absenc quantifi object result indic gap statist regard socio econom situat object sf intervent regard industri fabric invest gross region product statist tool correspond area select analysi borough district employ catchment area fact measur complet exist exogen factor explain develop socio econom situat alloc aid link close region local heterogen natur project object hard identifi intrins effect measur programm barrag measur aim region area difficulti measur indirect effect programm employ system observ set purpos programm launch detail inquiri carri subject complet post evalu object csf post evalu object csf coordin central consult compris post evalu csf concern carri nation consult januari june consult respons coordin develop methodolog appli made analyt method macroeconom measur project level approach aim firstli analys strategi intrins logic csf op measur provid preliminari evalu physic progress impact final examin implement system procedur summaris annex gener consist propos methodolog shortcom analysi intrins logic strategi csf op measur base uniform structur object link standard classif activ approach comparison member state necessarili object list order import basi member state prioriti criteria hierarchi complementar substitut synergi identif inconsist strategi specif csf op methodolog suppos provid answer relev question intent unintent effect case physic impact indic methodolog paper unabl provid court audit found shortcom develop socioeconom environ csf op comparison made initi situat commun intervent act situat end data date region differ insuffici analysi rank object requir methodolog guidelin partial op measur select specif examin systemat appli structur criteria result rank object instrument produc improv identif problem consist relev rel import prioriti adjust made csf op analysi financi implement implement system physic implement gener dealt evalu report case effect programm measur examin term job creation result formul quantit term quantif effect provid appli macroeconom model concern increas gdp job creation competit show inadequaci data provid manag context monitor system bottom analys gener conclus drawn term impact programm level commun ad express qualit term take account programm logic implement integr strategi effect organis process investig systemat anticip long term effect discuss discuss qualit term spanish object csf subject post evalu order commiss organis nation author financ commun studi drawn period pursu object conduct independ separ regard result impact post evalu highlight physic achiev object csf macroeconom impact csf observ nation evalu progress made field plan field programm base approach encount obstacl stress csf contribut term innov organis structur financi manag monitor inform system coordin partnership substanti progress need level chief consult summari includ recommend commiss follow complet programm drawn clearer distinct made commun structur intervent design encourag endogen growth factor aim restor region equilibrium rais live standard concern strike balanc prioriti infrastructur invest specif region characterist need develop find equilibrium fight unemploy increas product competit final recommend region polici pai attent employ post evalu object csf carri nation assessor concentr improv member state monitor manag system real exercis assess impact sf post evalu object post evalu object programm period coordin extern assessor elig region gener analysi made region detail studi made region main aim evalu analys impact structur intervent industri redeploy process region draw lesson program phase summari evalu approach appear annex ii common framework envisag approach adopt heterogen concern prioriti adopt depth analysi descript critic method techniqu analys strategi appropri csf op undergon relat socio econom environ seldom lead reformul structur object programm measur accord logic region develop redeploy basi criteria rank complementar substitut strateg analys base structur csf op partial uncrit regard strategi concern reformul kind due elabor make systemat identifi strategi shortcom term consist weight prioriti synergi complementar effect vi vi socio econom environ impact sf intervent assessor basi sampl project examin result ad addition aggreg observ term individu measur socio econom impact programm concern impact evalu base genuin combin top bottom approach combin evalu object intervent tuscani case top approach bi region tuscani rest itali econometr model estim impact increas demand product sector consumpt level ad tuscani rest itali model make estim multipli effect type intervent infrastructur servic busi aid privat invest effect employ direct effect employ estim techniqu standard coeffici type intervent top approach regard direct short term effect relat demand bottom approach base sampl project measur capabl reflect long term form indirect effect relat suppli extern save enabl reduct product cost effect difficult isol quantifi approach enabl aggreg effect term individu measur programm object detail evalu qualit consider effect measur degre addition commun intervent constitut complement top approach combin approach provid real ad term analysi base techniqu model formalis impact evalu make systemat inquiri number investig addition measur applic specif method estim net measur relat job creation compar experiment group control group rare provid real ad term impact evalu effect measur programm accur evalu assessor conduct statist analys result indic wish carri find data number compani locat industri zone set sf aid technolog transfer research establish busi meet measur project manag gener provid evalu procedur seldom made obtain precis inform physic implement result impact oper field job creation result clear term durabl job specif contribut ascrib structur measur addit data produc evalu report contradictori regard impact object programm draw conclus post evalu object op bring improv socio econom situat contribut avoid deterior mainten employ prepar ground industri redeploy region seek diversifi economi industri base cast reput exclus industri area integr procedur base programm concept op consist modif nation region polici set constitut program tool simultan exist object op commun initi gave rise confus overlap aid sf intervent posit effect term program implement method partnership synergi coordin evalu lack synergi commun erdf esf manag measur stress addition sf make tackl target area carri project remain unrealis commun aid speed implement carri ambiti project give form charact initi project addition type measur aid infrastructur busi servic aid privat invest vari consider sf act lever involv privat monei evalu omit aspect evalu stress studi preparatori negoti administr procedur relat adopt implement project integr nation polici involv delai underestim regard manag evalu show techniqu monitor programm inadequ intern made program period concern maximis rate absorpt appropri revis region develop prioriti ongo assess develop integr principl ongo assess ongo assess provid chapter implement provis deal improv monitor includ csf spd form intervent stress ongo assess involv critic analysi data collect monitor explain differ relat origin object assess intend result measur question opinion valid current intervent relev object letter member state financi year commiss stress ongo assess provid monitor committe inform programm run smoothli put forward reprogram measur present independ object pictur progress made initi phase propos concentr oper condit intervent indic manag abil person charg procedur select project subsequ view propos adapt program evalu report relev strategi emploi valid intervent object effect programm term work carri initi result relat object effici programm correct applic commun polici environ public contract measur result employ sme addit commiss suggest evalu gener themat evalu sector geograph area develop phase member state spain franc ireland netherland drew framework ongo assess feel ongo assess develop socioeconom context strategi intern extern consist implement condit includ program select criteria administr organis monitor system project financ channel implement result achiev take account intend result initi effect obtain apprais expect effect cost view measur effici relationship expenditur result felt ongo assess lead propos respect prioriti intend measur partnership system introduc mean ensur effect sf plai full role system decentralis manag start ongo assess csf occas decid monitor committe respons establish object evalu requir qualiti standard need guarante consist process adapt specif characterist region question whilst respect object exercis select assessor basi shortlist prepar person respons evalu member monitor committe commun rapporteur public call tender ongo assess made real contribut strengthen partnership system allow particip causal analysi structur intervent tabl show oper implement ongo assess signific work carri member state partnership system term identifi impact sf partnership approach ongo assess strongli influenc institut structur nation region tradit public bodi respons made widespread knowledg idea multiannu program evalu essenti draw critic assess structur intervent prepar adjust field evalu partnership develop connect object present aim ongo assess work suppli solut involv programm design manag polit leader work result bulki report inform programm prior apprais annual implement report ongo post evalu inform glean oral audit result recommend real term assist decis make manag project reprogram prepar gener intervent implement procedur intermedi evalu undertaken concern object no implement evalu subject signific delai member state intermedi evalu process origin envisag compris distinct stage stage involv assess scope evalu identif relat problem consist evalu subsequ draft report practic arrang seldom appli rule commiss insist intermedi evalu carri extern expert guarante credibl individu imparti conclus legitimaci strategi consist socio econom analys object quantif intend effect evalu requir area structur fund creat space year network extern assessor commiss member state advantag gener greater expertis area focus specif market practic court spot check highlight limit independ extern consult limit time assessor consult de facto depend programm manag inform separ respect duti rigor result obtain term perform reproduc updat inform monitor system present extern contribut usual procedur open invit tender base public offici journal appli view select consult carri assess netherland procedur consist limit number consult list potenti assessor submit bid select made bid commiss regularli particip monitor committe meet win accept criteria select consult involv process inconsist belgium greec portug commiss activ involv procedur select assessor framework technic group ad hoc technic accompani committe prepar choic consult monitor implement evalu contrast franc commiss offici inform bid deem select accompani final propos respect prefect region capac contract author ask observ brought attent netherland commiss take part work nation accompani committe pilot ant intermedi post evalu region cover object no work monitor committe react belatedli content draft intermedi evalu report flevoland object spd prioriti evalu object implement ongo evalu prioriti evalu object vari except examin physic financi result measur import aspect ongo evalu prioriti develop correspond genuin region corsica emphasi deal problem manag monitor link evalu monitor pursuit evalu object hamper technic problem measur evalu impact indic ongo evalu accord suffici import critic appreci region develop strategi chosen viabil project financ structur fund criteria select project effect impact programm specif gener object commun ad analysi object post evalu object object csf program period cover except case ongo evalu socio econom context commun assist take effect respect evalu contract gener provid monitor updat dealt systemat case mean detail progress chart wallonia unsatisfactori manner case direct influenc qualiti updat analys strength weak gener carri part ongo evalu extent mainten time intern extern coher programm compon object programm programm measur degre complementar synergi object measur examin rare systemat manner case brandenburg op financi commit respect prioriti product invest infrastructur account period initi estim assessor provid justif region develop strategi implement synergi subject analys incomplet aspect warrant systemat treatment regard synergi erdf esf activ similarli reorient programm prioriti alloc resourc explicit object evalu evalu produc consist present propos amend explanatori memorandum implic extens curtail propos respect measur evalu examin show assessor achiev object envisag contract evalu measur impact time resourc proportion object approach method techniqu contract formul evalu object approach gener term choic approach method techniqu left assessor adapt implement difficulti encount assessor occasion make indic inform dispos techniqu method develop meet evalu object genuin consensu exist oper methodolog evalu region develop commiss circul practic gener term coordin harmonis implement concret imprecis dispar member state program implement evalu result evalu report variabl qualiti make difficult compar result european level measur impact measur reveal shortcom techniqu appli characterist complex effect evalu detail search relev indic carri envisag indic serv measur physic financi result impact indic substanc evalu socio econom region develop impact appear hamper increas number measur programm measur object whilst programm assist convers revitalis industri op commun initi nation programm implement jointli commun nation measur differ applic date measur launch lastli object unquantifi formul gener context link diagnosi socio econom problem resolv object seri measur programm project implement link object seri obviou rememb physic impact indic attribut level programm wholli reflect programm evalu requir similarli difficult identifi result programm separ result privat region nation measur model estim expect effect impact measur basi mid term anticip result rare ongo evalu nation csf base input output model portug macro econometr model spain ireland whilst region model continu margin develop model provinc hainault belgium context intermedi evalu worthi mention connect establish model describ effect measur widespread field transport infrastructur mention made applic input output model expo project portug part prior ongo evalu estim consid caution estim effect measur employ precari applic model analysi enquiri techniqu suppli adequ inform hand net number job creat take consider number job creat measur effect job substitut hand degre perman job creat applic model techniqu provid detail job attribut implement programm evalu contract provid part bottom approach enquiri respect local econom develop partner final beneficiari includ compani receiv commun aid view make quantit qualit assess contribut made commun programm enquiri find unrepres light number particip compani partner limit reliabl subject scrutini result impact indic observ time obtain data statist long exist data cover geograph area correspond area question data compani record establish concern fact distort local statist singl establish present area compani premis countri statist bodi unabl subdivid data suffici precis target area seri problem assessor adequ indic view measur impact compens shortcom replac origin envisag substanti leav situat oper natur uncertain mention enquiri carri give concret form indic estim cost stress difficult quantifi indic programm aim absenc inform histor seri implement object programm result ongo evalu spd csf op period monitor procedur highlight imbal financ origin envisag fund implement programm numer adapt programm program phase order absorb financi aid appropri transfer program period averag rate risk situat lead overrid emphasi appropri underestim role evalu consist object resourc alloc impact structur measur impact structur fund evalu model impact csf programm result model impact structur fund specif characterist model macroeconom evalu field structur fund annex iii make differenti assess impact structur fund implement structur fund object term gdp growth actual converg capita gdp employ unemploy observ condit implement structur fund addition durabl develop refer control public debt balanc payment incom distribut respect environ effect term suppli demand effect structur fund instrument public invest invest human resourc aid privat compani gdp growth tabl show result princip model evalu impact structur fund hermin ogm dio posit increas gdp cohes fund countri greater converg cumul growth economi cohes fund countri result structur measur csf appear term real gdp portug greec spain ireland result assum principl addition fulli observ modifi principl observ paragraph macroeconom model produc suffici consist result impact csf real annual gdp growth consid plausibl demand relat effect continu predomin short term effect suppli appar similarli helm region model hainault region evalu impact spd term annual growth total ad account increas period contrast case italian mezzogiorno impact structur fund growth limit close commiss quest model introduc hypothes expect busi consum produc lower estim effect growth employ case previou model gain shown model regard potenti growth reduct unemploy appar longer term averag acceler annual growth due structur measur implement part csf tabl show growth gdp gener multipli effect csf lead period addit annual growth demand suppli econom speak predomin highlight hermin model effect demand disappear commun aid discontinu contribut achiev object articl treati effect suppli last increas product capac region concern effect suppli appar demand multipli effect underestim real converg term capita gdp model framework structur fund show converg guarante csf program reduc diverg develop converg case ireland bradlei hermin honohan hermin envisag effect aid csf capita gdp bradlei consid csf contribut bring irish economi closer eu averag modest honohan view csf plai signific role converg process beutel predict ireland catch rest europ csf increas annual growth rate similarli annual growth rate spain portug greec increas period due structur fund case posit effect converg term capita gdp forecast simul base ogm model converg real capita gdp relat eu averag provid estim stress fact trend project pessimist case ireland tabl csf net contribut converg remain modest cohes fund countri case hainault helm model take aspect real converg consider purpos ongo evalu consid provinc estim annual growth rate approxim higher european averag structur fund figur make hainault catch region estim highlight fact differ object member state region sector product structur structur fund aid produc variabl effect confirm structur fund program improv order assist improv economi product capac view converg employ unemploy tabl summaris find evalu impact structur fund employ unemploy studi conclud csf gener net job job creat trade servic sector product effect csf concentr industri sector lastli studi note reduct number industri job due increas product effect csf instrument hermin evalu spain ireland portug show aid public invest infrastructur product term growth aid invest human resourc spain privat invest trend illustr tabl show instrument increas gdp due increas total gdp gener csf period case greec hermin studi conclud invest hard infrastructur cover csf contribut gdp growth invest human resourc ogm model pereira evalu effect replac aid privat invest invest human resourc addit aid invest infrastructur show improv gdp growth converg process result structur fund addition joint financ requir aforement model made evalu signific addition public joint financ honahan hermin consid public joint financ requir growth rate irish economi lower employ experienc smaller increas contrast honahan envisag appreci reduct public debt proport gdp balanc payment surplu public joint financ requir appli case portug joint financ requir lead hermin evalu total addit gain term gdp develop posit term public debt helm evalu hainault attach great import addition evalu averag rate growth ad period base envisag scenario region polici includ spd continu region polici commun aid region polici spd deduct growth rate term employ fall industri situat deterior consider helm evalu conclud rate subsidi vari aid stimul invest extent consider invest place level aid lower durabl develop tabl show effect structur fund balanc trade current account balanc public debt evalu studi reach conclus econom expans gener csf lead case improv public financ taxat model csf creat budget deficit role macroeconom evalu structur fund decis make process short term effect structur fund demand ongo evalu tend estim difficulti experienc polit author commun fund underestim longer term effect suppli reorient reprogram op csf bias fact measur project commun appropri quickli discontinu field innov technolog implement complex favour exist structur product case macroeconom aspect sustain develop consid context addit macroeconom evalu account sustain growth converg essenti decis initi program occas spain greec german länder measur reschedul basi ongo evalu macroeconom analysi regard object region germani macroeconom analysi impact measur perform intermedi evalu made impact programm measur project evalu made programm measur act drive forc structur fund program fragment lack definit inconsist programm measur inadequ quantif specif object explain difficulti measur impact shortcom complic attempt identifi measur synergi degre complementar individu measur programm link programm gener object specif object programm measur unclear case problem consist object csf programm note ongo evalu report techniqu seldom fashion measur impact programm specif measur macroeconom model evalu effect csf princip instrument public invest privat invest invest human resourc term respect contribut gdp growth expenditur infrastructur increas yield privat capit complement speed converg form invest tabl choic financ measur programm make programm neutral term impact region develop last endogen growth evalu perform commiss member state context partnership programm measur insuffici make examin consequ specif measur area sector compar measur similar object analysi impact measur programm consider initi attempt offset growth inter region equal determin choic made compar expect gain effici actual result principl project rel cost advantag analys view approv financ pursuant articl regul eec erdf analysi compulsori case major project total cost mio ecu invest infrastructur mio ecu product invest prior assess major project part examin applic commun aid determin amount financ post evalu provid sf regul requir commiss purpos establish socio econom advantag obtain reflect commun resourc origin provid defici process evalu major project render concept evalu area ineffectu prior assess justifi post evalu made microeconom sector studi potenti impact structur fund product effect instrument analys impact short medium term synergi complementar consider project evalu current evalu connect inadequ superfici harmonis synergi complementar project essenti weaken desir impact ongo evalu tackl problem relat programm manag account criteria determin select project sustain contribut region develop programm manag system guarante criteria select project appli ensur programm produc result project provid ad term develop avoid fact consum appropri quickli advantag project select system transpar purpos inspect evalu conclus evalu commun structur measur legal requir stem council decis extens implement partnership member state evalu system aid design manag intervent measur contribut improv understand effect us period mid term evalu complet monitor committe revis reform structur fund evalu enter phase matur consolid delai improv methodolog work determin evalu method measur socio econom impact programm framework region develop mean programm unabl provid satisfactori solut attent paid indic level relev scrutini inform attend cost addit qualit aspect formalis progress area evalu process stagnat true statist base weak cast doubt valid indic major influenc monitor evalu process current plethora indic vari relev detriment qualiti evalu prevent oper small number impact indic essenti justifi reorient structur polici carefulli select bear mind constraint impos regionalis data materi possibl gather inform reliabl indic check compar indic aggreg european scale improv order full account evalu decis make process oper manag structur fund step ensur evalu transpar object object correspond requir finalis date adequ order evalu find object assessor remain independ manag public author concern common frame refer make easier read compar evalu report share practic experi evalu oper object defin term refer technic specif gener approv commiss methodolog deal region sector nation aspect specif cover short long term effect strength weak methodolog compar commiss method similarli frame refer evalu includ minimum list indic propos commiss measur perform programm object guarante degre consist essenti purpos analysi socio econom structur indic complement refin analysi divers approach evalu commiss requir assessor explain approach explicitli call tender issu type effect impact suppos measur period concern view assess exhaust method addit evalu detail analysi link programm object prioriti measur implement achiev inter relationship object result programm prioriti measur context divis evalu beneficiari concern improv increas effici meet specif expect area ongo evalu similarli greater control cost sought commiss awar volum expenditur alloc evalu partnership framework commiss aspect region polici evalu addition converg partnership concentr employ endogen econom develop social welfar capita gdp criterion judg effect structur measur base estim programm effect impact commun ad nation region develop model model impact individu measur macroeconom result structur measur refin take account imperfect underli model side effect measur cumul effect social welfar macroeconom model make fundament distinct effect demand shorter term structur adjust term suppli program structur fund assist place greater emphasi improv product capac economi ensur effect assist perman avoid excess depend demand lead situat commun aid remain essenti long term effect suppli appar longer period ongo evalu gener pai attent effect demand commiss aim develop instrument need monitor evalu effect structur economi macroeconom model show polici econom growth compat durabl develop relationship impact growth effect durabl develop analys greater detail systemat account dualiti program structur fund assist effect addition public joint financ requir easi discern examin systemat detail analys carri area evalu se profess replac polit decis make process involv broader consider aim provid essenti tool sound effect manag commun structur measur take account socio econom result report adopt court auditor luxembourg meet septemb court auditor bernhard friedmann presid gt tabl gt gt tabl gt gt tabl gt gt tabl gt gt tabl gt gt tabl gt gt tabl gt gt tabl gt gt tabl gt gt tabl gt gt tabl gt articl framework regul regul eec amend regul eec task structur fund effect coordin activ articl fund coordin regul regul eec amend regul eec prior apprais call prior assess court prefer adopt express prior apprais appear regul commun oper complement nation oper contribut set close consult partnership commiss member state concern compet region local bodi social partner compet bodi partnership conduct full complianc respect institut legal financi power parti concern annual report financi year chapter chapter chapter court report numer shortcom field evalu program period concern evalu program period prior evalu csf post evalu csf post evalu csf themat evalu sme telecommun program period prior apprais region develop plan prior apprais programm prior apprais sdp prior apprais sdp critic analys sdp csf commiss request evalu member state impact european structur polici econom social cohes union dg xxii memo march draw term refer evalu csf object form intervent confirm role ongo assess aid decis make monitor committe implement partnership system procedur implement composit role evalu team distribut common guidelin monitor ongo assess commun sf lai factor analysi specif object link monitor ongo assess send letter member state remind requir carri ongo assess desir implement procedur brussel confer evalu european region polici novemb result post evalu object prior apprais european confer evalu method sf intervent berlin decemb problem involv assess impact micro econom macro econom themat level sevil confer march aim promot exchang experi field evalu partnership system programm manag jointli commiss extern consult involv financ budget head annual amount ecu programm programm approach hamper short plan deadlin impli absenc prior apprais ii lack tangibl object quantifi indic implement result impact iii administr constraint programm programm fall respons author sector region approach overlap iv weak commun rule result project reject object op accept context commun initi project project approach cohes fund contribut harmoni applic programm programm approach job creation econometr model base hypothesi full employ compani product overcapac turn annual report sf mention import leverag effect refer result creation job compani evaluación intermedia de programa operativo regional del objetivo fase orientacion sobr contenido comun recog en lo pliego de condicion técnica datar regulatori administr timet gener criteria underpin term refer mid term evalu oper programm commun initi evaluatiekad voor de programma van de europes structuurfondsen terp advi cbea pieter van run decemb examin spot commiss revitalis countrysid strengthen econom fabric region structur modif relat region develop monitor committe includ repres nation author concern commiss annex summari methodolog appli part post evalu object csf explicit aim post evalu object csf assess strategi object select csf draw conclus futur action analys consequ initi object redefin adjust intervent implement period provision stock concret result csf op signific measur make initi assess impact analys effect implement mechan draw conclus view make futur adjust methodolog approach prepar princip consult respons coordin evalu made consult behalf member state concern object order evalu logic intrins csf op adjust made csf op specif analys adjust commun ad intern consist extern consist relev strategi exist problem appropri financ task base top approach carri collect inform kei data financi data ant object anticip output effect target group area main instrument number project measur approv number project complet descript environ develop programm initi situat current situat identif extern factor influenc develop programm success failur analysi basic problem formul kei region develop indic includ indic dispar identif polici instrument loan subsidi technic assist prioritis object identif level prioriti link object instrument object analys perform base top bottom approach analysi output effect op measur project account net loss substitut multipl effect analysi rel effect measur combin measur analysi success failur comparison output input aim formul kei option indic object aim analys effect csf op implement measur small number measur identifi exist plan improv plan implement monitor evalu process member state examin cover decis make plan financi control implement monitor inspect mechan financi channel partnership addition fund coordin greater flexibl transpar simplif harmonis process implement monitor analys depth small sampl measur major project ad hoc sampl programm measur project chosen view substanti small number physic impact indic carri depth analys annex ii summari post evalu approach respect object post evalu commun assist object plan period gener includ erdf esf compon compris gener comparison object region area socio econom situat prior object structur fund assist socio econom situat assist analysi strategi emploi term prioritis object prioriti measur indic plan unanticip effect synergi programm compon utilis fund analys base content csf op annual implement report report submit monitor committe prior post evalu detail studi cover region aim studi depth csf op type measur adapt analys institut structur programm manag procedur evalu impact ad effect attribut csf op evalu cost effect effect studi object programm contribut region develop process depth evalu emploi bottom approach aim examin oper cover select process typolog manag process impact effect term ad synergi addition work upward level compil inform individu measur ultim programm annex iii characterist macroeconom model evalu structur fund princip model macroeconom evalu structur fund compris econometr model hermin helm quest ii calcul gener equilibrium model ogm bbm input output model dio fidimi structur residu analysi characterist applic model case examin shown diagram form tabl iii iii tabl iii reproduc model characterist csf simul evolut economi object countri period year multi sector base perceiv structur chang brought structur fund evalu reliabl catch process commun assist suppos support consolid part enquiri court analysi perform assess appropri macroeconom techniqu measur impact structur measur establish contribut effect decis make strateg aspect program analysi show explan endogen exogen factor success structur programm depend vari method conceptu approach emploi fact macroeconom model aim describ mechan econom system countri region captur simul effect exogen shock assist provid structur programm singl descript econom fact definit hermin econometr model take account specif characterist member state aggreg effect nation level assum economi utilis full product capac acceler multipli effect relat increas invest creat expans product employ model give satisfactori result term effect demand regard effect suppli take phillip curv account model suggest fall unemploy bring increas wage whilst limit effect inflat effect product explicitli account model extern save effect increas improv human capit public privat physic capit product account differ countri model partial inform durabl develop variat exchang rate aim guarante stabil balanc payment variat fiscal transfer helm macro econometr model ongo assess object spd provinc hainault belgium region develop approach specif account effect endogen growth link long term product improv product due sf intervent larg limit industri sector concern labour product basi similar assumpt hermin model regard utilis product capac multipli acceler effect invest demand aggreg effect spd hainault economi invest gener ad employ manufactur industri commerci servic sector period year note helm model region export account import region risk overstat effect demand figur demand higher wage adjust relat fall unemploy higher cost capac constraint account helm model inform trend unemploy demand labour lastli base histor statist data cross check seri relev data comput gener equilibrium model appli nation level show long term effect commun structur measur suppli omg model context inter tempor endogen growth assum product factor market equilibrium economi work full product capac demand effect product employ sf programm stimul growth increas product product effect product function object model determin optimum situat countri maximis function inter tempor social basi hypothesi situat uncertainti econom agent anticip perfectli amount monei alloc period aid spread suppos consumpt invest decis relat data lastli omg model long term stabil balanc payment budgetari equilibrium sector bbm model expect labour market equilibrium demand influenc product employ sector expans demand suppos gener growth model includ technolog chang relat product effect result reduct input dio input output model show link resourc economi final consumpt identifi interdepend sector countri link basi intermedi consumpt input output approach maximis effect structur intervent demand ignor suppli effect product wage inflationari adjust durabl develop consider fidimi model combin gener equilibrium model input output model analys effect commun intervent southern itali north countri exist techniqu measur effect region polici eurostat structur residu analysi evalu impact sf area elig object analysi attempt identifi residu result differ actual situat counterfactu situat produc applic estim nation tendenc carri calcul impact mix result programm evalu nation european polit measur path previous region polici studi carri eurostat includ data indic recent date back consider reduc conclus quest ii model attempt analys economi member state interact rest world unit state america japan model concern transmiss effect econom polici nation intern level initi devis serv simul tool predict purpos quest ii model pai attent effect demand predecessor take greater consider interact term stock attent implic term behaviour econom agent gt tabl gt gt tabl gt gt tabl gt hermin econometr model base origin herm model harmonis econometr research model econom system minimum size min distinguish min helm hainaut econom lead model quest ii multi countri busi cycl growth model econom paper octob dg ii econom financi affair optim growth model ogm pereira bourguignon branson de melo model bbm lolo zonzila dynam input output model dio beutel fidimi consult compani evalu macroeconom impact object csf itali implement mechan court servic extern assessor highli specialis field macroeconom european economi model commiss repli gener comment commiss accept evalu process parti rough readi scope made insist remark progress made space year consciou difficulti overcom commiss redoubl effort organis methodolog front achiev satisfactori situat engag perman dialogu countri union studi carri research area main phase develop assess process structur fund intervent program period period regul reform structur fund adopt council decemb nation plan submit begin partli reflect requir strateg vision choic object achiev quantif expect result post evalu attempt remedi shortcom compar result achiev rework object consider task suffer limit reflect report deal intervent object object area repres attempt coher analysi impact reform econom social cohes period request member state commiss experi tighten rule monitor evalu identif stage prior apprais ongo assess post evalu doubt success ongo assess strictli requir regul mid term assess organis time level monitor committe bring assessor beneficiari assess closer report produc present debat committe result process serv educ oper purpos studi organis carri commiss hope fulfil discrep method emploi choic assessor cost work level detail report coordin gener supervis provid commiss evalu coordin unit nation contact technic evalu group differ connect discret allow member state subsidiar principl commiss believ process plai essenti role propag genuin climat evalu prove beneficiari oper tool improv manag intervent financ nation commun sourc futur evalu benefit attitud qualiti conclus depend qualiti inform possess suppli project manag expertis independ assessor period propos regul aim reduc factor limit scope evalu process concern primarili increas effici deploy structur fund propos made spirit prior apprais properli incorpor plan member state requir submit strict quantif object attain result evalu carri previou period topic themat evalu specif programm account close correl mid term reprogram conclus ongo assess bid ensur greater effect structur fund commiss propos structur fund aid disburs mid term depend perform criteria assess perform close link qualiti program follow prior apprais ongo assess final regard specif methodolog commiss plan autumn publish work carri mean programm order ensur greater harmonis evalu union involv detail descript specif methodolog prior apprais ongo assess post evalu survei literatur assess method condit applic analysi system indic area intervent harmonis concept list suggest indic methodolog organis subject base evalu multilingu glossari main concept evalu outlin innov nation commun project clear commiss endors court comment case import account difficulti limit inher evalu exercis gradual overcom supersed lose sight fact evalu foremost technic aid decis make manag intend place polit decis maker serv shed light consequ choic made decis degre flexibl method order context evalu final commiss point start fund reform respect respons nation administr commiss structur fund manag gener evalu constantli shift member state increasingli requir assum prime respons carri evalu ii specif comment scope audit court includ audit countri germani unit kingdom attitud evalu summari main observ commiss believ evalu figur expenditur margin term cost ongo assess grow field carri decentralis level volum expenditur devot chang expenditur evalu broken countri object type intervent figur publish commiss annual evalu overview commiss continu effort obtain systemat overview amount expenditur set evalu sum award technic assist manag partnership system term regul defer subsidiar principl commiss author dictat precis framework evalu indic method effort develop nation practic improv qualiti evalu commiss set mean programm distribut booklet methodolog question organis european confer evalu techniqu practic distribut document frame refer prior apprais guid evalu major project set technic evalu group member state particip organis seminar object problem coordin post evalu stage plan structur intervent post evalu carri year end program order solv problem commiss promot ongo assess themat assess themat assess carri produc materi prepar program ongo assess prepar program complet evalu overview introduc object supplement updat ongo assess themat evalu start commiss introduc provis propos amend regul distinct made object evalu adequaci qualiti data question data highlight evalu report pinpoint problem distinct improv situat data larg demand evalu commiss satisfi current situat data regard critic evalu monitor system commiss stress problem relev monitor data indic matter primarili follow audit commiss continu effort improv situat act court comment systemat evalu reliabl data work carri connect audit control consolid improv situat appar field year depart concern compli condit award contract prescrib relev direct procedur laid acpc negoti remit sign contract mean clarif made upset timet problem margin commiss blame problem inadequaci evalu report due incompet part consult poor qualiti data term refer basi report countri excel unsatisfactori commiss share court view difficulti experienc evalu organis climat indiffer member state post evalu object carri consult intern reput highli qualifi expert common methodolog part paragraph justifi measur evalu exercis constraint court critic refer evalu carri commiss initi great deal work develop methodolog court critic post evalu object valid part realist view possibl devis precis quantit measur impact commun ad ongo assess form analysi implement intervent effect assess context evalu overview post evalu evalu involv econometr model tend expens necessarili measur impact evalu manag tool aid decis make process commiss found divid object program period correspond adequ area question made implement programm complic commiss propos march reform structur fund provid singl program period object case object order avoid unmanag number evalu programm programm select approach need kei area commiss share court opinion cut number measur programm programm made number specif propos effect fund reform gener issu introduct occas commiss express regret failur member state quantifi object adequ fact nation public expenditur administ object hamper develop manag system base indic matter defect methodolog analyt framework problem programm design sophist nation statist commiss point member state common guidelin monitor ongo assess decemb present technic evalu group consist respons evalu member state framework document purpos content procedur ongo assess initi meet meet group distribut depart copi mean document organis ongo assess context partnership chapter document deal formul specif invit tender select assessor supervis qualiti evalu receiv evalu distribut depart involv mean document assess qualiti evalu report includ detail schedul recal evalu carri partnership arrang period member state monitor committe activ particip themat post evalu initi commiss court comment small amount monei earmark object evalu program period member state carri evalu commiss initi conduct evalu object csf object spd begin period addit themat assess relat period commiss carri post evalu csf spd object period question knowledg cost rais paragraph evalu includ financi overview evalu drawn commiss small number initi sole member state fund technic assist amount involv margin compar work frame refer mean document intend educ tool administr develop technic expertis prioriti commiss rais averag standard evalu level expert specialis statist base inform object commiss share view court indic court acknowledg commiss effort develop indic regul tighten exercis quantifi dispar launch member state question quantifi object prioriti prior apprais progress made intervent distinctli quantifi predecessor task ongo assess improv indic effect commiss stress problem increas reduc number indic difficulti monitor system regularli quantifi agre indic exist programm question lack coher program region local author principl subsidiar set prioriti determin scope program countri progress made pressur demand evalu commiss view simpl methodolog framework intend reach step part fund reform take evalu account commiss agre dual program cycl make coordin evalu program easier reason propos singl program period futur program drew post evalu period prior apprais spd carri commiss initi relat matter author prioriti union post evalu period commiss believ evalu carri context reprogram themat evalu sme amp cover ground commiss discuss member state launch evalu overview half cover period overview futur program commiss draft report describ countri qualiti evalu contribut modif intervent summari cover kei point mid term review inform commiss support court comment relat wide diverg situat hundr programm commiss assess result report mid term review present time court posit prematur commiss point evalu manag interest greater account budgetari author european parliament public object evalu paragraph court make suffici allow complex partnership system posit comment paragraph issu object independ evalu exist precis frame refer appli methodolog check data spot qualiti evalu relat degre profession profession ethic interplai interest member state court fail mention criteria mean brochur assess qualiti evalu report explicitli refer appropri methodolog reliabl data credibl result commiss constantli strive improv standard requir bear mind realiti ground turn attent assess oper evalu system ground evalu contract award commiss commiss appli standard procedur award contract laid acpc expert chosen basi select award criteria publish offici journal applic result exercis featur report acpc degre precis contract born mind commiss pai expert advic interest ensur contract draft enabl expert appoint make skill method object object compris programm expenditur involv number team lead fragment invit tender letter spirit direct procedur award public work contract commiss compli rule case care lose control practic arrang implement evalu end steer committe set accompani evalu meet organis period evalu team report subsequ check depart charg detail specif depend inform requir request request draft evalu unit carri check term contract except descript work carri standardis acpc point earlier gener accept methodolog programm evalu case order lose control approach adopt commiss discuss methodolog relev question rais applic techniqu propos gener methodolog approach form part specif precis detail techniqu left open discuss specif case commiss agreement consult produc evalu improv qualiti report organis meet content lesson learn unit offici concern final report submit month schedul date accept offici consult june payment made juli report criticis court fact clarif consult involv addit budget commiss stress term refer structur princip defin question relev strategi result effect term output effect implement strategi page document commiss explain posit question methodolog paragraph depart consult lead depart decid accept report post evalu object csf introduct commiss endors court comment difficulti experienc evalu connect design gener programm post evalu object csf court comment point qualifi data region dispar date critic statist offic methodolog evalu assessor sampl techniqu gener emploi evalu combin case studi greater detail specif instanc techniqu properli provid lesson court state bottom analys gener conclus drawn term impact programm level impact commun polici impact improv manag transpar top base econometr model court criticis aspect remit evalu commiss confirm evalu question fulli context duti account budgetari author part work report econom social cohes object remit evalu suggest wai improv monitor manag system relev strategi analys perform assess drawn enabl effect intervent analys post evalu object systemat econometr model justifi case level aid low region statist seri unavail assess polici report econom social cohes commiss suggest modif part propos reform structur fund year commiss includ number recommend evalu propos regul ongo assess develop integr principl ongo assess commiss share opinion court part report clarifi number point paragraph commiss believ critic appreci develop strategi impact term object project viabil matter specif prior apprais post evalu paragraph purpos ongo assess adjust intervent improv manag analysi commun ad part evalu overview post evalu evalu impact commun prioriti modif intervent case contribut valuabl inform commun ad paragraph commiss obtain pictur ongo assess synergi oper financ fund countri separ program case german object spd end assessor appoint erdf project produc summari evalu carri fund commiss agre region evalu cite court weak repres evalu carri countri correct state ongo assess analys indic fund plan result request brandenburg chang op high rate absorpt fund alloc case project refer number made measur monitor committe june august approach method techniqu court criticis vagu formul interim object contract commiss gave guidelin case decentralis level bottom method evalu effect effici case larg csf consequ reprogram global impact determin made econometr model techniqu ireland spain greec portug itali commiss drew expert opinion europ unit state america identifi effect wai evalu programm object methodolog difficulti case inadequ monitor system limit compar result european level aim ongo assess measur impact programm deliber choic impact quantifi phase intervent sequenc implement result final impact question evalu impact larg csf discuss paragraph impact structur fund evalu model impact csf programm part report court present result econometr macroeconom model explan scope natur lead confus data present structur manner report econom social cohes background inform impact programm measur project court appear criticis lack evalu level programm measur programm evalu gener bottom necessarili base evalu measur programm similarli current themat evalu launch commiss concern specif categori measur programm board case measur small busi amp environ conclus commiss believ court conclus provid construct critic issu commiss work year continu develop commiss admit court detect weak note progress made step commiss aegi structur fund reinforc sem exercis help develop cultur evalu exist region carri evalu commit process subsidiar principl difficulti heterogen geograph locat subject area factor account mean method evalu activ structur natur multi annual programm analys propos methodolog evalu