a lapel is also there no okay okay okay so should i start yep yeah yeah okay so i think it is better to 1st have a presentation of my work and then we can discuss with this crash in temp in temp what we can do for my future to to continue my research because apparently i i will have serious problems okay so i will start with the presentation of my work you can be sitting here itself and do the presentation yeah okay i start like this then yeah that is better okay so it is my g work is generally about using posteriors in speech recognition systems and somehow enhancing the estimation of posteriors getting new posteriors which are havi which are more informative by somehow integrating some extra knowledge like prior knowledge and contextual information related to the problem and then use this posterior estimation method for designing hierarchical speech recognition system so in this hierarchical arg architecture i will be able to integrate the extra knowledge at the proper level of hierarchy and i will be al also able to combine different kind of knowledge or sources sources of knowledge i have well as you know generally posteriors are estimated using neural networks and more specifically m l p s in a speech recognition system so time limited window of a speech signal is represented by some cepstral features which are then processed by an m l p and it gives us some evidence as in the form of pos phone posteriors then we use these phone posteriors as features or as scores for for either just decoding or d n d training and inference training and then decoding but we know that in this in this case we are not able to integrate contextual information line contextual information and we are not able to integrate the prior knowledge we can have about phone use or about words in the posterior estimation so the main motivation is to see if we can integrate this kind of extra knowledge in the posterior estimation so what is proposed to solve this problem is to use a what we formally use in h m m formalism which is called gamma state posterior i as a posterior for training or decoding so it is well as you know it is a state posterior probablility in a h m m which is defined as the probability of being in a specific h m m state at a specific time having the whole observation sequence and the model so whole observation sequence means having complete contextual information and the mod and the model can encode some kind of prior knowledge for us by means of topological constraints well you know it is this gam gamma posterior is written in terms of forward and backward h m m recursions and actually one way to use this gamma posteriors is using these posteriors as some kind of newer scores for decoding so in this case it will be similar to hybrid method the the difference is that we do one more step maybe i can explain it better there so we do one more step here and we here by means of another h m m we introduce some kind of prior knowledge and contextual information we get better evidences than what i we initially had here and then we do the decoding and the and s more informative posteriors instead of this one so we are expecting to the system to perform better and more robust to noisy cases here you see some results and how how what is the effect of introducing reasonable prior knowledge so different rows in this table are showing different level of noise and also clean speech and different columns are showing different kind of posteriors or gamma posteriors so the the 1st column is showing the our baseline system which is getting estimate of posteriors out of m l p and then d using these posteriors for decoding and the other columns are showing the performance of different kind of gamma so gamma which is estimated using information about minimum duration of phonemes about possible transition between phonemes and some kind some more prior knowledge like which wo like which word is composed of which phonemes and g gram grammatical knowledge ab about transition between words and things like this so as you see introducing more reasonable prior knowledge will h help to have better performance in almo in almost all the cases and here i compare the performance of the gamma base system with the standard h m m g m m system which is based on doing decoding using likelihood as the scores and the difference is that our system use is using posteriors for decoding so as you see s it is working better than the standard h m m g m m system and finally the conclusion is he here we saw how we can get some more informative posteriors by introducing extra knowledge like prior and contextual information and then using this p posterior estimation method to design hierarchical speech recognition system which we are which which the goal is to have a better more efficient and more robust system so if you want now we can discuss about the crash and the loss of data so well i lost all the posteriors i was i i used as input for my system so the gamma are somehow estimated or computed on top of posteriors and now i do not have any posterior and probably the scripts generating that posterior so what i can do okay you go to the table you have there like the big table you told and then we can discuss okay okay so which i think i have all the gammas no especially gamma full models i have gamma full model but what about other ones and what about the f posterior because because i i you know yeah posteriors i cannot stop my resea i i may do something else you know in future with this and well i need posteriors to now you need the different method from how from gammas you can generate the posteriors yeah and posteriors even you have those 3 state perform gammas also you have all these no no i do not have them there were all under temp you you we have that because you stored them huh ah okay okay so so now yeah now you can write another paper if you can yeah you can go back up to the feature you know yeah yeah maybe maybe some other m p h d student should be hired to work on you know the generating gamma up to gammas to posterior i was just let us talk about little about this presentation itself the slide number 6 6 okay okay how you feel it is important that you are taking the context of the whole utterance how important it could be is it not a possibility that you are having less context less context what you mean instead of having context from one to capital d which is for the whole utterance which does not make much sense in general yes so what is a possibility that you can cut the context instead of having the context from yeah you mean a smaller context instead of this that is right might be left or right everything there but not the whole context because it is it is a fact that when you are having one utterance so it one utterances link up full sentence or something and there might not be much breaks in it yeah so in that sense it does not make sense that you are going too much in the past and then you are trying to compute something which is not related yes yeah yeah b well even they can have some information which are not so meaningful or which are not related yeah well but then i will have the problem to find the optimum amount of context how much context should i take kind of let us say idea is usually 100 milliseconds or 12nd i 200 200 millisecond so but for numbers i think it may be okay numbers hardly yeah yeah numbers it might be okay because most of the sentences might be 3 seconds or something 12 even less than that yeah just few words like so but if for or something yeah okay like if it is really long sentence of 10 seconds or something you may not really need so much con that m that match of context to computer commas i know it is really computationally very intensive also like if you use okay yeah that is a good idea that is reasonable okay so when we are talking about them then my story they are the worst i think so pretty much all the posteriors are from you only yeah yeah i cannot generate posteriors yeah and and you do not have scripts for so there is i do not have the c files also presently with me sk ah okay you do you have just your no yeah no my said that enough is enough and what could happen if you do not even have your 0 you know yeah and then i then i would have taken 2 years extension yeah it was it was pretty scary but let us see what happens but al for your case you do not need really complicated posterior you just need some p l p s and then yes yeah you can then you know because if most did it on what numbers and one of couple of c t f experiments right n yeah i for c t s petr still i think have he did not lose anything so no but but ma he is he may be linking to matthew i guess because matthew got the wav files no no no no no i probably might but you got the all the wav files so yeah but the wave file is th that is in the temp only right so so the only thing is that i can recover it back from berkeley yeah so that is what i am saying like yeah icsi yeah yeah so if he got features then it is okay otherwise if he has to generate again he can not generate because even petr has lost a lot yeah he is having only the results with him so he does not have the files the real the real s ones ah because no everything we w if th if they say that we cannot recover it then i can quickly get it back from icsi in a couple of days i can put all the system back here yeah okay but but the p everybody has features in temp only most of the time all the c t s features or c t s wav files so yeah yeah so forget about c t s at least now i think because it is again yeah because even to download that much of data it takes at least one or 2 weeks yeah a lot of time no it i can dow obviously downloading is another thing the only thing is that i have to do is that they have data in one particular structure but segmentation so i have to 1st of all you know organize create tar files and then i can get it back here but you say do you need to do some segmentation also on top of that so and then you have to get the l p p l p features and yeah that i can get all those things okay because tho those files are also very big they are not single files all th all those m yeah yeah but the those files can be recovered easily only thing is that now if they had to say that we cannot recover it they are so there should not be any break yeah the we can wait at least one or 2 weeks for this because it is 11 day 1012 days like this week i can wait and see if they cannot recover it then i can just get all the data from icsi and put back the c t s system but still i think we can not really do these things before icas because yeah no we cannot do so maybe we can concentrate work especially on numbers now and then we can go to c t s yeah so in numbers case what do you really need like just po pi posterior estimated using p l p features for number which i think we can we can rate it yeah basically yeah w we need to generate again p l p s but wave files are there yeah p l p numbers 95 database is there fine p l p they are also last yeah p l p s yeah okay everything that everything is lost and if if you really ask me even the structure which was there real every point by point how p l p is well generated that information is also not there but you are generating p l p s from yeah but the parameters which are exact but at least you f hopefully 95% i know but that 5% yeah yeah that you can del and then we we need to train the new rates because m l p training needs to be done and then only the next step will happen okay so it is it is pretty pretty hol holding is stupid whether we can replicate the results whatever results you are showing whether we can replicate them or not presently it is it is not known but at least yeah you have something to verify their wa yes yeah so so p l p s or these are all 13 just only p l p s not deltas and del you nowadays not that one there is another problem for verifying these results because well for these results you know the the configuration should not well i also saved the configuration somewhere in the temp so exactly how many stays for decoding and which kind of language model and things like this i i think i can remember almost all of them but f it is it is a bit stressful yeah but if you got something from hemant or matthew then i have those number of stage yeah but h he does not like we have then you know like it is only for only close d c l k c l they have 11 no no no no he is using different setup i think no he he got from you only he does not use our setup do you use our setup for the number of states y m yes for the gamma estimation ah i think so yeah so then i have those number of stages okay no no those things i am also having because they were done 2 years back yeah ah okay anything which is done in the last 2 years is the one which is so lost ah so you did not have any p for these p l p s no p l p s or p files from p l p nothing so bu what about this noise levels like we have noise wav files in da da com databases the there is also in com com database yeah so we have directly f wave files with particular noise yeah that is right ah ok see no th those things are not disturbed no no but they are they are they are down in the database section nothing related to the database has been disturbed no but but i think de except the switchboard yeah except switchboard but the switchboard also we have it but only thing is that we do not have all the data we need yeah but but the problem is like all this i think it may not be there in database i guess no no it is dead no they are there 0 okay because it was that now you called the noise x database no no it was it was pre written there no no it w 0 ori originally done ah okay it is in the database itself even with s and r s that is right yeah no no it is even in d v d form we have it that the ah okay then it is okay ah yeah so it that is not a problem so y you it is not that you all the no no i did not do it myself yeah with s and r different s and r s no no no means at l yeah that part is less scary yeah so at least we have wave files so now we can generate anything in the p l p s or so at least yeah so the things which are related to your p l p can be done i think it is it is not such a major problem yeah okay yeah so so as the conclusion there is no major problem except regenera yeah which time for i guess no except except time so you tha m l p needs to be trained and p l p features those how much time we want to spend again to get so it is kind of one5 days work kind of to generate the new files but for all these s and r s so that is also again yeah yeah yeah that will aga means it will light up that is it yeah but all all of it is doable in 34 days time well i also had the of generated posteriors or gammas or things like this which i should regenerate i have the scripts but well it takes time it is c p u and regenerating all these things but okay it is okay so there is no major problem except time deadline of 2 weeks for icas okay and if i do not have to generate any new results i am also on the other side then yeah it is but if i need to generate new results then and anyway there is emotional loss so scripts and code everything written that is no the thing is like you can not really write this k i suppose the code is the real problem scripts is okay like yeah no yeah yeah even scripts also the configurations or you do if you forget something some factor or something it is really because it is yeah yeah yeah means losses are emotional as well as whatever it is there and bla bla but it is tragedy so so raid 5 you have told to the they are they are it is it is it looks like if you get 3 disk gone then it is very difficult to get it well like fine if it is one disk it is fine because at least one is having the mirror mirror which disk 3 disk no one disk there is no problem so it will recache on the mirror but if the 3 disk are gone it is very difficult so i do not know how it went like usually while as soon as one disk fails it should be replaced actually and i dunno so it should be replaced by mayb yeah otherwise it it will go on destroying other disks ah ok so i so the one so they i do not know how it happen you know such a thing like usually as soon as one fails it actually notifies the you know the system administrator or makes certain kind of noise yeah yeah to to make sure that you know it has to be replaced so w if it the disk is not replaced then it w it will fail it will ri it then then it there is a internal recovery if it just r replace the disk there okay it is it it can internally it can quickly recover everything into that disk so so it is like you know if you have a if you have it is kind of like essentially if it is like 12000 g b data space then it essentially will have a hun 200 g b only stu visible data f to you but then it can we as soon as they replace one of those hard disk i it can it can from the other one it can recover everything on that it will have measures like inter internally it can do that kind of thing but if the th if the 3 disks fail then it is it is it is yeah a really difficult job i do not know how it can be recovered probably the one way that they extend the har the hard disk to the people who are experts and they do like sector by sector block by block they try to recover but that is it is very expensive but like this th simple yes the simple thing might cost you minimum €10000 15 something like that but even this maybe really huge data also was it insured any idea i do not know whether it was insured i do not think insurance company will give no no insurance can take care of means anything can be insured in this world nowadays i think maybe some companies definitely do insure you can not really have so many backups but it still means one thing which is a mystery to me whe why temp one and temp 2 were residing on the same hard disk physical no it does because it was not temp one temp 2 but they have the same it has 3 g b 3 disks hard disk category and so you can go up to 14 or something like that but it can be on the same yeah yeah so it means which just partition these but so it tries to put if you it tries to quickly put things if this way that so that and but only thing that only one has the backup so that keep taking up the backup there so it puts everything quickly it can decide wherever it wants to put so it is faster to do that way no no no what i am saying means temp one and temp 2 could have been different systems altogether no i think that soft name they were given the i am saying they could have kept differently yeah but then what are the use of raid then but no raid on both they systems was the problem yeah no but that is what the raid can allow you to have keep up to 14 hard disk it can allow hard disk there there were already 5 hard disks right yeah so it they have 5 and you can go up to 14 if you want to keep there and it can still work and it takes the and the way it look like it it is still tolerant you know the way it it usually it does it if you one this crashes before i if it replace quickly then no problems but we we otherwise unsaved data will start the 1st thing is to get lo lost that is the thing yeah not everybody is going to be scared of temps i yeah no temp temp is no well it is a i think they can they can they can do so then then because th th some some of these people that expert there are couple of experts so they learned itself so if they can easily recover it well to do this kind of thing you know but is it really costly the system is yeah it depends on the job you know sometimes the small hardware thing they might do it to then you know €5000 and all but if it is very much detailed work they will just i it the system the the whole thing starts like this that you have to give your credit card number and sign a form and then only they will start touching your hard disk no no no no no no no no i checked over the net it is not the way you d you send the things to them they will see if they can recover yeah then only they will ask you that this is the quotation no no bu no th they will but if there is no no if they cannot recover they they will send it back no no that is what they say like you do it then send it the hard disk then they will say okay we can do it and then if you do it with only with only yeah no no no 1st they will give you a quotation the they will not go we ho without that it is not means it is a wrong information yeah maybe at least they will give some number others like they can yeah yeah because in the beginning what they say that send us the thing we will look at the things yeah yeah if it is recoverable we will tell you what is the quotation and if it is not recoverable we will send it back to you then what did they estimate of that but means f and i if they they cannot recover it then then what they will they will not charge anything from you for the inspection yeah i think that is yeah yeah yeah at least they they will know m beforehand i think but that is right yeah no it it is up to you know means looking at how much failure has happened yeah yeah accordingly they will tell you whether they can recover or not and in fact if they they can go a lot but you know they can go block by block and look into it and try to recover but that matthew will want to go or not is the question but even like how much important data l sometimes it is just m p 3s or something so you do not really need to yeah yeah yeah yeah and it is like 40 tera fo 4 tera no 4 tera that is 40 tera 4 tera it is like so how much is 4 tera 4000 gigabytes yeah 4000 gigabytes yeah okay 4000 g b s not much yeah it yeah that is a that is a big but now we got something like more than fift is it raid one has more compared to raid 5 no raid 5 is better i think it l it levels no raid one is having exactly f 50% capacity is utilized it is copy ah okay 2 copies of the same thing will be existing that is a raid one but raid 5 is then then 20% copy only that is right yeah raid 5 is 20% ah it is not the other way no so raid one is exactly it is means that is lot of wastage of resources but it is more tolerant and there is no kind of or anything nothing exists there yeah it is a so the disk which has crashed that cannot be recovered that disk which has not crashed it can be recovered completely means if both the disk have crashed for the same data you cannot recover anything yeah yeah yeah yeah if one disk has crashed crashed then you can recover everything yeah it will be then the other disk yeah it will be in the other disk so that is raid one and hemant how how do you want to go about it t if you are given a choice you want to take raid one or raid 5 or a simple laptop no i will say how do you like to go about with icas ah well i i think w after this meeting we can t we can try together to regenerate this well p l p s i think th they should be 1st regenerated then posteriors and if by the end of week we could have posteriors yeah then it is not that difficult i can easily regenerate the gammas and do all the experiments again yeah to what are the experiments you need to do maybe it is a what are the new experiments you are having in your mind again mainly th there would be some experiment to check how the system is robust against these tuning factors like language mod language modeling scaling scaling factor language scaling factor and inversion penalty this will be the main new issue and well but do you feel that is paper material yeah the new thing in the paper and well some and also maybe like this noise is he was no in these cases but but the one which you have reported means you want to report something more than that well actually actually this w this was not in the paper this is not in the paper actually d i put it in the presentation but it is not in the paper ah okay this is the paper was just for clean speech but since i had the results before and i cannot copy these things okay because i t i talked with herve and he said okay actually the numbers are not very reasonable because they are just 13 p l p features and we have to have at least something which is known for people i mean they are expecting something around 9087 or something like this so i anyway i had to re to redo all the experiments but now it is a little bit more difficult because before i had posteriors and now we have 2 more steps p l p s and and and posteriors so yeah okay at least now he can know a full system setup from so might be what i can do i can give you the setup and you can you can generate from bottom train m l p test m l p yes thank you very much yeah thank you very much so now mainly like 39 p l p you were always 39 no i was using 39 yes not sure but then why did this features you gave me like they are 13 0 m i wanted i wanted to extend this well actually the paper we wanted to write was for icas was something related to multi stream gamma you truncated them to no no no no these these these ones like the but okay okay will i i will explain so tha my plan was to have 2 streams and i i i well yeah i so i i thought that okay i one stream will be p l p and the other will be delta p l p s ah okay you did it on only one ah ah okay so this was one part of experiment so single stream and then i wanted to combine deltas with this and have another table so that was why deltas ah okay ah ok but actually because you know the numbers and the study is not sh i it is not showing strong results anyway results are not very important but they should be within a range of acceptable numbers so then for now i think it is better to instead of doing p l p and delta p l p i can have single stream of 39 p l p s and then combine them with traps just to have yeah those results only you reported in interspeech no like 39 p l p results yeah 39 and they were then they were but they were less than 10% or so yeah yeah yeah yeah yeah now even the clean speech you are getting so what is this result this is related to your m l m i no no it is interspeech the okay no no this is just these numbers are full p l p 39 okay ah okay but just to make things clear in the presentation to show more steps what is a triphone gammas he use the triphone m l p and get try yeah ah okay your your m l p yeah yeah no n no he gave scale to me then i generated gammas no i i gave yeah even okay even even if you but those gammas will be same as s normalized scale likelihoods right yeah it yeah no no no no no no then the they are through that data from through the they are differently no yeah yeah because i have triphone g m g m m s and h m m s okay th so he gave me scale likelihoods of triphones not scale likelihoods yeah scale like scale likelihoo from t m l p scale likelihood posteriors scale likelihoods from from triphone memory g m m 0 m l p scale likelihoods yeah well yeah so i j i d do i did try it yeah th that is how you do that you are you are having posteriors there right you divided by the okay okay so it is scale likelihoods so then again i will pass through full network then i can generate triphone gammas okay and full network what was the r ch architecture it is like it is no no it is it is just g m m word models ah okay you have all the connections to between all the words like so what are the other things we need to discuss so then 1st thing is like we need to generate p l p s and then all these s and r s p l p s yeah it is amazing that everything was under temp no but i think what i think there is still some data which is recoverable at least they could give us time to i think that the most of those things should be there i can hope it already if they could no it was there on like yesterday morning also like even one day after the crash yeah so i was running some experiments and then it was okay but it is readable only so i can not write anything so yeah no you do not have to write but you could read no yeah so but we do not know like we thought like i thought it is recovering so maybe by tomorrow i will get everything so so if you want a copy again you will have that is all be because of you you came on wrong day from iran yeah you should had come on it would have been okay yeah anyway but yeah still some people are in vacation so they will really they will get a shock of their life yeah sileye will be back and he is not in vacation but he is in italy pedro pedro also might be the one kind of like if they have read their mails he flies to senegal directly yeah so daniel is well in italy yeah but even all over the recent iteration iterate training set in temp yeah everything is lost yeah because like we we s how much we can copy because it is really so many iterations and even we thought of really completing minimal experiment also yeah yeah yeah but it is a major loss no doubt but at least yeah a script are there every scripts like at least scripts are there but so if if they can decode the data on which we want to run the scripts is not there yeah if they can decode at least hemant is p files then hemant can if they can yeah if they can give me my c files then also it is okay yeah but c files yeah even if they give you p files it is really better even you do not really need to ru run all the yeah because i do not need to generate features also yeah yeah it is amazing i n i do not need all my p files just 3 of them yeah yeah you j just only like recent p files at least yeah and what if we have some day a fire in idiap we will lose all the data 0 that is fire will lose all the data you know i mean but they have well i i think w they can and yeah they can d you know store it somewhere nowadays it is not the case no no no they physically also separate the things physically yeah yeah physically it is updated but you know here we can easily have a fire because the everything is made of wood i think and it is small and no i think there is sprinkler or something around here i hope so yeah but still i think i it depends or it is sprinklers in edinburgh they had that big fire and then then what if their sprinklers do not work even even sa several da buildings and all the computers in that building they all burned but they have like 3 backups in the university so all these people they did not really affect much ah huh no it is the university is maybe it is really big so they can afford for yeah yeah in fact they distributed the whole thing around yeah they yeah yeah they want th they will have backup in different and also in in some in underground they may not have it in one place they will not keep it at one place yeah physically at different places yeah so that like file proof or something yeah yeah anyway the good the conclusion is to have a back up and and c d at home yeah maybe yeah no c d s are not enough like no yeah something like that i can recover c d s are not enough that is the problem yeah how much no but because one c d is how much it is not even one g b yeah for example f phonebook i can recover everything on phonebook because i have it on the c d so then c d s are not enough i wrote it once time to copy it to my home and so i have all the data of my c d but i do not know if i had i copied all the numbers that are on that so you are talking about datas or you are talking about data itself the whole feature to everything okay features segmentation every label file everything is there i could recover it back from there actually but but what about home directories or he also kept everything in temp i do not know temp no no he wa he was having locked many things in the proper places yeah but in temp he was not having lot of important things yeah all the experiments which he was running but he he did mostly on numbers no so at least if we can recover we we can read some of his stuff or something no did you locate it it is home or home speech or something look what look for any features or anything are there no i but what we will do with the switches no no he he maybe he might be using same p l p features or something it they are different no no no no no okay that way it might be but the situation is that he he was generating his own p l p features from his own scripts we do not know it his own he was not using using doctor speech ah okay is here he got his own yeah so he was like he was so i would borrowed few of the things from him yeah the f f t routine and reading the signal wave form these things i borrowed from him and i changed and then i put it in my all programs so i i kept the backups but those backups are the them is also on temp i did not i did not know that this this way it can crash because i thought maybe i can do a mistake and wipe out the things and then there is no backup so i cannot blame anybody but i did not know that the whole backup can itself crash yeah yeah so now in in my life i will never believe anything which is temp not whether it is temperature or whether it is temporary hey because just few few days back i took a backup of my laptop fearing the same thing but then i did not realize that i should take a backup of only good thing is that the numbers i think i pretty much can recover all the even the f triphone experiments yeah reverse because i think i have kept those labels all those things in the speech directory a p file of it 0 then it is good you know like we do not really nee so it is easier to it all back all those labels and everything yeah so but your p l p is also like p l p should be there i re should have kept the p l p also somewhere tha then we just need to run your neural net only yeah but p p p l p s are like hardly few minutes li p l p is hardly anything yeah n the the extra work on is like you know converting the segmentations from monophone to triphone this kind of thing then the all the scripts are there in the temp file that kind of thing ah i like no no no no no which which scripts from posteriors to s forced alignment no what you do is like you have the segmentation to train that for monophones right yeah you can you can convert the same thing into triphone segmentation because there is monophone and triphone they are not different yeah yeah except that you are just going to give a different label to them p depending on the context so it is easier to convert that segmentation directly here rather than now ugh you know you say the point that if you lose one so so the thing is that i have to recover means i have to recover through the pho no monophone segment segmentation to triphone segmentation and then the whole thing but but you still need to run all the nets no l yeah it is okay th that numbers it is very fast so it is no problem it is no but it is it is not i think at least it takes 2 hours or 3 hours i think yeah so it is yeah 3 years 2 to 3 years yeah you can not parallel also that is the problem yeah but right now you the thing is that right now you know almost what is the like the which will give you the best is also you can cont instead of running it not in all cases that is the problem which people are facing yeah because everything was written then and there itself means even if the optimisation has been done they did the optimisation there and they they worked on that started working on that he they did not write it with pen or something on a paper or saying that okay this is the best optimisation yeah yeah yeah so for example if he want repeated all these results then he ju he need to use all ma hemant is p l p configuration then that is really yeah because if i change my configuration and your results are somewhere else yeah the results will be then you do not you do not know well anyway let us recover it okay ho let us hope the best so how much time we have spent i think i think we have spent yeah for 3540 minutes it is yeah okay so this is good enough thank you okay yeah okay thank you thank you thank you okay fine okay fine have a good day you too it is all it is all we have to leave fast
i am going to i am going to i am going to i am going to little apple is also that yeah okay okay okay okay so should i start yeah yeah okay so i think it is better to 1st have a presentation of my work and then we can discuss with this crash in temp what we can do for my future in fact to continue my research because apparently apparently i will have serious problems okay so i will start with the presentation of my work you can be sitting here itself and you do the presentation okay that is better okay so it is my work is generally about using posteriors in speech recognition systems and somehow enhancing the estimation of posteriors getting new posteriors which are having which are more informative by somehow integrating some extra knowledge like prior knowledge and contextual information related to the problem and then use this posterior estimation method for designing hierarchical speech recognition systems so in this hierarchical architecture i will be able to integrate extra knowledge at the proper level of hierarchy and i will be all also able to combine different kind of knowledge or sources sources of knowledge i have well as you know generally posteriors are estimated using neural networks and more specifically mlps in a speech recognition system so time limited window of speech signal is represented by some capsule features which are then processed by an mlp and it gives us some evidences in the form of phone posteriors then we use this phone posterior as features or as scores for for either just decoding or the training and inference training and then decoding but we know that in this in this case we are not able to integrate contextual information as long contextual information and we are not able to integrate the prior knowledge we can have about phonemes or about words in the posterior estimation so the main motivation is to see if we can integrate this kind of extra knowledge in the posterior estimation so what is proposed to solve this problem is to use what we formally use in formally which is called gamma state posterior as a posterior for training or decoding so it is well as you know it is a state posterior probability in which is defined as the probability of being in a specific state at a specific time having the whole observation sequence and the model so whole observation sequence means having complete contextual information and the model and the model can encode some kind of prior knowledge for us by means of topological constraints well you know it is this gamma posterior is written in terms of forward and backward recursions and actually one way to use this gamma posteriors is using these posteriors as some kind of newest scores for decoding so in this case it will be similar to hybrid method the difference is that we do one more step maybe i can explain it better there so we do one more step here and we here by means of another we introduce some kind of prior knowledge and contextual information we get better evidences than what we initially had here and then we do the decoding and and more informative posteriors instead of this one so we are expecting the system to perform better and more robust to noisy cases here you see some results and how how what is the effect of introducing reasonable prior knowledge so different rows in this table are showing different level of noise and also clean speech and different columns are showing different kind of posteriors or gamma posteriors so the 1st column is showing the our baseline system which is getting estimate of posteriors out of mlp and then using these posteriors for decoding and the other columns are showing the performance of different kind of gamma so gamma which is estimated using information about minimum duration of phonemes about possible transition between phonemes and some kind some more prior knowledge like which word like which word is composed of which phonemes and grammatical knowledge about transition between words and things like this so as you see introducing more reasonable prior knowledge will help to have better performance in almost all the cases and here i compare the performance of the gamma based system with the standard gmm system which is based on doing decoding using likelihoods at the scores and the difference is that our system use is using posteriors for decoding so as you see it is working better than the standard hmmgm system and finally the conclusion is here we saw how we can get some more informative posteriors by introducing extra knowledge like prior and contextual information and then using this posterior estimation method to design hierarchical speech recognition system which the goal is to have better more efficient and more robust system so if you want now we can discuss about the crash and the loss of data so well i lost all the posteriors i was i i use as input for my system so the gamma are somehow estimated or computed on top of posteriors and now i do not have any posterior and probably the screen generating that posterior so what i can do you go to the table you have there like the big table with all that then we can discuss so which i think i have all the gamas know especially gamma full models i have gamma full model but what about other ones and what about the posterior the posterior because i you know i cannot stop my research i am i may do something else you know in future with this and well i need posteriors to know you need the different method from how from gamas you can do that most serious even you have those 3 state performed gamas also you have all these no no i do not have them they were all under 10 we have that because you are stored them okay so no yeah no you can write another paper if you can you know maybe maybe some other phd students should be higher to work and gamma is to be generating gamma i was just let us talk a little about this presentation itself the slide number 6 how you feel it is important that you are taking the context of the whole utterance how important it could be is it not a possibility that you are having less context less context instead of having context from one to capital d which is for the whole utterance which does not make much sense yes in general so what is a possibility that you can cut the context instead of having the context from you mean a smaller context instead of this might be left to right everything there but not the whole context because it is a fact that when you are having one utterance so one utterance is like a full sentence or something and there might not be much bricks in it so in that sense it does not make sense that you are going too much in the past and then you are trying to compute something which is not related yeah well even they can have some information which are not so meaningful or which are not related yeah well but then i will have the problem to find the optimum amount of context how much context should i take kind of let us say hennix idea is usually 100 milliseconds or 12nd so for numbers i think it may be okay numbers hardly yeah numbers it might be okay because most of the sentences might be 3 seconds or something even less than that yeah just few words like so but for ctes or something like if it is really long sentence of 10 seconds or something you may not really need so much that much of context to computer gamas and it is really computationally very intensive also like if you is okay yeah that is a good idea that is reasonable okay so when we are talking about them then my stories are the worst i think so because yeah all the posteriors are from you only i cannot generate posterias and so there is and you do not have scripts for i do not have the c files also okay you do not you have just your theories yeah no god has stopped my my work he has said that enough is enough and what could happen if you do not even have your theris yeah then i would have taken 2 years extension or you would have yeah it was pretty scary let us see what happens but for your case you do not need really complicated post you you just need some plps and then yeah you can read and read it because it mostly did it on what numbers and one of a couple of on see experiments right yeah i have for cts peter still i think has he did not lose anything number but my he is he may be linking to matthew i guess because matthew got the wave files probably might but you got all the wave files so yeah but the way file is the in the temp only right so you so that is what i am saying that i can recover it back from yeah so if he got features then it took otherwise if he has to generate again he can not generate even path has lost a lot he is having only the results with him so he does not have the files the real the real if they say that we cannot recover it then i can quickly get it back from in couple of days i can put all the system back here but everybody has features in tempo and most of the time all the cts features or cts v files so so forget about cets it is at least no i think it is again to download that much of data it takes at least one or 2 weeks no i can now see downloading is another thing but taken i have to do segmentation they have a data in a particular structure so i have to 1st of all you know organize create our files and then i can get it back here but you said you need to do some segmentation also on top of that and then you have to get their p plp features and yeah that i can get all those things okay because those files are also very big they are not single files yeah but there are no be recovered easily only thing is that now if they have to say that we cannot recover it yeah the we can wait at least one or 2 weeks for this bosc one day 12 days like this week i can wait and see if they cannot recover it then i can just get all the data from xc and put back the but still i think we can not really do these things before i guess no we can so that is like maybe we can concentrate what especially on numbers now and then we can go to cts so in numbers case what you really need like just for fear poster you are the estimated using plp features for number where at least we can yeah we need to generate again plps but we files are there yeah plp numbers 95 database is there plps are also last yeah everything everything is and if if you really ask me even the structure which was there real every point by point how plps were generated that information is also not there but you are generating plps from fecal yeah the parameters which are exact but at least hopefully 95% i know but that 5% yeah that you can not really and then we we need to train the new weights because mlp training needs to be done and then only the next step will happen so it is it is pretty pretty whole whole thing is stupid whether we can replicate the results whatever results you are showing whether we can replicate them or not presently it is not known but at least yeah you have something to verify there yeah so so plps or these are all 13 just only plps not deltas and deltons no there is not delta and there is another problem for verifying this results because well for this result you know the configuration the configuration should not well i also save the configuration somewhere in the temp so exactly how many states for decoding and which kind of language model and things like this i think i can remember almost all of them but it is it is a bit but if you got something from hammond or met then i have those number of states like we have there no like it is only for only close dcl kcl they have no no no he is using different setup i think no he got from you do you use our setup for the number of states for the common estimation yes i think so then i have those number of states no no those things i am also having because they were done 2 years back anything which is done in the last 2 years is the one which is so you did not have any p 5 this plps no plps or p files from plp so what about this noise levels like we have noise wave files in their com databases so we have directly wave files with a particular noise added yeah that is right no those things are not disturbed they are all in the database section nothing related to the database has been disturbed no but i think except the switchboard yeah except switchboard also we have it but one thing is that we do not have all the data we need but the problem is that we do not have all the data is like all these snrs i think it may not be there in database no no they are there because you added already like all the noise it was it was pre written there even with snrs that is right okay then it is okay even a dvd form we have it yeah so that is not a problem so it is not that you are added all the no i did not do it myself with snr different snr so means at yeah that part is less scary so at least we have wave files so now we can generate anything in a plp so at least so the things which are related to your plp can be done i think it is yeah it is not such a major problem yeah so so as the conclusion there is no major problem except yeah yeah so it is how much time you are going to spend again mlp needs to be trained and the plb feature so it is kind of one5 days work kind of to generate the new points but for all these ssrs so that is also yeah that will like it means it will add up that set but all all of it is doable in 34 days time i also had the store thus of generated posterior or gamas or things like this which i should regenerate i have the scripts but it takes time it is cpu and regenerating all these things but okay it is okay so there is no major problem except time deadline of 2 weeks for icasp okay and if i do not have to generate any new results i am also on the other side then but if i need to generate new results then and anyway there is emotional loss so much of scripts and code no the thing is like you can not really write this script especially the code is real problem scripts is okay yeah even scripts also the configurations or if you forget something some even pre emphasis factor or something it is really means losses are emotional as well as whatever it is there man are and blah blah but strategy so so rate 5 you have told to the yeah it is it looks like if you get 3 disks gone then it is very difficult to get it which is like fine if it is one disk it is fine because at least one is having the no one does that is no problem mirror so it will recover from the mirror but if the 3 disks are gone it is very difficult so i do not know how it went like usually as soon as one disk fails it should be replaced actually so it should be replaced by yeah otherwise it will go on destroying other days so the one so they i do not know how it happened you know such a thing like usually as one fails it actually notifies the you know the system administrator or makes certain kind of noise you know maybe to make sure that you know it has to be replaced so why if the disk is not replaced then it will it will then there is an internal recovery if you just replace the disk there it is it can internally it can quickly recover everything into that disk so so it is like you know if you have if you have it is kind of like essentially if it is like 12000 gb there are data space then it essentially will have a 100 gb only visible data to you but then it can as soon as you replace one of those hard disk it can it can from the other one it can recover everything on that it will have mirror internally it can do that kind of thing but if if the 3 days fail then it is it is a really difficult job i do not know how it can be recovered probably they one way that they extend the hold the hard is to the people who are experts and they do like sector by sector or block by blog that i do recover but that is it is very expensive but the 2 ladies yes a simple thing might cost you minimum 10 but even this may be really huge data also was it insured any idea i do not know i do not think insurance company will give you no insurance can take care of means anything can be injured in this world loud is i think maybe some companies differently they will insure otherwise like you can not really have so many backups like servers but this still means one thing which is misduring to me why temp one and temp 2 were residing on the same hard disk no it was because it was not temp one temp 2 but they have the same it has 3 gp 3 disk hard disk category so you can go up to 14 or something like that but it can be on the same so it means it is just partition so that so it tries to put if you it tries to quickly put things if that is very that so but only thing is that only one stripe has the backup keep taking up the backup so it puts everything quickly it can decide wherever it wants to go so it is faster to do that way no no no what i am saying means temp one and temp 2 could have been different systems all together no i think that is a soft name they have given the i am saying they could have kept differently yeah but then what is the use of rate then no raid on both the systems what is the problem no but that is what the rate can allow you to keep up to 14 heart days can i think is that there are already 5 hard disk right yeah so they have 5 and you can go up to 14 if you want to keep there and it can still work and it takes and the way it looked like it is still fault tolerant you know the way it is but to be really it is that if you one disk crashes before if it is replaced quickly then no problems otherwise unsaved that i will start the 1st thing is get lose lost yeah now everybody is going to be scared of temps yeah i know everybody is going to be scared of temps yeah i know temp is no well it is anyway i think they said then they can do because some some of these people are experts there are a couple of experts in switzerland itself so if they can easily recover it probably to do this kind of thing but is it really costly the system is yeah it depends on the job you know sometimes it is a small hardware thing they might do it within you know €5000 and all but if it is very much detailed work they will just the whole thing starts like this that you have to give your credit card number and sign a form and then only they will start touching your hard disk no no no no i checked over the net it is not the way you you send the things to them yeah they will see if they can recover then only they will ask you that this is a quotation no but if there is no no if they cannot recover they will send it back no no that is what they say like you do it then send it the hard disk then they will say okay we can do it and then if you do it no no 1st they will give you a quotation they will not go without that it is not it is a wrong information maybe at least they will give some number other list yeah yeah because in the beginning what they say that send us the thing you look at the things if it is recoverable we will tell you what is the quotation estimate of that and if it is not a corridor we will send it back to you but means and if they cannot recover it then then what they will they will not charge anything from you for the inspection yeah at least they do know beforehand that is right how far they can go yeah it means looking at the how much failure has happened accordingly they will tell you whether they can recover or not and in fact if they they can go a lot but you know they can go block by block and look into it and try to recover but that much you will want to go or not is a question but even like how much important data like sometimes it is just mp 3s or something so you do not really need to and it is like 40 terra for 4 terra no 4 terra i guess like there was so how much is 4 terra 4000 gigabytes yeah 4000 gigabets okay 4000 gb not much yeah that is a big but now we got something like is it right one is more fault in tests compared to rate 5 no rate 5 is better right no rate one is having exactly 50% capacity is utilized it is copy 0 okay 2 copies of the same thing will be existing that is rate one but rate 5 is then 20% copy only that is right rate 5 is 20% it is not the other way no so rate one is exactly it means that is a lot of wastage of resources but it is more fault tolerant and there is no parity kind of or anything nothing exists there so that this which has crashed that cannot be recovered that the disk which has not crashed it can be recovered completely means if both the disk have crashed for the same data you cannot recover anything if one disk has crashed then you can recover everything it will be there in the other disk it will be in the other so that is read one anyway how do you want to go about it if you are given a choice you want to take red one or red 5 or a simple laptop i would say how would you like to go about with i casp well i think after this meeting we can try together to regenerate this well plps i think they should be 1st regenerated then posterior and if by the end of week we could have posterior then it is not that difficult i can easily regenerate the gommas and do all the experiments again so what are the experiments you need to do what are the new experiments you are having in your mind mainly there will be some experiment to check how the system is robust against this tuning factors like language model language modeling standard language scaling factor and world insertion penalty this will be the main new issue and well you feel that this paper material yeah the new thing in the paper and well so maybe like this noise is no easy cases but the one which you have reported means you want to report something more than that this is not in the paper actually this was not in the paper i put it in the presentation but it is not in the paper okay the paper was just for clean speech but since i had the results before and i cannot copy these things because i talked with hegwe and he said okay actually the numbers are not very reasonable because they are just 13 plp features and we have to have at least something which is known for people i mean they are expecting something around 9087 or something like this so anyway i had to redo all the experiments but now it is a little bit more difficult because before i had posterior than now we have 2 more steps plps and then posterior at least now he can know a full system set up from so why be what i can do i can give you the setup yes thank you very much you can generate from bottom train the mlp test the mlp thank you very much so now mainly like yeah 13 and plp you are always using 39 no i was using 39 yes but then why did these features you gave me like their 13 you truncated them to i wanted to extend this well actually the paper we wanted to write was for icas was something related to multi stream gamma but no no this this this one is like i will explain so that my plan was to have 2 streams and i i i did it all only one yeah i so i i thought that okay i one stream will be plp and the other it will be delta plp so this was one part of experiment so single stream and then i wanted to combine deltas with this and have another table so that was what but actually because you know the numbers and studies it is not showing strong results anyway results are not very important but they should be within a range of acceptable numbers so then for now i think it is better to instead of doing plp and delta plp i can have single stream of 39 plps and then combine them with traps yeah those results only you reported in interest speech you know like 39 plp results yeah they were that is where they were less than 10% no even like clean speech you are getting what is this result this is related to mlmi no no it is inter speech that no this is this is okay these numbers are full plp 39 okay but just to make things clear in the presentation to show more steps what is the tripod gommers he is the type of mlp and get a good 0 okay you are your mlp no he gave scale likelihoods to me then i generated gamas okay even but those gamas will be same as normalize the scale likelihoods right no no no they are differently they are passed me through the data from that hm yeah because i have trifone gmms and hm okay so he gave me scale likelihoods of triphons not scale likelihoods yeah scale likelihoods yeah scale likelihood from from trifone member g m no mlp is skill like lutes yeah well you are having posterias there right yeah so i i i i you are divided by the priors yeah okay okay so it is still then again i will pass through full network then i can generate triphoon gamas and full network what was the it is like architecture no no it is just gmm word models you have all the connections to between all the words like  so what are the other what are the other things we need to discuss so then 1st thing is like we need to generate plps and then all these snrs plps yeah it is amazing that everything was under no but i think what i think there is still some data which is recoverable at least they could give us time to i think that most of those things should be there i can copy it already if they could no it was there on like like yesterday morning also like even so i was running some experiments and then it was okay but it is readable only so i can not write anything no you do not have to write but you can read yeah but we do not know we thought like i thought it is recovering so maybe by tomorrow i will get everything so because if you want to copy again you will have this is all because of you you came on wrong day from iran you should have come on chumma it would have been okay yeah anyway but yeah still some people people are in vacation so they will really they will get a shock of their life see they will be back and he is not in a vacation but he is in it through maybe they will not come back in there right their heads he flies to senegal directly so daniel is married italy yeah but even all over the recent iteration iterative training set up is in time because like we so much we can copy because it is really so many iterations and even we thought of really completing many more experiments also yeah yeah but it is a major loss no doubt but at least yeah scripts are there every script like really scripts are there but so if if they can record at least hammond is p files then amitken yeah if they can give me my c files then also it is okay but c files yeah even if they give you p files it is really better even you do not really need to run all the yeah because i do not need to generate features also yeah it is amazing and i do not need all my p files just 3 of them hey just only like reset p files at least and what if we have someday a fire in ediap we will lose all the data that is anywhere fire will lose all the data i mean but they have well i think nowadays that is not the case no no no they physically are also separate yes they can you know the story but you know here we can easily have a fire because the everything is made of wood i think and it is small and yeah sprinkler something around here i hope so but still i think i did it too in edinburgh they had that big fire and then when what is there in sprinklers do not work even even server that building some all the computers in that building they all burnt but they have like 3 backups in the university so if people they did not really affect much because universities maybe it is really big yeah so they can effort for the whole thing around yeah they will not keep it at one place yeah they will have backup at different physically at different places and also in some in underground so that like fire proof or something yeah and you need care for me to have you know yeah maybe yeah anyway the good the conclusion is to have conclusion is to have a backup on the on cd at home no cds are not enough cds are not enough yeah how much because one cd is how much it is not even one g b so then cds are not enough phone book i can take on everything on phone book because i have it on a cd i wrote it once upon time to copy it to my home and so i have all the data of my cd i do not know if i had i copied all the numbers that on that you are talking about data data itself the whole feature to everything feature segmentation every label file everything is there i can recover it back from there but whatever it is some iqbal is home directories already he also kept everything in no no he was having a lot many things in the proper places yeah but in temp he was running a lot of important things yeah all the experiments which he was running but he he did mostly on numbers no so at least if we can recover if we can read some of his stuff or something did you look at his home iqbal or home speech iqbal or something look what look for any features or anything or there what we will do with his features no no no he maybe he might be using same plp features or something no no no no no okay that way might be but the situation is that he was generating his own plp features from his own scripts he was not using doctor speech ah okay he got his own yeah so he was like he was so i borrowed few of the things from him the fft routine and reading the signal waveform these things i borrowed from him and i changed and then i put it in my all programs so i kept the backers but those backers are themselves on them i did not know that this way it can crash because i thought it might be i can do a mistake and wipe out the things and then there is no backup so i cannot blame anybody but i did not know that the whole backup can itself crash so now in my life i will never believe anything which is temper whether it is temperature or whether it is temporary because just a few days back i took a backup of my laptop fearing the same thing but then i did not realize that i should take a back over only good thing is that the numbers i pretty much can recover all the even the trifone experiments because i think i have kept those labels all those things in my speech directory a p file of it then it is good like we do not really need so it is all back all those labels and everything so but your plp is also like plp should be there i should have kept the plp also somewhere there then we just need to run neural net only neural not only yeah but p p plp so like hardly few minutes plp is hardly anything yeah the extra work on is like you know converting the segmentation from monophone to tri phone this kind of thing then they all the scripts are there in the temp for that kind of thing which which scripts like from posterous to no no no no no what you do is like you have the segmentation to train that for monophone right yeah you can you can convert the same thing into a typhone segmentation because there is monofone and triphor there are no different except that you are just going to give a different label to them depending on the context so it is easier to convert that segmentation directly here rather than now you know you see the point that if you lose one so so the thing is that i have to recover means i have to recover through the phone no monophone segment segment or tripe on segmentation the whole thing but you still need to run all the nets you know yeah it is okay that is a number that is very fast no but it is not i think at least it takes 2 hours or yeah 3 hours i think are in and you can not parallelize also that is the problem the thing is that right now you know almost what is the like the bond which will give you the best result so you can control not in all cases that is the problem which people are facing because everything was written then and there itself means even if the optimization has been done they did the optimization there and they they worked on that started working on that they did not write it with pen or something on a paper or saying that okay this is the best optimization so for example if he want to replicate all this results then he need to use all my hammond is plp configuration then that is if i change my configuration then your results will be your results are somewhere else then you do not know where anyway okay let us recover it let us hope the best so how much time we have spent i think we have spent 35 40 minutes ago okay so this is good enough thank you okay thank you fine have a good day good day so we have to leave 1st so we have to leave 1st