[User] Please transcribe this text

[Assistant] And at the time, like I think really after Vans started popping, we got on a little promo tour to promote the EP we were pushing or whatever. So once we came out with really that, uh,


[User] Please transcribe this text

[Assistant] Uh, Vans was on Skateboards and Scrapers, EP, and I think it came out as a single as itself too.


[User] Please transcribe this text

[Assistant] It was an EP, it was an album. It was for sale though, right? Yea, it was for sale, yea. It was in all the stores and internet stores and everything.


[User] Please transcribe this text

[Assistant] I mean, it's for sure, it's for sure, uh, at least almost at gold right now. Yeaah. Yeaah, I gotta work for my manager, he was almost at gold right now, so.


[User] Please transcribe this text

[Assistant] But, yeaah, it be like that, like, I don't know, I think like,


[User] Please transcribe this text

[Assistant] You know, we just, even with the Pink Dolphin shit, I just try to set the marker, like, you really gotta have people believing in your lifestyle to do anything successful as an entrepreneur. If people don't believe in your lifestyle, they don't believe in your brand, they don't believe in nothing you push, period.


[User] Please transcribe this text

[Assistant] Like, if you go on Instagram, you see like, some people have


[User] Please transcribe this text

[Assistant] That's the whole point I was going for. I was going like, people don't have to know what it means or what it is. They just gonna go towards it because of the lifestyle behind it. You feel what I'm saying? So we had, I had even Travis McCoy I think might have thrown my t-shirt on at one time. You know what I mean?


[User] Please transcribe this text

[Assistant] Like, honest, to be honest, like, that was never even my vision to use an actual dolphin. That was Cena's vision, uh, my, uh, my old partner, but you know what I mean.


[User] Please transcribe this text

[Assistant] Yeah, man, it was merch. It was like, well the thing was, I had a friend named Elliot.


[User] Please transcribe this text

[Assistant] At the time, who, uh, had a printing shop and he had a company called Ultra Vitalance at the time and he and now he's doing shit for Justin Bieber and shit but at the time he was, he was, he was in the city.


[User] Please transcribe this text

[Assistant] And, uh, San Francisco, and, and he designed one of my main, major logos and ended up


[User] Please transcribe this text

[Assistant] Everywhere for Pink Dolphin, which was the promo logo with the plus sign in Japanese. So me, me and B knew him already because he was giving us ultraviolence gear.


[User] Please transcribe this text

[Assistant] So after he made the logo, I was like, yo B, let's put this together. Let's, let's do this as like, kind of like a rock band. It'll be like a rock band. You know what I mean? But we gon' have clothes and, but at first we was gon' really call it a, it was really gon' be a rock band called Pink Dolphin.


[User] Please transcribe this text

[Assistant] Dedicated our life to, uh, you know, uh, elements that we had, or things that we had going on, you know. We all dedicated our life to certain things. And, uh, you know, B was like, you were just always the one that dedicated everything the most. Like, you got LGND on your neck, like that's your clique. You know what I mean? That's your gang. You got, uh, you got,


[User] Please transcribe this text

[Assistant] Tats, like all over your body, like representing what you stand for, you know what I mean? And you always rap about shit that, you know, is prevalent and relevant in your life and what's going on. So I think just that is really why I beat


[User] Please transcribe this text

[Assistant] Bruh, I'm 29. To be honest, people think I'm younger, but like, I'm 29 now. I've been in the game for a minute, so it's just...


[User] Please transcribe this text

[Assistant] Now I saw, I saw the spectrum. Young L always stood for young legend.


[User] Please transcribe this text

[Assistant] Nah, it's my name's Lloyd, bruh. Oh, okay. Oh, shit. Yeaah, so as young as I was young, Lloyd. Okay. Uh, it was funny cause like I always felt like I always wanted to be like Jay-Z. I always liked her.


[User] Please transcribe this text

[Assistant] Like uh, Jay-Z was like my idol like growing up. Like Stray Blueprint was like my favorite album. Like I listen to it everyday faithfully.


[User] Please transcribe this text

[Assistant] When we really, I think it all changed really when uhm, when we went to, uh,


[User] Please transcribe this text

[Assistant] When me and, uh, one of my partners, we went to, uhm,


[User] Please transcribe this text

[Assistant] We went to Chris Brown's video shoot, my last with Big Sean.


[User] Please transcribe this text

[Assistant] Yeaah, so it all changed from that point on. Like we really realized what product placement can do.


[User] Please transcribe this text

[Assistant] And do for, for like a, a clothing brand. At least at that time, what it could have done.


[User] Please transcribe this text

[Assistant] I felt like he was kinda working some angles, so I was like, you know, I'm just gonna keep these scenes. So I was looking around, I just seen like,


[User] Please transcribe this text

[Assistant] Has Arnold over there with like five Fendi belts, like, I was like, bro, what the fuck is this shit? Like, you know what I mean? Can I take one? You know what I mean? It was just clean, just seeing, you know, people like.


[User] Please transcribe this text

[Assistant] Really pushing the hard line out there, you know, really like trying to get whoever's in the video as fly as they can be. So we was like, look, can we get Chris to wear this crew neck in these little coin pouches? You know what I mean? Bro, mind you, this is shit that we've like never got placed. And this shit that's like not even good, really good quality.


[User] Please transcribe this text

[Assistant] You know what I mean? But we're like, you know, at the time we're like, you know, it was probably going to go.


[User] Please transcribe this text

[Assistant] So, he wore it and was just, Chris really, you know, we get some big salutes to Chris Brown cause he really did that, you feel me? He really did that for us.


[User] Please transcribe this text

[Assistant] Yeah, like a lot of it was product placement, but a lot of it bro was like we have somebody who works with us named Colt Connors. You know what I mean? He's a beast with the sales. It's like you can't, you know, if you don't have nobody do sales, then you're not shit.


[User] Please transcribe this text

[Assistant] Yeaah, I mean it was just like, I think, uh,


[User] Please transcribe this text

[Assistant] You know, uh, we all, it came to a point where we just had different ways we wanted to rap. I think, like, B wanted to rap a certain way, he was wanting to be, have the freedom to do whatever he wanted to do on the track. I think a lot of times, like, maybe Stunna wanted...


[User] Please transcribe this text

[Assistant] You know, it would be like we trying to make some happen, so we kept bumping heads. So it was like at that point, it was anybody's shot to go solo, you feel me?


[User] Please transcribe this text

[Assistant] So, I felt like the fact that B took it, it was good. It was great cause, I mean, nobody else was taking it, so.


[User] Please transcribe this text

[Assistant] It was like for, I was, nobody was really like, we were kinda looking at it from a distance, like we couldn't really say none.


[User] Please transcribe this text

[Assistant] It was kinda like I think when the group started to kinda like go.


[User] Please transcribe this text

[Assistant] That's when it was like, kinda like, then we gotta step back and, and really, you know, figure out. Well, that's the money too. Yeah, yeah, yeah. And we always, we was always splitting shit four ways. We was always splitting shit four ways.


[User] Please transcribe this text

[Assistant] Lightweight it was, but like honestly it came to a point where like I wasn't even taking no rap money. I was like, bruh, I don't even want rap money no more. Y'all can have this, I'm just gonna take the beat money cause that's 50. Oh yea, so yea, you're


[User] Please transcribe this text

[Assistant] Yeah, they always gonna wanna see us on stage, so it's just a matter of- If you don't go on stage for a couple-


[User] Please transcribe this text

[Assistant] Yeah, and definitely the fact that like we get into things other than music, you know what I mean? I think that B is like doing a lot of this, uh, these like speeches and different speeches and going to like, uh, LACMA and doing things down there and everywhere he's been at, it's good for, it's always going to be good for me, good for the rest of the group.


[User] Please transcribe this text

[Assistant] To be honest, like nah, we finished that, it was fine. Anytime we could get in the studio again, it was good, like the time I was younger.


[User] Please transcribe this text

[Assistant] Yeaah, that's our boy, like, I mean- He has had many waves.


[User] Please transcribe this text

[Assistant] Yeaah, I mean I think really, with like us growing up around him, I mean we didn't grow up around him, we didn't grow up around him, but I mean, at least with the putting music out in the same wave as Soulja, I think like, you know, uh,


[User] Please transcribe this text

[Assistant] We, we kinda learned from him. You know, I think B learned a little from him. I mean, I can't say he did or not, but I can speak for myself. Like, I learned a little from Sojourn. At least a little. Least to say. So, uh.


[User] Please transcribe this text

[Assistant] Yeaah, I mean, me doing a mixtape with Soulja was definitely like one of my biggest accomplishments. Like, I feel like I got it on, now that I got my 15 solo mixtapes on iTunes and shit, like, everything's, you know, kinda coming towards like, kinda making sense, making more sense, you feel me, so.


[User] Please transcribe this text

[Assistant] Which one? The Soldier tape? The Soldier, uh, that was Domo and Mario vs. The World. Oh, hell yeaah. Yeaah, so that was like, that was like a minute ago, but I think...


[User] Please transcribe this text

[Assistant] Yeaah, I did like pretty much all the beats, like FK, I did a few.


[User] Please transcribe this text

[Assistant] Yeah, yeah, it was. I went and produced with them like way back, like before they was doing a lot of stuff, like, uh.


[User] Please transcribe this text

[Assistant] I mean, like, I think my solo shit, the biggest solo shit I probably did was probably the one with Fader. Probably the John Nash tape. Probably the Enigma, er, John Nash tape. Yea, when I sampled all Image and Heat.


[User] Please transcribe this text

[Assistant] I think that was big because it got me recognition by her. Like she hit me up on Twitter. She was like, yo, I don't know if this is legal, but uh, this is pretty dope. Damn, really? She ain't trying to hit you with that.


[User] Please transcribe this text

[Assistant] Nah, yo, she was mad cool, like we worked in the future, like she was like, I want you to produce on, uhm, on Sparks or whatever, I think that was her.


[User] Please transcribe this text

[Assistant] Yeaah, oh yeaah. Imogen Heap is like, uh, you know, she's a Grammy nominated. I think she won Grammy for like mixing or engineering one of her projects. She's from, uh, Europe and she's like hella famous on hella levels.


[User] Please transcribe this text

[Assistant] Yeah, so I was peeping and I was like, okay, so I went in depth and started like sampling a lot of her live shit and a lot of her like acapellas and like I got like freeway on one of the joints.


[User] Please transcribe this text

[Assistant] And uh, I just was trying to go crazy with it and you know, Fader, they had just put me on a cover like a couple, like maybe like a year before that or something.


[User] Please transcribe this text

[Assistant] They're mad cool though, like, I went to one of his art shows, or one of his like, one of his shows, it was crazy.


[User] Please transcribe this text

[Assistant] It was like mad shit I would hear from other people and not know if it was really true so I couldn't even really take, take no action on that.


[User] Please transcribe this text

[Assistant] And I don't know if this is gonna be on legal record, but I'm just gonna say it. Fuck it. That's your limitations? Self snitching. Self snitching.


[User] Please transcribe this text

[Assistant] After like seven years, you're good. Nah, like, look, so I legit, like, it was the end of this show, you feel me?


[User] Please transcribe this text

[Assistant] And uhm, we was all like, you know, my hands was kind of sweaty. You know what I mean? It was the end of the show. It was like a gym class show. We was out there with Gary Archer, Legend Gary.


[User] Please transcribe this text

[Assistant] The mic went flying like hella fast though, you feel me? Hit a bitch in the head and cracked her whole shit. Like her whole shit was just whopped.


[User] Please transcribe this text

[Assistant] Man, the city, nah man, I think it might have been like really like Arizona or something. That was a big ass spot. Yeah, it was tucked, but like it was just funny, just not funny bro, it wasn't funny. You getting in trouble? Huh? You getting in trouble?


[User] Please transcribe this text

[Assistant] That's probably what happened, yeaah, I think I just shook. I just shook him. The nigga, the nigga made me.


[User] Please transcribe this text

[Assistant] Who's gonna get whooped and filmed and get stripped, you know what I mean?


[User] Please transcribe this text

[Assistant] I was 18. Me and Sistano had to go to county when I was 18 and Uno and B went to Juvenile. They was 16, 17.


[User] Please transcribe this text

[Assistant] Cause like, when I, I don't know, not that I've noticed, but, I mean, everybody got their preference, you know, they like everybody and talk to their own opinions.


[User] Please transcribe this text

[Assistant] Man, a lot of people do, cause her son's early music was crazy, bruh. His bars are crazy. He's still so fucking good. He's raw. He's raw. He's a beast. Like, he's never stopped going hard. It's just that like, I think people wanna, wanna, you know, they gotta pay close attention now, really.


[User] Please transcribe this text

[Assistant] The only way anybody would, would really be able, I think the only way, the only truth, the real truth about it is the only thing that separates me from before working with the company and how I work now is that, like, we have a different type of business agreement, you know what I mean? It's a different type of business agreement because it came to a point where, uh,


[User] Please transcribe this text

[Assistant] A business deal had to be made, you feel what I'm saying? So like, low key like that got made and


[User] Please transcribe this text

[Assistant] I got what I came for, as far as fashion is concerned.


[User] Please transcribe this text

[Assistant] Anything kinda happens like that after it's been around for a minute almost, like anything, period. I think it just has to change with the times, you know, and I think, uhm,


[User] Please transcribe this text

[Assistant] Kinda like, it does kinda come into a point where like, where like, uh, you know, ownership and business deals come into play.


[User] Please transcribe this text

[Assistant] And I think, uh, it's all about how, uh, it's a lot of, a lot of it is just timing and how, uh,


[User] Please transcribe this text

[Assistant] How you're perceived by the public, you know what I mean? At the time, you know what I mean?


[User] Please transcribe this text

[Assistant] Uhm, I have a good relationship with the creative director, Sina, and that's like my bro, like we go.


[User] Please transcribe this text

[Assistant] Like, get Cavsina back every time you get into some problems, you know.


[User] Please transcribe this text

[Assistant] Yeaah, he the heart of it, he pretty much is the heart of it, the creative part of it, yeaah.


[User] Please transcribe this text

[Assistant] I didn't even know what that was about, but I remember that it's like, I know his girl, so I know, I know who he is now. But like, I didn't really know.


[User] Please transcribe this text

[Assistant] I didn't really, like I know Softest, so I know- Shout out Angel. Yeah, she's cool. So, uh, when it came out of him, like the first thing that I heard-


[User] Please transcribe this text

[Assistant] And like honestly I'm a huge like Gleece fan right now. But like I heard that like somebody was like performing outside of my store going hella crazy and shit. Like I got word of that shit by a fan. So I was like,


[User] Please transcribe this text

[Assistant] I just, uhm, I kinda like asked a couple people about it, like what it was, and they were like, yeaah, they were just out front of our store doing, like, they don't have a store so they use a U-Haul, so they were just doing that thing out front, and I really get it as they were making our store pop harder anyways.


[User] Please transcribe this text

[Assistant] So it was kinda cool, so we weren't really trippin', but I think it was something on like, uh, I looked on his Twitter account, and I ain't really with that Twitter shit, like I wouldn't even go there with really anybody for anything, cause I don't think it's worth it, it's just...


[User] Please transcribe this text

[Assistant] You know, Twitter is like Twitter fingers or you know, whatever you want to call it. But it was kind of like, I hit him up and I was like, what's up? I was like, what's up?


[User] Please transcribe this text

[Assistant] And I just wanna see what he's gonna say. You know, I hit him on Twitter and I'm like, what's up?


[User] Please transcribe this text

[Assistant] He said some shit and I was like, I kinda just brushed it off.


[User] Please transcribe this text

[Assistant] Yeah, he wanted a reaction, so I told him, I think I had, I had, I had actually, yeah, yup, I had DM'd him and I was like, bruh, like, I'm not with this fashion rivalry, like, this is gay.


[User] Please transcribe this text

[Assistant] Yeah, I was like, bro, I don't even know you, I'm not with this fashion robbery.


[User] Please transcribe this text

[Assistant] You gotta look at it like they lost their store to us, damnit.


[User] Please transcribe this text

[Assistant] Like, we were selling out the store for, we were like selling out the block for a minute to the point where like they couldn't pay for their store, whatever, they couldn't do their store, so like.


[User] Please transcribe this text

[Assistant] When I look at it like, you know, he was rapping shit, I'm like, yo, his numbers don't lie, you feel me? So.


[User] Please transcribe this text

[Assistant] Yeah, I mean, it was cool, like, they were always never to my face on some funny shit, like, I would see Tyler on the block all the time, like, he was skating down the block every day, like, I was on the block too.


[User] Please transcribe this text

[Assistant] I had a decent page on it, I was getting most of my money from Pink Dolphins.


[User] Please transcribe this text

[Assistant] And he was always the one we were living up to, like, when we went up to his studio in LA. I don't know if he still is in the same studio, but he had this crazy studio in downtown, bro. It's like the dopest fucking lab ever.


[User] Please transcribe this text

[Assistant] I was like recording at the studio. I just seen him there. I just invited there for like a few minutes.


[User] Please transcribe this text

[Assistant] Like neon, like every wall was like neon and he had lights flashing like disco ball, like crazy shit, like everywhere in the whole lab.


[User] Please transcribe this text

[Assistant] Man, okay, I didn't start, this is funny, like, I didn't really start smoking, I mean, I was smoking loud every now and then, but I wasn't really starting spending major money on weed, so I was like,


[User] Please transcribe this text

[Assistant] Legit havin', you feel me? Enough money to spend on it, so, till I'm like 21. But like, when I, like as far as like,


[User] Please transcribe this text

[Assistant] The drugs, it wasn't really much drugs involved, like we wasn't really...


[User] Please transcribe this text

[Assistant] But me and Uno would be like, we looking for what we say back in the day. We'd be like, look.


[User] Please transcribe this text

[Assistant] Straight up man, so we was young, so we was, you know, a couple of times, you know, it just got ran. Straight up. Oh, you guys were all runnin'?


[User] Please transcribe this text

[Assistant] I feel like he's where his sponsors at right now, bro. We gotta get him some sponsors.


[User] Please transcribe this text

[Assistant] It was huge, and now it's getting to the live cast, and now live casts are getting popping.


[User] Please transcribe this text

[Assistant] Bro, I remember one time I was driving from, uh, from Berkeley to Stockton, bro, I got a speeding ticket. My niggas was roasting me for like three hours about how I got a speeding ticket to see the bitch.


[User] Please transcribe this text

[Assistant] You might be foaming at the mouth afterwards, I heard menacing motherfuckers were, you know, out up north where they got that shit killing people, like legit, like I heard about like at least two people, uh,


[User] Please transcribe this text

[Assistant] Me and Souljuice would sit, we would have dinner. I don't think we had the same plug in LA, but I know when we was in Atlanta, he had juice, and when we was in LA, we lived across the street from each other in LA, downtown, and he had ju-


[User] Please transcribe this text

[Assistant] Oh my god. I was thinking that was Otis Fowler, I didn't know, but now I heard that like if you keep your lean, if you keep your lean in the fridge, it'll take the cold, you know. Really?


[User] Please transcribe this text

[Assistant] Shit, like honestly I was thinking about it, I don't know, it might be, uh,


[User] Please transcribe this text

[Assistant] I think it might be a part two of the enigma theory. It might be a part two of that.


[User] Please transcribe this text

[Assistant] I think, yeaah, I think cause you know, it's really just a time of like, I think it has to be like the right time for everybody in the group. You know what I mean? Cause, like I think even that comes down to just, just like, how our vibes are gonna be together. So, I think it's just based upon like us getting along. Yeah, I mean you guys are- Well like everybody has spaces. Yeah, everybody has space.


[User] Please transcribe this text

[Assistant] Just recently listened to that shit, it's funny you bring that up. He was like, who did the beat? And he told me to put another tag on it, and he was like, put another tag on it right there. That's tight. Who did this beat young L? Who did the beat young L?


[User] Please transcribe this text

[Assistant] Thanks to my moms, thanks to my pops, R.I.P. Granny, free OT. Free OT. I already know. It's Berkeley. Squad shit.


[User] Please transcribe this text

[Assistant] Yeaah. It's like, I thought it was like, it was like a joke when I, cause I seen people taking flight, I was like, damn, that bitch got hit. Yeaah. I'm like, ooh, like something like that shit is wild out there. Oh, that one girl with the dreads got fucking clocked by that one fool.


[User] Please transcribe this text

[Assistant] Risk my safety or anybody else's safety for like some political use.


[User] Please transcribe this text

[Assistant] We took that shit and we flipped it and then like we had other groups coming out with shit saying like they was based, you know, we was defending our title, you feel me? It was just funny like, so at the end of the day like yeaah.


[User] Please transcribe this text

[Assistant] You know, I don't know what there is about you. When I'm away from you, everything you do, everything you think seems to be all wrong. But when we're together...


[User] Please transcribe this text

[Assistant] The only thing I can think of is, I love you.


[User] Please transcribe this text

[Assistant] You know, this quarreling is no good. Let's make a bargain. From now on in, we'll sit down and discuss everything reasonably. No more of this parting forever, huh?


[User] Please transcribe this text

[Assistant] Oh, contacts, contacts, what have I heard that before? Oh yeaah, Charlie Baxter.


[User] Please transcribe this text

[Assistant] Did he get you that modeling job too? What are you going to model?


[User] Please transcribe this text

[Assistant] You're known from one end of Broadway to the other as no-no. The girl who never turned down a date if there was a dinner in it.


[User] Please transcribe this text

[Assistant] Yes, who is Danny James? A broken down director of a little theater group that couldn't act its way out of a paper bag.


[User] Please transcribe this text

[Assistant] Now look sweetie, you're coming to rehearsal, and after rehearsal you're coming to my room, we're gonna have supper. Then we're gonna sit down and discuss everything reasonably, like we decided to do this morning. That is, if your memory goes back as far as this morning.


[User] Please transcribe this text

[Assistant] Then I'll refresh your memory, happy heart, because there's one... Just a minute. What is this? Publicity, a breakfast bowl. What does this yum yum mean? Eleanor's new name. A catchy name for the columnist. Only through publicity can an unknown get a break. Look at Olive McVean. Somebody printed she had the prettiest legs on Broadway. So what?


[User] Please transcribe this text

[Assistant] Some directors ask their actors to forget that their audience is there. I ask you to remember every minute that your audience is there. And another thing you must remember, no matter how much talent you possess, no matter how quickly or glibly you learn your lines, hard work and sincerity are the foundation to every good performance. Whether it be opening night in New York at the best theater there,


[User] Please transcribe this text

[Assistant] Or the ending of a long road tour company in a tent in Paducah, Kentucky.


[User] Please transcribe this text

[Assistant] Just 53 minutes late. You know we have one hour for rehearsal.


[User] Please transcribe this text

[Assistant] Of course, for an actress of your accomplishments, seven minutes should be sufficient. But as for the rest of us, we need rehearsals.


[User] Please transcribe this text

[Assistant] Now look, would you try it one more time, and this time I suggest you underplay it. Sorry, Mr. James, time's up. Look, couldn't we just finish this scene? For another five dollars.


[User] Please transcribe this text

[Assistant] I want to talk to her alone. Look, Baxter, she's not interested in doing a fan dance in the department store window. Or are you?


[User] Please transcribe this text

[Assistant] I'm not trying to be superior, sweetie. It's just that, well, I don't want to see you make a fool of yourself. You understand that, don't you?


[User] Please transcribe this text

[Assistant] Oh, you can't. Alright. Goodbye, career.


[User] Please transcribe this text

[Assistant] Go on and eat beans for the rest of your life. Get old and haggard and look at other people's names and lights and remember, yours could have been there, but no. You chose a director who couldn't direct traffic.


[User] Please transcribe this text

[Assistant] You break that date and bar the prettiest dress no-no has.


[User] Please transcribe this text

[Assistant] What goes on in your head cannot be dignified by the word thinking.


[User] Please transcribe this text

[Assistant] Look, the only reason I came down to pick you up, I was afraid maybe you might get into some kind of trouble. And it looks like you did. I'm only taking you home for old times sake. You know me, I'd take a drowned rat home if I found one.


[User] Please transcribe this text

[Assistant] Look, I've got to see Johnson before rehearsal, so we only have time for dinner. Now where do you want to go and no drug stories?


[User] Please transcribe this text

[Assistant] We know about the bookmaking ring you're setting up. You've stepped on a lot of toes, Bunny.


[User] Please transcribe this text

[Assistant] Get out of town. It's not going to be very healthy for you around here.


[User] Please transcribe this text

[Assistant] I'm interested in something else. There's a rumor around you're going into producing. This is true. Hiya laddy, how's tricks? Hello, Baxter. Charlie Baxter.


[User] Please transcribe this text

[Assistant] Well, everything turned out fine last night, didn't it? Creek, I mean.


[User] Please transcribe this text

[Assistant] In case you don't know it, the time to leave a restaurant is after you eat. Or do they do it different in Ohio?


[User] Please transcribe this text

[Assistant] He's not right. What does it drip like I know about talent? Come on, let's get our dinner out of here.


[User] Please transcribe this text

[Assistant] Yum yum, I want you to meet a friend of mine. Bunny Harris, and this is her roommate, Sandra.


[User] Please transcribe this text

[Assistant] Yeaah, it's what I wanted with changes. Well, I guess that's the way life is, it's full of changes. Plan on something, work for it, dream about it. When it finally comes, it's not exactly what you wanted.


[User] Please transcribe this text

[Assistant] Well, Johnson wants to hire the group. And he thinks you're a good actress, but he has his problems. He feels that he needs a big star to sell tickets.


[User] Please transcribe this text

[Assistant] And when you buy the Brooklyn Bridge, be sure and take the river with you, because somebody may ask you to move it, and that's a very expensive job.


[User] Please transcribe this text

[Assistant] Honestly, sweetie, I haven't heard of people sticking their necks out. But I've never heard of anybody sticking their neck out and pointing at it like you do. Now look, there's only one place ever to read a script. And that's in broad daylight, in an office. Right?


[User] Please transcribe this text

[Assistant] I did say that. I am lonely. All guys like me are lonely. Here's your coat. I got a better idea. Why don't you call your guy, get him up here. We'll all have a good cry together.


[User] Please transcribe this text

[Assistant] This is Miss Lawy. As you all know, Miss Lawy is going to be with our group this summer.


[User] Please transcribe this text

[Assistant] He has a score and plays a piano. Now look, I got lots of work to do. I'm tired of this Charlie Baxter gagging.


[User] Please transcribe this text

[Assistant] Right, I was with him the first time he saw her. Lieutenant Gorham warned him.


[User] Please transcribe this text

[Assistant] Tell you what I'll do. I'll run this at the head of my column tomorrow. And I'll write him an open letter.


[User] Please transcribe this text

[Assistant] I'll appeal to his better nature. To the man who recognizes himself in this sketch, I'll say, you look like an intelligent man my friend.


[User] Please transcribe this text

[Assistant] Plays the piano. Where you going? I'm gonna play a long shot. I've always been a sucker for long shots.


[User] Please transcribe this text

[Assistant] And has decided that you should take your rightful place with the rest of the group. And star in a summer stock company. Do you hear me?


[User] Please transcribe this text

[Assistant] And who's this pretty little girl? Huh? Why? Why, she's missed, uh, What was that name again, my pet?


[User] Please transcribe this text

[Assistant] Danny, I'm sorry. I guess you're right. If you're going home, couldn't we all go together?


[User] Please transcribe this text

[Assistant] Ladies and gentlemen, this broadcast comes to you from the Mayflower Hotel in Washington, D.C. Our distinguished guest of honor, Mr. Dewey Roberts, has not as yet arrived. But the banquet hall is overflowing with people who have come from near and far for this important occasion.


[User] Please transcribe this text

[Assistant] We will commence our program with a musical rendition of Mr. Dewey Roberts' favorite song, Indiana.


[User] Please transcribe this text

[Assistant] That's real mother of pearl. That is a dollar and fifteen.


[User] Please transcribe this text

[Assistant] Yeaah, for sure. Maybe, maybe, yeaah. You know, it's just a little-


[User] Please transcribe this text

[Assistant] My home then, when I at last find a home, is a cottage. A little room with whitewashed walls and a sanded floor, containing four painted chairs and a table, a clock.


[User] Please transcribe this text

[Assistant] Above, a chamber of the same dimensions as the kitchen, with a deal bedstead and chest of drawers.


[User] Please transcribe this text

[Assistant] Small, yet too large to be filled with my scanty wardrobe.


[User] Please transcribe this text

[Assistant] So the kindness of my gentle and generous friends has increased that by a modest stock of such things as are necessary. It is evening. I have dismissed, with the fee of an orange, the little orphan who serves me as a handmaid. I am sitting alone on the ha. This morning the village school opened. I had twenty scholars.


[User] Please transcribe this text

[Assistant] But three of the number can read, none write or cipher, several knit, and a few sew a little. They speak with the broadest accent of the district.


[User] Please transcribe this text

[Assistant] At present, they and I have a difficulty in understanding each other's language. Some of them are unmannered, rough, intractable, as well as ignorant.


[User] Please transcribe this text

[Assistant] But others, a docile, have a wish to learn and evince a disposition that pleases me.


[User] Please transcribe this text

[Assistant] I must not forget that these coarsely clad little peasants...


[User] Please transcribe this text

[Assistant] Are flesh and blood as good as the science of gentlest genealogy?


[User] Please transcribe this text

[Assistant] And that the germs of native excellence, refinement, intelligence, kind feeling,


[User] Please transcribe this text

[Assistant] Are as likely to exist in their hearts as in those of the best born. My duty will be to develop these germs. Surely I shall find some happiness in discharging that office.


[User] Please transcribe this text

[Assistant] Yet it will, doubtless, if I regulate my mind and exert my powers as I ought, yield me enough to live on from day to day.


[User] Please transcribe this text

[Assistant] I was weakly dismayed at the ignorance, the poverty, the coarseness of all I heard and saw around me.


[User] Please transcribe this text

[Assistant] But let me not hate and despise myself too much for these feelings. I know them to be wrong.


[User] Please transcribe this text

[Assistant] That is a great step gained. I shall strive to overcome them. Tomorrow, I trust, I shall get the better of them partially, and in a few weeks perhaps they will be quite subdued. In a few months it is possible.


[User] Please transcribe this text

[Assistant] The happiness of seeing progress and a change for the better in my scholars may substitute gratification for disgust.


[User] Please transcribe this text

[Assistant] To have surrendered to temptation, listened to passion, made no painful effort, no struggle, but to have sunk down in a silken snare, fallen asleep on the flowers covering it, wakened in a southern clime amongst luxuries of a pleasure villa, to have been now living in France, Mr. Rochester's mistress.


[User] Please transcribe this text

[Assistant] Delirious with his love half my time, for he would. Oh yes, he would have loved me well for a while. He did love me. No one will ever love me so again.


[User] Please transcribe this text

[Assistant] I shall never more know the sweet homage given to beauty, youth and grace, for never to anyone else shall I seem to possess these charms. He was fond and proud of me. It is what no man besides will ever be. But where am I wondering, and what am I saying, and above all feeling?


[User] Please transcribe this text

[Assistant] Weather is it better, I ask, to be a slave in a fool's paradise at Marseilles, fevered with delusive bliss one hour, suffocating with the bitterest tears of remorse and shame the next?


[User] Please transcribe this text

[Assistant] What to be a village school mistress, free and honest, in a breezy mountain nook, in the healthy heart of England. Yes.


[User] Please transcribe this text

[Assistant] I feel now that I was right when I adhered to principle and law, and scorned and crushed the insane promptings of a frenzied moment. God directed me to a correct choice. I thank his providence for the guidance.


[User] Please transcribe this text

[Assistant] Juan, why don't you tell them? Two men came here to ask about Hal a week after he disappeared. I think they were FBI men.


[User] Please transcribe this text

[Assistant] Well, the last time I ran into him, he was with several people. One of them I think was a Mr. Copley.


[User] Please transcribe this text

[Assistant] The HuggingFace dataset library, a quick overview. The HuggingFace dataset library,


[User] Please transcribe this text

[Assistant] It's a library that provides an API to quickly download many Publix datasets and pre-process them. In this video, we'll explore how to do that. The downloading part is easy with the load dataset function.


[User] Please transcribe this text

[Assistant] You can directly download and cache the dataset from its identifier on the Dataset Hub.


[User] Please transcribe this text

[Assistant] It's a dataset containing pairs of sentences, where the task is to determine the paraphrases.


[User] Please transcribe this text

[Assistant] The object returned by the load data set function is a data set dict.


[User] Please transcribe this text

[Assistant] Which is a sort of dictionary, containing each split of our dataset. We can access each split by indexing with its name.


[User] Please transcribe this text

[Assistant] This split is then an instance of the Totaset class, with columns.


[User] Please transcribe this text

[Assistant] Here, sentence 1, sentence 2, label and idx, and rows. You can access a given element by its index. The amazing thing about the HuggingFace dataset library is that everything is saved to disk using Apache Arrow, which means that even if your dataset is huge, you won't get out of RAM. Only the elements you request are loaded in memory.


[User] Please transcribe this text

[Assistant] The result is then a dictionary with list of values for each key.


[User] Please transcribe this text

[Assistant] Here, the list of labels, the list of first sentences, and the list of second sentences.


[User] Please transcribe this text

[Assistant] The features attribute of a dataset gives us more information about its columns.


[User] Please transcribe this text

[Assistant] In particular, we can see here it gives us a correspondence between the integers and names of the labels. 0 stands for not equivalent, and 1 for equivalent.


[User] Please transcribe this text

[Assistant] To preprocess all the elements of our dataset, we need to tokenize them.


[User] Please transcribe this text

[Assistant] Have a look at the video, prepossessed sentence pairs for repressure.


[User] Please transcribe this text

[Assistant] But you just have to send the two sentences to the tokenizer with some additional keyword arguments.


[User] Please transcribe this text

[Assistant] Here, we indicate a maximum length of 128, and pad inputs shorter than this length, to get inputs that are longer.


[User] Please transcribe this text

[Assistant] We put all of this in a tokenized function that we can directly apply to all the splits in our dataset with the map method.


[User] Please transcribe this text

[Assistant] To speed up preprocessing and take advantage of the fact that our tokenizer is backed by Rust, thanks to the picking phase tokenizer's library,


[User] Please transcribe this text

[Assistant] We can process several elements at the same time in our tokenized function, using the patch called true argument.


[User] Please transcribe this text

[Assistant] Since the tokenizer can handle lists of first or second sentences, the tokenize function does not need to change for this.


[User] Please transcribe this text

[Assistant] You can also use multiprocessing with the map method. Check out its documentation, linked below. Once this is done, we're almost ready for training.


[User] Please transcribe this text

[Assistant] We just remove the columns we don't need anymore with the removeColumns method.


[User] Please transcribe this text

[Assistant] We name label to labels, since the model from the Transformers library expects that.


[User] Please transcribe this text

[Assistant] And set the output format to a desired backend. Torch, TensorFlow, or NymPy.


[User] Please transcribe this text

[Assistant] If needed, we can also generate a short sample of a dataset using the select method.


[User] Please transcribe this text

[Assistant] It was on CNN hitting me up about young chaps. It's crazy. It was probably on CNN. I just did it. And I know Instagram hit me up. They took my verification.


[User] Please transcribe this text

[Assistant] And you know, when I get on live, they just be talking shit. So they just used to me just talking shit back to them. So they just be wanting me to get on live just to talk shit.


[User] Please transcribe this text

[Assistant] Muffuckers just talking shit to each other. Cause if you don't learn how to do that shit back, nigga, you gonna be getting flamed up all day. Yea, you asked out. Cause I've always been a big black motherfucker, so motherfuckers are always trying to trap me with that shit, and I just go off with that. But you probably was always been a fly, cause you a fly nigga now. Yea, I've always been like that. Yea, Jordans and shit, I've always been like that.


[User] Please transcribe this text

[Assistant] It was alright, you know, motherfuckers, hearing that, knowing who I was, knowing who he was, so you know. It was always, we was hood famous and shit. Okay, so you had a bit of a rep going before he started.


[User] Please transcribe this text

[Assistant] We both did, so everybody knew who we was, like high school I was the nigga, like period. Were you making beats and shit back then too? Yea.


[User] Please transcribe this text

[Assistant] Yeah, that was my original quote until some fuck shit happened, like the bitch ass niggas just started hating on me because I got signed and they didn't. Oh really? Fuck em.


[User] Please transcribe this text

[Assistant] He was first. We got, uhm, me and Keef got introduced by a mutual friend called, by the name of Eda, he a rapper too. Oh yea, yea. At Chicago. Okay. And shit, we just been rocking that resist. Yea. That was about it.


[User] Please transcribe this text

[Assistant] It's just how he was carrying himself out of everybody. He was the youngest one. Like, and he carried himself like he was older than all them niggas. All them niggas looked up to him. Like, they can say what the fuck they want to say. All them niggas looked up to him. Right. As a youngin'. Uh huh. Like, no bullshit. And I seen that shit. I'm like, what the fuck?


[User] Please transcribe this text

[Assistant] It was always weed and shit. It was always weed and shit.


[User] Please transcribe this text

[Assistant] It was just a little off and on shit. Trying it out. Yeah, just trying that shit out. I ain't fuck with it.


[User] Please transcribe this text

[Assistant] Hell no, never. Hell no. I always gotta, you know, clear my own shit. Even though I'm high, I'm still clear with the shit.


[User] Please transcribe this text

[Assistant] Uh, the Bang Project, when we first worked together, his first Bang mixtape, uhm, we was in motherfucking high school at the time.


[User] Please transcribe this text

[Assistant] In the hood, I just, you know, I did one beat on there. I didn't do-


[User] Please transcribe this text

[Assistant] Cause DJ Ken had a studio at the time on 55th and Wabash and shit in Chicago. Okay. So we was right in the middle of that shit like, in the hood, like right there.


[User] Please transcribe this text

[Assistant] So, you know, motherfuckers would go there every day, work on shit, and then one show they got on house arrest and shit, all that shit happened, he just, you know, moved out, just went to his crib, and with my studio, my book bag and shit, suitcase coming over there every day, recording them, then we just made motherfucking Back from the Dead. Yeah, and- Changed motherfuckers' lives.


[User] Please transcribe this text

[Assistant] Anyway, when I, you know, when I first, when I did the Back 4 the Dead, I was already like, you know, been practicing that on that shit.


[User] Please transcribe this text

[Assistant] Hell yeaah. Cause I been making beats since I was 11. So I'm already, at this time, I'm motherfucking 16, 17, going on 18 and shit, just making this shit. I'm already aware of like, keys and shit. Like I already know what the fuck to do.


[User] Please transcribe this text

[Assistant] Hold on, wait, these motherfucking views starting to go crazy, like what the fuck going on?


[User] Please transcribe this text

[Assistant] Oh, let's start paying attention to that type of shit. But other than that, hell nah, ain't.


[User] Please transcribe this text

[Assistant] Yeah, it was always YouTube. Everything was YouTube. Shout out to YouTube.


[User] Please transcribe this text

[Assistant] Not really. I was just, you know, a young nigga. I ain't really give two fucks about it though. I was just, you doing shit that I love. Like I love to make music. So once that shit took off, I was like...


[User] Please transcribe this text

[Assistant] Man we had, man there was so many people coming in, don't let these niggas fool you nigga. GZ flew in, all type of rappers flew in too. Trying to sign niggas. To Chicago?


[User] Please transcribe this text

[Assistant] That's crazy. They seen how niggas was coming though, you know. See all our brothers and shit in them.


[User] Please transcribe this text

[Assistant] Nah, 50 ain't never come to the hood. I just met his ass in Cali. Oh yea. Cool nigga though. He was cool? Yea, I fuck with 50. You roast him?


[User] Please transcribe this text

[Assistant] During that era, he was the dude. That's what's crazy. That's what's crazy. That's what's crazy. That's what's crazy. That's what's crazy. That's what's crazy. That's what's crazy.


[User] Please transcribe this text

[Assistant] Hell yeaah, I had to fight every day. Oh, all the time back then? Yeaah. Cause I'm from a different hood, I went to a school from a different hood, so shit. Had to get on that.


[User] Please transcribe this text

[Assistant] I'm from A-Trail hood, call A-Trail. Okay, okay. Motherfucker in Chicago. It's a small little area. It's a small little area, but motherfuckers know.


[User] Please transcribe this text

[Assistant] It's staying in Inglewood. I'm from Inglewood, but it's like I stayed over there because my grandma crib was in, uh, A-Track. But Inglewood, I just...


[User] Please transcribe this text

[Assistant] When niggas seen him though, it was like 100 though, like niggas from the block like, bro, that's Hey R.R. bro from Dipset, like, y'all niggas really burning this nigga through the hood, like, on some real nigga shit.


[User] Please transcribe this text

[Assistant] It's what we call, you know, what we start saying is thot and shit like that. Doinks and shit.


[User] Please transcribe this text

[Assistant] Yeah, cause they here keep saying this shit a lot, so they think it's cool for a nigga to say it. Which it ain't cool for a nigga to say it, you know, not from-


[User] Please transcribe this text

[Assistant] And not with that. Exactly. You feel me? So. I don't know. That's the one that they did homie, so shit.


[User] Please transcribe this text

[Assistant] We hear about it, but I don't even get into all that shit. I'm too far, like.


[User] Please transcribe this text

[Assistant] I got too much money, like, I ain't really worried about shit, like, I'm not really worried about shit, like, I ain't thinking about niggas.


[User] Please transcribe this text

[Assistant] They was always there. Okay, so from day one? Same projects and shit.


[User] Please transcribe this text

[Assistant] It could have been any one of them. But Keith was, you know, consistent with it. He was the one in the studio. Ferto really ain't no rapper.


[User] Please transcribe this text

[Assistant] He'll tell you that. He always, you know, been on the block. He was older than us. So he already been on the block and shit. So this little shit. And motherfuckin' Reesey, he really ain't no rapper either. He always been on the block too. So, I'm big bro.


[User] Please transcribe this text

[Assistant] Yeah, he motivated though. Once they see him, you know, getting booked for shows and shit, getting feature money and shit, everybody want to get in now.


[User] Please transcribe this text

[Assistant] A lot of niggas was in videos, you know, that was in, you know, in videos that rap now.


[User] Please transcribe this text

[Assistant] I was pullin' up on they ass, we pullin' up, we sleepin' in the crib, we, you know, grandma in there cookin' for us and shit, you know, we just coolin'. Yeah. Just vibin' out. Shit, I'm pullin' up with this motherfuckin' suitcase, we gon' get this work in. Cause I seen it in them, I seen the work ethic, they want to work every day. That was Keith. Keith wanted to work every day.


[User] Please transcribe this text

[Assistant] I was working with everybody, I treated everybody equally. From Dirk, Keith, Reese, Fredo, everybody was equal to me.


[User] Please transcribe this text

[Assistant] You know, cause I was making certain beats for Keith and, you know, certain, and they was getting placed with Big Sean and shit like that. Like Moolah, that pose had been a Keith beat.


[User] Please transcribe this text

[Assistant] He ain't really think of it after that, like, go ahead, get your money.


[User] Please transcribe this text

[Assistant] Cause I was the first one signed.


[User] Please transcribe this text

[Assistant] I was just being around the nigga, you know, he caught on and I caught on to his vibe. Cause I used to be with uhm, no ID and shit like that.


[User] Please transcribe this text

[Assistant] Cause he the originator of that shit. Damn. Talk about it. Shout out Rich Boy. Niggas don't know. Why the niggas don't know? Cause I heard it, I heard the snare, and uhm, I think it was a Mike Will beat when he did the Tupac back. I heard that snare now. I'm like, that bitch hard. I didn't even know Michael made that. Damn, you talking some-


[User] Please transcribe this text

[Assistant] Yeah, that's my boy. So I paid attention to that shit. I was like, that's not hard as hell. Let me use that. Cause I know he's not going to use it no more. Cause I feel like, I know Mike cause he's like, man, I want just one, one time using that shit. I'm like, man, that motherfucker's not hard. He don't even know I know that he don't even know that he, you know. Did you like that?


[User] Please transcribe this text

[Assistant] It was Polo the Dungeon kid, and it was like SN9, that's the name of the song.


[User] Please transcribe this text

[Assistant] I don't know, I found that shit, I made that shit like that. I had put a gun, a gun sound in the scream to go.


[User] Please transcribe this text

[Assistant] I'm like, damn. Cause the gun sound didn't sound like a gun sound to me. Nah, yea, it sounded like a mixture. Yea, it sounded different. So I'm like, let me put a scream on top of this shit. And that shit been my signature. Like when I bring that shit back out, niggas gonna be like.


[User] Please transcribe this text

[Assistant] Throwback. Yeah, I got some shit coming too. You got some new shit coming? Hell yeah. I ain't gonna say woohoo, but it's just coming.


[User] Please transcribe this text

[Assistant] I'm at that point, niggas know. I know every artist in the game.


[User] Please transcribe this text

[Assistant] Vice wanted to do a show with him and his mom. I had bought a, um, BMW. I just gave it to her, just let her, you know, fuck it, you can have it.


[User] Please transcribe this text

[Assistant] Oh, hell yeaah. My mama, bro, I'm telling you, if y'all would've met her, she was a real one, bro.


[User] Please transcribe this text

[Assistant] After that shit came out? Yeah, I was still living in it, uhm, before she died.


[User] Please transcribe this text

[Assistant] Man, she was in the bathroom, she just started screaming and shit. And then she just, in the kitchen, she fell to the floor. Talking about, I'm dead and shit. I'm like, what?


[User] Please transcribe this text

[Assistant] She start praying with me and shit. Grab my hand and start praying. Saying the blood of Jesus and shit, you know.


[User] Please transcribe this text

[Assistant] I was just sitting there like in a state of shock. I ain't had no tear or nothing. It was just like, oh I got to man the fuck up cause I got to take care of my little brother.


[User] Please transcribe this text

[Assistant] Yeah, it just happened. It was like that. The day before that she was good, like, just cool and like, what the fuck?


[User] Please transcribe this text

[Assistant] And the next day, all bad. And at that time, I was working on my motherfuckin' King Chop album. That's my rap album. And she was there through the processes and shit. And then, shit just went left after that. I'm like, what the fuck?


[User] Please transcribe this text

[Assistant] Had to, you know, do all that shit, front of the room, all that crazy ass shit.


[User] Please transcribe this text

[Assistant] Yeah, my family here now. Cause they thought my cousins and shit was always...


[User] Please transcribe this text

[Assistant] Because they was the smart ones and shit going to college and shit like that, they thought, you know, cause we from the hood, our side of the family was from the ghetto and shit.


[User] Please transcribe this text

[Assistant] My mom was happy as hell, cause when I told her, uh, wanna want to fly me out, to sign me and shit.


[User] Please transcribe this text

[Assistant] She broke down and started crying in the driveway. Proud of you. Yeaah, proud of me and shit. My grandma, she was super, super, super proud of me. Yeaah. Cause they ain't, you know, motherfuckers like, when the money gonna come? Right. I'm like, it's coming. I'm grinding, it's coming. That shit came, motherfuckers.


[User] Please transcribe this text

[Assistant] Yeah, she seen the vision though, she wasn't never too picky with the shit like, where the money, how much, she should play with it.


[User] Please transcribe this text

[Assistant] Yeah, cause when I first got my check, I gave my momma like 30,000. Really? Yeah, cash.


[User] Please transcribe this text

[Assistant] For your success? Yes, yes, yes bro. Cause I was, uhm, at, during this time I was finna go open up a restaurant with my mom and dad thing.


[User] Please transcribe this text

[Assistant] If y'all got some ground beef, we'll probably make some spaghetti. If you got some chicken, we gonna make some chicken.


[User] Please transcribe this text

[Assistant] Cause look, I'm big on season, like my shit gotta be axis, seasoning, salt, uh, onion powder, garlic powder. I gotta have that. Go heavy.


[User] Please transcribe this text

[Assistant] How you think I'm eating good? Yea, like he ordering out and this nigga got a house full of food. I'm like, bro, let's take this shit out and cook this shit. I whip that shit up, motherfucker, start eating that shit.


[User] Please transcribe this text

[Assistant] Hell naw man, these niggas eat like, the rest of it food all the time and shit, hell naw.


[User] Please transcribe this text

[Assistant] Yeah, I was out here trying sushi and shit, like that was different. I had bruh and shit back to the crib. They, I started showing my momma how to eat and shit, you know. They didn't know about sushi? No, hell no. Okay. None of my family knew about sushi, so I, let's go to this motherfucking sushi restaurant and let's go eat some shit.


[User] Please transcribe this text

[Assistant] Like, I, we never, I never went to The Bean, like, that's what I was saying. Yeah, he made one vice thing, he's never been to The Bean. I never was downtown like that, so they had us, we was boxed in the motherfuckin'.


[User] Please transcribe this text

[Assistant] And niggas thought I was really playing, like nah nigga, I ain't never seen that shit. And I seen that shit, it was like, okay.


[User] Please transcribe this text

[Assistant] You know, pick when you come to the city. You gotta go to the 183rd though.


[User] Please transcribe this text

[Assistant] That's fried chicken. You gotta go to the one on 83rd though, where I'm from. Okay. Am I gonna get shot though? Nah, you good. Alright. Tell them I sent you though. There we go. There we go.


[User] Please transcribe this text

[Assistant] You got that much respect in Chicago, you can go anywhere. Bro, I'm respected, bro.


[User] Please transcribe this text

[Assistant] Man, Gustavo, man, uhm, he's really my homie first, first of all, before we even did business. Like, I fuck with him, you know, we start, you know, talking on personal shit and shit like that. And then next thing you know, we just start working. Cause I met him in the Universal building. I told him about everything.


[User] Please transcribe this text

[Assistant] Yeah, we just built our relationship off that. And I've been rocking with him since, shit, that was five years ago. The fuck? That was the beginning, my boy.


[User] Please transcribe this text

[Assistant] Like man, we ain't got time for all that shit. We done been through that shit. Motherfuckers getting arrested, shooting up the club and shit like that. That's why I ain't too big on that shit right now.


[User] Please transcribe this text

[Assistant] But I was too muthafuckin', I was always ahead of niggas, like I always thought bigger. Like, I always thought bigger and better.


[User] Please transcribe this text

[Assistant] Because I ain't had a song on the radio since motherfuckin' what, 2015? And still don't give a fuck if I had a song on the radio since 2015. But I'ma stay relevant on this net. Like motherfuckers gon' see me. Like I'm not finna-


[User] Please transcribe this text

[Assistant] You know, let my fan base go down a drain for no nigga like, these people love me.


[User] Please transcribe this text

[Assistant] Yeah, my motherfuckers want me to promote their clothes and shit like that. I fuck with it though. I fuck with it. Man, real shit. My role marketing genius.


[User] Please transcribe this text

[Assistant] And some of these producers that be, you know, noticeable, them niggas don't have no character to theyself.


[User] Please transcribe this text

[Assistant] That niggas just be dull. Just be dull, like, they don't got no perk, people skills and shit like that.


[User] Please transcribe this text

[Assistant] Yeaah, cause when most people see me and shit, they be thinking motherfuckers gonna be all mean and shit. Yeaah, yeaah. Because I'll, you know, I'll be having a little mug on my face, but it don't be attentionally, it's just how I look, my nigga.


[User] Please transcribe this text

[Assistant] A little bit, just a little bit. You can't let two niggas, you know, niggas get comfortable with you and shit. Like hell nah, that's impossible. I'm not finna let you get comfortable around me. Like nigga, you gotta, you know, earn that. Real shit, pay respect.


[User] Please transcribe this text

[Assistant] I'm in the crowd, bro. Every show I do, I'm in the crowd. I'm in the middle of that bitch. We in there. You can touch me, pull my hair, whatever the fuck you wanna do. I'm right there. You MC.


[User] Please transcribe this text

[Assistant] Yeah, I'm like a real good A&R too. I have a fine niggas. I do all that shit. I was just about to say that. When Kodak was coming up, I was like, bro, that nigga gonna be that nigga. And I told, I told niggas I'm bro, that nigga gonna be that nigga.


[User] Please transcribe this text

[Assistant] Cause when I seen that new flocking video, I was like, yea that lil nigga stop. Cause I like how he was moving and everything. He had his own lil swag to him. I'm like...


[User] Please transcribe this text

[Assistant] It's coming out of Florida? Most niggas ain't coming out of Florida like that. Cause I'd have been down there and heard the music and niggas weren't coming like that. Florida's New Chicago. Yea, right now. I was just down there.


[User] Please transcribe this text

[Assistant] Yeah, like changing up the shits and the beating shit, like, just adding little shit that I-


[User] Please transcribe this text

[Assistant] I personally asked them niggas, just let me hear it before it dropped. Cause if it was like that, I would've been like, alright cool, you just let me hear it first. But shit, I'm in Atlanta, I hear it on the radio, I'm like, what the fuck? How the fuck this shit get on the radio this quick?


[User] Please transcribe this text

[Assistant] It was on the radio in Chicago. It hit the radio at the same time. Cause I was on the phone with my momma and then shit like that. My little brother. It was on the fucking radio at the same time. In Atlanta and Chicago. I'm like...


[User] Please transcribe this text

[Assistant] Yeah, Duncey was coming to get beats for Kanye for his album. And, uh, they stopped me like, nah.


[User] Please transcribe this text

[Assistant] We need, uh, yeaah wanna do the remix that don't like. Alright, alright, cool. Let's do it.


[User] Please transcribe this text

[Assistant] And just, I just did everything right there. We was at the motherfuckin' Nakuna Loft at my manager's office. I just brought my studio shit with me. And I set up right there. And I did this shit right there. Broke it down a hook. Verse open. Verse near, you know.


[User] Please transcribe this text

[Assistant] But you just spaced it out and everything. Yea, I just took out Keev, um, fuckin' verses.


[User] Please transcribe this text

[Assistant] Oh really? When I seen that I was like, aw they on some sneaky ass shit. Yeaah. That made me like, make some bitches.


[User] Please transcribe this text

[Assistant] Yeah, I could tell cause I heard the verse, I'm like, he probably didn't want to do that shit, but he did it anyway.


[User] Please transcribe this text

[Assistant] I just knew the remix was getting done, and I was with no ID, I told no ID, I was like, ay just tell dude let me hear it before, you know, come out.


[User] Please transcribe this text

[Assistant] I think the day, the day we met. Cause at that time they dropped click.


[User] Please transcribe this text

[Assistant] That was a huge bitch. I remember when that dropped. That was like, yea. That was that day. It was like, alright, the good Friday. Yea. And then the next. Oh yea, that was the good Friday.


[User] Please transcribe this text

[Assistant] Yeah, that song, that shit was spreading like motherfuckin' wifi. Like, shit was crazy.


[User] Please transcribe this text

[Assistant] Shit, let's get to work. That's all I was thinking like, yeaah, that's what I wanted. Shit, let's get to work. I just started traveling myself to get in the studio with different niggas. Around that time. Yea, around that time. That's why I was so everywhere. And I built my shit up, so.


[User] Please transcribe this text

[Assistant] And at the time, I was doing the XXL and shit like that. That's when I started getting the magazines and shit.


[User] Please transcribe this text

[Assistant] Like shit start going, you know, crazy. Follows and shit going up. Like this motherfucker crazy.


[User] Please transcribe this text

[Assistant] Damn, motherfuckers see me on the street. Ah, that's that nigga that was, uh, woo woo. I'm alright, cool.


[User] Please transcribe this text

[Assistant] Khaled the big homie though. I fuck with Khaled, but nah, I wanna spy by Khaled.


[User] Please transcribe this text

[Assistant] I fucked with Khaled, I did uhm, what the album was.


[User] Please transcribe this text

[Assistant] Which one? What the fuck this album was? The first one? Nah, uh, Kiss the Rain shit. Oh, you did a song on that? I did the intro.


[User] Please transcribe this text

[Assistant] A lot of niggas don't realize, like, I'm really fucking talented, bro. Like, get in the studio with me, bro.


[User] Please transcribe this text

[Assistant] Man, I can show you a lot of shit. Niggas be like, this motherfucker singing and rapping, all type of shit. Making a beat, all that shit. And putting my niggas in there to make that shit sound bigger.


[User] Please transcribe this text

[Assistant] Like I sign producers and shit like that too. Get in they ass, you know?


[User] Please transcribe this text

[Assistant] You never had the slave away? Nah, hell nah. For what?


[User] Please transcribe this text

[Assistant] Yeaah, yeaah. Like all that shit I was doing with Keith, them shits was like 5-10 minutes, bruh.


[User] Please transcribe this text

[Assistant] Love Sosa, Love Sosa definitely was like a five minute beat. Right. Like that shit was a five minute beat literally.


[User] Please transcribe this text

[Assistant] I think, it was, the tempo was slow as fuck to me though. It's slow. It doesn't sound like a hit, right? But it's still hit though, like when I see him perform it, people still go crazy to that shit. It was 808s. It was that melody, cause when that song came out,


[User] Please transcribe this text

[Assistant] I'm like, what the fuck? It wasn't even Keef rapping. It was mothafuckin' Chell H. That first time you ever heard it in a club? Yea, a female from Chicago.


[User] Please transcribe this text

[Assistant] Her shit was going crazy too. I like her shit hard too. As well as this shit. I like her shit too.


[User] Please transcribe this text

[Assistant] That's crazy. It was a lot of motherfuckers calling me for that beat though. At first I was finna sell that beat to French Montana. Really? Damn. We was all in the studio when we made that shit. And you do have hits with him, don't you? Yea, that's my boy. Yea. Yea.


[User] Please transcribe this text

[Assistant] Child to French, French really, you know, cuffed me and, you know, took me on the road with him and shit like that. Really? That's why me and Puff got a bond too. Really? Yea, Puff my homie. What was going on tour with French like?


[User] Please transcribe this text

[Assistant] Hell nah, I can't, I don't know, I ain't big on two men, bitch. Don't be under me like that, I ain't with all that.


[User] Please transcribe this text

[Assistant] Like I know you from somewhere, I'll be like, well, I'll play with it. I'll be like, well, where you know you from?


[User] Please transcribe this text

[Assistant] Motherfucker, I had an uber driver, motherfucker.


[User] Please transcribe this text

[Assistant] This nigga was staring at me through the whole fucking ride cause once I pulled up, when we pulled up to the crib and shit, he just like, man.


[User] Please transcribe this text

[Assistant] My phone dead bro, can I take a picture with uh, on your phone? I'm like, take a picture on my phone.


[User] Please transcribe this text

[Assistant] And one of them is just for losers? Yeah.


[User] Please transcribe this text

[Assistant] Oh sure enough that muthafucka kept calling my shit bro. Like every day. From different numbers though. Like a straight fuck.


[User] Please transcribe this text

[Assistant] Just cornball that shit. You can't do cornball that shit. There's a lot of male groupies out here too. I hate that shit.


[User] Please transcribe this text

[Assistant] Actually, I got a website called Chop Squad Drums, you know, for the producers that want my official sounds and shit. It's called ChopSquadDrums.com


[User] Please transcribe this text

[Assistant] Yeah, like it's a bunch of shit. You can buy beats off that bitch and everything. I got an option like if you want to custom some shit, you know.


[User] Please transcribe this text

[Assistant] It's a lot of niggas that be asking me to post some, um, funny shit on my page. They, what's your PayPal? I'm like, what the fuck you need my PayPal for?


[User] Please transcribe this text

[Assistant] Cause they be seeing me, uh, put up them little funny shits and they be like, yo, what's your PayPal? I'm, bro, what the fuck do you need my PayPal for, bro? I'll just post this shit if I like it. Like, I post shit that I like. I don't post shit that, you know.


[User] Please transcribe this text

[Assistant] A lot of bitch ass shit bro, like, not letting me in the VIP room and I'm, uh.


[User] Please transcribe this text

[Assistant] I'm getting paid to do this show. I'm getting paid to do this and I got a VIP section in the back.


[User] Please transcribe this text

[Assistant] But at the time, the Migos was getting off the stage, and they dude stopped me talking about some, you ain't important enough to, you know, come back here, some shit like that. Motherfucker's looking, I'm looking at his ass like.


[User] Please transcribe this text

[Assistant] But you know who the fuck I am, bro? Like, stop playing with me. Like bitch, you can be my security. And then I went upstairs and said that shit.


[User] Please transcribe this text

[Assistant] Oh, what the fuck are memes? Bro, there's so many of them, bro. I couldn't even pick which one. The one, uhm, they had a fucking mic. I was in the studio in the booth. And they had the fucking, uh, rope hanging down.


[User] Please transcribe this text

[Assistant] It was funny as hell though, cause I'm like, that shit was just creative as fuck.


[User] Please transcribe this text

[Assistant] I hate the word that niggas be saying. You think you too good for some shit. What the fuck do you mean? I'm too good for what? To respond to you?


[User] Please transcribe this text

[Assistant] Cause I see the good shit, I like it. Okay, cool. But the bad shit is keeping my attention like, you bitch ass nigga steady fucking coming at me like, bitch I ain't gonna say nothing.


[User] Please transcribe this text

[Assistant] Right. They just be doing weird shit. I fuck with it though. It's funny bro. They keep me entertained like shit. They don't even know they entertaining me cause some days I be getting bored as fuck.


[User] Please transcribe this text

[Assistant] I had posted some, some funny ass shit, and you know the boy was kinda like, you know, dirty and shit, but he wasn't dirty.


[User] Please transcribe this text

[Assistant] And somebody was just, you know, bashing me. Talk about you should, uh, help this boy out of steady laughing at him. I was like, bitch.


[User] Please transcribe this text

[Assistant] Go donate to a charity. Go donate. Like you talking to me like you can't go donate ten cents, motherfucker. You see the commercials, the fuck is you coming at me like that for? Yea. Let Young Chop live. Alright.


[User] Please transcribe this text

[Assistant] Can we roast fans in p- in peace please? You feel what I mean? It wasn't even no roast, it was just some funny ass shit, cause dude was flaming, talking about dude, and it was just some funny shit, and she came at me all wrong. I was like- Like you knew the nigga personally or some shit. She's like, all that money, you can go help that boy out. Baby. My money is for my family only. And me.


[User] Please transcribe this text

[Assistant] And if I choose to help somebody out, that's off the scrimp.


[User] Please transcribe this text

[Assistant] Cause I done helped motherfuckers out a lot. Yeah. Banched motherfuckin'.


[User] Please transcribe this text

[Assistant] Christmas toys for a whole fucking church. Niggas don't even know I did that shit. Just driving down the street and just doing that. I'm like, you know what? Hey man, pull over. Let's go to this wolf.


[User] Please transcribe this text

[Assistant] All my homies eating, all features and shit. These niggas ain't no big name or nothing. I forgot a couple hundred thousand, you know, a couple thousand followers or some shit like that. Or a hundred followers or some shit. Still getting like 500, 250 of features or some shit like that.


[User] Please transcribe this text

[Assistant] Yeaah, I see the same potential in everybody that I fuck with, you know?


[User] Please transcribe this text

[Assistant] But I know some of them motherfuckers ain't gonna make it to a point like, you know, as that, but you know, still work with.


[User] Please transcribe this text

[Assistant] I'm a good coach, we gon' coach you through it. If I feel like that shit ass, I'm gon' coach you through it. I'm like nah, we gon' scratch that my brother. I'ma keep it one hundred with you bro.


[User] Please transcribe this text

[Assistant] That's how I do it in the studio. Any nigga got ideas. I don't give a fuck who you is. Thanks. If you got, if you saying some hard shit, alright, let's use it. Put it in now.


[User] Please transcribe this text

[Assistant] And we cut niggas in, I don't shit, you know. I don't be petty with shit. I'll buy you pizza.


[User] Please transcribe this text

[Assistant] I got Johnny May Cash, I got Mike P, I got YB, and I got me.


[User] Please transcribe this text

[Assistant] 7 songs, just 7 songs, but the part 2 to the album is going to be a long list of songs, like 19 songs.


[User] Please transcribe this text

[Assistant] I'ma just do part one first, let it ride for a couple of months and see what the fuck it do. Let it soak up and shit. Yeaah. Cause I'ma put, you know, some money behind the shit. That's how you gotta do it man. Yeaah.


[User] Please transcribe this text

[Assistant] Cause all the products that I dropped recently, I ain't put no money behind it, but still make a couple of dollars.


[User] Please transcribe this text

[Assistant] Yeah, just going through, uhm, my shit. Gang shit, that's me. All my albums went through me.


[User] Please transcribe this text

[Assistant] Oh, that's my boy. Like, nah, that's my real boy. That's my boy right there. Hey, y'all niggas on the collab beat would be crazy. Yeah, he just called me like some months ago and said this shit. But I think he forgot about it. Like, I'ma text him after this. I totally forgot about it too. That's my boy.


[User] Please transcribe this text

[Assistant] Yeah, produced by me and him too. He make beats too. He just text me randomly too. Oh, he's the FaceTime god though, really though. He talk about some, uh, let's meet up, we gon' fight. Oh, what the hell you talking about? Let's fight. Oh, what?


[User] Please transcribe this text

[Assistant] You know she's in love with you. Now wait a minute Tommy. Well isn't she?


[User] Please transcribe this text

[Assistant] Wait a minute, that's not the line, is it? Sounds so, so corny.


[User] Please transcribe this text

[Assistant] Well, even I can make mistakes. Let's see. Husband's on the side. Yeah, that's a line alright, but it's no good. Look. When the husband says, you do, my dear, etc. Just say very quietly, yes, I do.


[User] Please transcribe this text

[Assistant] No, don't do anything. Stand perfectly still, but bring it from way inside. It's simpler that way. It'll be a lot more effective. Alright, let's try that. Take it back a couple of times. Alright, let's see, uh...


[User] Please transcribe this text

[Assistant] Oh no, we're just running over a few scenes from the new piece. Part for me.


[User] Please transcribe this text

[Assistant] Sure, I guess so. Yes, sir. Where is Julie? I'll get her.


[User] Please transcribe this text

[Assistant] You're gonna rest, and I mean rest, right here in bed for two weeks. Don't worry about rehearsals, don't worry about anything, don't even think!


[User] Please transcribe this text

[Assistant] Just lie here like a queen and take it easy and learn your lines.


[User] Please transcribe this text

[Assistant] You know, honey, I think we could help that second-eye curtain. It's too long a wait when you cross to Judson.


[User] Please transcribe this text

[Assistant] Oh, oh, oh, sure, absolutely, I agree.


[User] Please transcribe this text

[Assistant] Oh, oh, sure, sure, one and the same. I traded in the old spear and the armor for, for this model.


[User] Please transcribe this text

[Assistant] Oh, Hitty. I'm sorry. I've got it straight now, Hitty.


[User] Please transcribe this text

[Assistant] It's this way, see. You've got a play to put on. That's a story. One you can act out on the stage. Alright. Then you hire some actors. Actors, you know, to speak the dialogue and act the characters in the play. Well, if they're good and the play's good, you've got a hit. If not, you've got a turkey.


[User] Please transcribe this text

[Assistant] On me, I'm just kind of head traffic cop, back of the footlights.


[User] Please transcribe this text

[Assistant] There's a nice big one, that old freighter. What do you suppose she's carrying? Fried bananas?


[User] Please transcribe this text

[Assistant] Hooray! I reserved the table right over here. Looks good too.


[User] Please transcribe this text

[Assistant] Oh, mystery women, eh? Well, madam, how about pouring my coffee?


[User] Please transcribe this text

[Assistant] Oh. Alright. Guess I'm too weak to lift it after all.


[User] Please transcribe this text

[Assistant] I remember when they had swan boats on this lake. When I was a kid, I was crazy to ride in one. But I never had the price.


[User] Please transcribe this text

[Assistant] Doesn't she ever think about, about what's going on right here?


[User] Please transcribe this text

[Assistant] There's nothing for you to do here. Martha'll take care of her if she needs anything.


[User] Please transcribe this text

[Assistant] Sure I do. I like the kid too. But we don't have to change her whole lives on her account, do we? Nothing to worry about. She's the most self-sufficient child I ever saw in my life. Come on, let's go.


[User] Please transcribe this text

[Assistant] That's good. Hitty, I want to have a little talk with you. I've been thinking things over about you and me, about you. And I've decided the best thing to do is I'm going to send you away to school, boarding school.


[User] Please transcribe this text

[Assistant] There'll be a lot of children your own age to play with. Nice teachers. You'll be crazy about it.


[User] Please transcribe this text

[Assistant] No, no, I don't object. Do everything you can to keep her entertained, will you?


[User] Please transcribe this text

[Assistant] Look, I'm sorry. I realize what you're all trying to do and I, I do appreciate it, but it's just no use.


[User] Please transcribe this text

[Assistant] Gone? Gone where? Where could she go? Didn't Donnelly bring her home?


[User] Please transcribe this text

[Assistant] Get a haul of them, tell them to come over and wait for me. Did you call the orphanage? Call them. I'll be home right away.


[User] Please transcribe this text

[Assistant] I'll have to read that sometime. It won't work. What I need is a good long vacation. Just hitting me.


[User] Please transcribe this text

[Assistant] They're fresh air fun campers. This group was from the Martha Stone orphanage in Brooklyn. Oh, I see.


[User] Please transcribe this text

[Assistant] It has a lot of like a mathematical formula, but uhm, while I spend a lot of time on it, I think it's not really hard to understand now.


[User] Please transcribe this text

[Assistant] Right, because when I first time see this paper, I see a lot of phobia there. I'm a little scared of that, but after I...


[User] Please transcribe this text

[Assistant] Um, see about attention is all you need that paper and compare that paper to this one. And some, many things make sense to be honest. Yeah.


[User] Please transcribe this text

[Assistant] Yeah, but I do think this kind of papers can really make some change of the like attentions or, or transformers because before you


[User] Please transcribe this text

[Assistant] Uh, maybe change some parts of them. You need to know why they have this kind of, like, attention, like, uh, uh, residuals there.


[User] Please transcribe this text

[Assistant] So I don't, I don't think this kind of papers will do help to me.


[User] Please transcribe this text

[Assistant] Okay, hello everyone, I'm Jiabei Chen and today, uhm, I want to introduce the paper to you. It's called Attention Is Not All You Need.


[User] Please transcribe this text

[Assistant] Pure attention loses rank doubly experientially with staff.


[User] Please transcribe this text

[Assistant] And into this lecture, we will have like a pro problem description at first time, and then we will have some background definitions and I will share the main idea of the papers with you.


[User] Please transcribe this text

[Assistant] And then we will go in details like the methods and techniques talked about in these papers. And the papers also gave us three experiments to show the phenomenons, they said.


[User] Please transcribe this text

[Assistant] And also gave us the result of the paper.


[User] Please transcribe this text

[Assistant] And then I'll also have some relative works and potential future works. Okay, let's begin.


[User] Please transcribe this text

[Assistant] Uhm, so the first things I want to talk to you is problem description.


[User] Please transcribe this text

[Assistant] And, uh, through the papers that we've been working on in this course, it is not difficult to see that Transformers has not only been used for the basic tasks,


[User] Please transcribe this text

[Assistant] Of like a natural language processing, but also had a huge impact in the fields of computer vision here, like or speech, uh, speech signal processing or multimodal tasks and so on.


[User] Please transcribe this text

[Assistant] And, uh, attention is that all you need. We have this kind of problem. And, uh,


[User] Please transcribe this text

[Assistant] The paper we talk about today seems to be closely related to the father of the transformer.


[User] Please transcribe this text

[Assistant] Just the professor mentioned earlier, his attention is all you need.


[User] Please transcribe this text

[Assistant] And the reason I chose it at first time that the name of this paper does seem like to want to fight with Transformers. So, however, I believe that after reading it, you will find that this article is actually a profound analysis of what makes Transformers great. So.


[User] Please transcribe this text

[Assistant] Uhm, the whole article is looking at just one question, that is, why is transformers effective?


[User] Please transcribe this text

[Assistant] When we fully understand why attention-based architecture are effective and explore existing models roughly, and we can design more effective models, I think.


[User] Please transcribe this text

[Assistant] So uhm, I will give you some background definitions because as this paper is based on transformers and includes a lot of mathematical proofs, I'm going to start by taking you through some basic concepts and transformers in an accessible way. Okay.


[User] Please transcribe this text

[Assistant] And first of all, we will talk about the mathematical concept, it called Lipschitz continuity.


[User] Please transcribe this text

[Assistant] And it actually describes the upper bound of a slope of the point order function, which means that Leiblich's continuity function is the limit in how fast the point order function can change. And there will exist a real number


[User] Please transcribe this text

[Assistant] The absolute value of the slope of the line connected them, it is no greater than the real number.


[User] Please transcribe this text

[Assistant] And the smallest such bound is called Lipschitz constant of the function. And you can just imagine that it's a smoother condition than continuous.


[User] Please transcribe this text

[Assistant] And the next part, next mathematical concept, recording norm. I think everyone knows norm, but this norm is not for vectors, but here we are using the norm for metrics. And here we have AL1 norm.


[User] Please transcribe this text

[Assistant] This is the sum of absolute values of elements in each column of the matrix, and then take the largest of them.


[User] Please transcribe this text

[Assistant] And the next is the infinite, infinite, no, the sum of the absolute value of each row of the matrix and then take the largest of them. And these two is just like the same because the only difference is here is column and this one is row. And so,


[User] Please transcribe this text

[Assistant] In this paper, we have defined something that combines these two norms.


[User] Please transcribe this text

[Assistant] That seems to combine the maximum features of the row and column, so I don't think it's really hard to understand.


[User] Please transcribe this text

[Assistant] And we also have next concept called inductive bias, inductive bias. And, uh, I will give you a simple example of that.


[User] Please transcribe this text

[Assistant] Like if I have an apple, and if I imagine an apple, maybe I would think about its, uhm, Apple company, like iPhone, like iPad. And if I give the apple to an artist,


[User] Please transcribe this text

[Assistant] Like Picasso, like Picasso, it's Picasso's really famous painting called Guernica. And Picasso is who excellent in use of rich forms, namely space, color and line. After the age of 30, Picasso entered a period of restless exploration.


[User] Please transcribe this text

[Assistant] And his work were as restless as his life.


[User] Please transcribe this text

[Assistant] So without a slightly unity and continuity and stability, you can see the picture here. I think it's really weird because you can see many like an angle here, like a triangle, like a really weird.


[User] Please transcribe this text

[Assistant] And so if an apple is in Picasso's eyes, what will it look like? Maybe it'll look like this one.


[User] Please transcribe this text

[Assistant] And you can see how also have many angles, uh, no continuity and stability. So maybe it's weird, but it's maybe in the Picasso's eyes.


[User] Please transcribe this text

[Assistant] Oh, I also want to give you this drawing. It's a really famous card, Starry Night. Starry Night is from Van Gogh.


[User] Please transcribe this text

[Assistant] Was a colorist painter. He's a colorist painter and his preference for color is almost reach a state of madness. So you can see he used a lot of stuff.


[User] Please transcribe this text

[Assistant] I see this kind of picture is full of textures, full of colors and, but it's really beautiful, right?


[User] Please transcribe this text

[Assistant] And, uh, if the apple is in Van Gogh's, um, opinion, maybe it looks like this, like also have many textures, have many colors.


[User] Please transcribe this text

[Assistant] Or Monk. I think he is also a real famous painter. He takes his life, death, love, terror, and loneliness as senses and expresses his feelings and emotions with strong contrasting lines.


[User] Please transcribe this text

[Assistant] This picture, this drawing is really weird with some shapes here and some color blocks here. So the apple is in his eyes maybe.


[User] Please transcribe this text

[Assistant] Just like this one. It's also in a really weird shape and some color block like here is red and here is yellow. So maybe it's the


[User] Please transcribe this text

[Assistant] So as we can see from these apples, different people maybe have different characteristics, so the same event or object is often interpreted in different ways.


[User] Please transcribe this text

[Assistant] So I do think like an inductive bias is a similar concept, but it's talk about not human beings, but machine learning model. So each model has its own reasoning preference because of its different objective and evaluation method.


[User] Please transcribe this text

[Assistant] And this property has nothing to do with the data set. Like, uhm, for example, in the linear regression, the model assume that output were


[User] Please transcribe this text

[Assistant] Uh, dependent variable is related to independent variable linearly.


[User] Please transcribe this text

[Assistant] So, uh, we have, uh, like a table here. Maybe we have this kind of, um, deep learning components we have like fully connected.


[User] Please transcribe this text

[Assistant] We have convolutional recurrent graph network and they have different entities like units, fully connected. The entities units and to the convolution is great elements just like the filter, yeah.


[User] Please transcribe this text

[Assistant] And recurrence is time steps and to the graph networks it's nodes. And the relation to the fully connection, connected is or to or because it's fully connected.


[User] Please transcribe this text

[Assistant] Yeah, and uh, convolutional is local because uhm,


[User] Please transcribe this text

[Assistant] You can just come and just have, can see the relationship between a small area.


[User] Please transcribe this text

[Assistant] And recurrent is sequential and graph network is ages because like we have our nodes and ages is the relation between the nodes.


[User] Please transcribe this text

[Assistant] And so, um, it also, uh, can be the inductive bias of every component. Like, if we have fully connected, maybe the re- relation to every point is really weak. And, but if it's in convolutional network, maybe it will be local.


[User] Please transcribe this text

[Assistant] And recurrent will be sequentially and graph network will be arbitrary because


[User] Please transcribe this text

[Assistant] If I have a point, I have a node, I'm not sure the other nodes are maybe anywhere, so it's arbitrary, right? So for example, like convolution, its green elements are filtered, which can consider the relationship between the points in a small area.


[User] Please transcribe this text

[Assistant] So it is suitable for doing some analysis about these images, so.


[User] Please transcribe this text

[Assistant] So this kind of characteristic will make it more suitable for some


[User] Please transcribe this text

[Assistant] And the next concept is called the rank collapse. This is a very terrible phenomenon, to be honest, because the output of each layer of the model is one sentence feature matrix. And each row here


[User] Please transcribe this text

[Assistant] Each row of the matrix represents the feature vector of a word.


[User] Please transcribe this text

[Assistant] And the rank collapse should mean that each row of the feature matrix tends to be the same.


[User] Please transcribe this text

[Assistant] It also means the feature vector of each word tends to be the same. It means that every


[User] Please transcribe this text

[Assistant] Every word in the sentence will not have any ways they are almost the same in the computer on the device, right? So it's a really terrible phenomenon.


[User] Please transcribe this text

[Assistant] And, uh, so we, the output of the conversion doubly exponential to rank one, we, we call this kind of rank one matrix, uh, rank collapse. And the next step,


[User] Please transcribe this text

[Assistant] Uhm, so this kind of rank one matrix doesn't make sense to us, so we're trying to avoid this kind of things.


[User] Please transcribe this text

[Assistant] And the next step is the model review, because this whole paper is just to analyze the transformers, so we will go through the transformers. And the transformers contain two big parts of it, like encoder and decoder.


[User] Please transcribe this text

[Assistant] And in encoder, we have multi-head attention and, uh, in the decode and feed forward neural network and residual connections and layer normalization steps.


[User] Please transcribe this text

[Assistant] And decoder, we also have two multi-head attention, uh, also feed forward neural network and, uh,


[User] Please transcribe this text

[Assistant] One more linear mapping decoder layers. So uhm, in the right hand is a transformer's block. And just like we see in the left, we have these kinds of things and we will put X into it and you will have to do something into it.


[User] Please transcribe this text

[Assistant] And the main point is that in, inside the transformer, we have these four parts, like multi-head attention, feed forward and residual connections and normalization.


[User] Please transcribe this text

[Assistant] And because uhm, I'm going to talk a little bit more about the internals of attention because we are going to use some of them later. So we'll go in details a little.


[User] Please transcribe this text

[Assistant] Like, uh, in the self-attention, what we have done is we have a sentence. At first, we will have a sentence and we will take it into part of characters. Like in this example, we have six characters here.


[User] Please transcribe this text

[Assistant] And we'll do the word embedding and precision encoding to mix them into the matrix. So in this matrix, every row represents a word. Yeah.


[User] Please transcribe this text

[Assistant] And, uh, and next we will have three matrix, weight matrix, the first one called query.


[User] Please transcribe this text

[Assistant] Uh, we also called core a wq.


[User] Please transcribe this text

[Assistant] And the second one we have k, we call it wk and wv here.


[User] Please transcribe this text

[Assistant] And what we have done is because this is my multi-head, uh, attention, so we will take into three parts. The head number is three now. We assume that.


[User] Please transcribe this text

[Assistant] And so we will put into Q into Q1, Q2, Q3.


[User] Please transcribe this text

[Assistant] So we will do some calculation, uhm, like with input x will multiple with wq and we will have q.


[User] Please transcribe this text

[Assistant] And also the same calculation with k and v, because the wq was divided into three, so we got is q1, q2, q3, k1, k2, k3 and v1, v2, v3.


[User] Please transcribe this text

[Assistant] So next calculation is with, uhm, multiple Q and K together and, uhm, multi-K.


[User] Please transcribe this text

[Assistant] And so we got this kind of matrix and we'll do some softmax of it. And then, uh, we also melt it.


[User] Please transcribe this text

[Assistant] And because we have q1, q2, q3. So actually we have three parts of this matrix and we will just combine them together to get a


[User] Please transcribe this text

[Assistant] A size uhm, also the same as the input x, the same, they have the same size.


[User] Please transcribe this text

[Assistant] Okay, that's all of the self-attention system, so we will use it later. Okay.


[User] Please transcribe this text

[Assistant] Let's move to another part. And in this paper, we analyzed a SEM. We called it SEMS. It's a pure self-attention network, which means that transformers without skip connections and multilayers perceptron.


[User] Please transcribe this text

[Assistant] And you can see this is the transformer block, but we only want this part. It's multi-head attention. And we call it sense.


[User] Please transcribe this text

[Assistant] Okay, that's, uh, we move to the next part. It's the main idea of the main ideas of the


[User] Please transcribe this text

[Assistant] Uh, who are paper. And, uh, first we follow the author's steps. We explore the internal structure of transformer in depth. We first put attention out separately here and, uh, we call it sense and decide the past decomposition method for analyze.


[User] Please transcribe this text

[Assistant] Talk uniformity, and it's also called rank lapse.


[User] Please transcribe this text

[Assistant] Yeah, just like the same, like ran, uh,


[User] Please transcribe this text

[Assistant] Yeah, we also call it rank collapse. We found this kind of phenomenon. And the third part is uhm,


[User] Please transcribe this text

[Assistant] Because you know that Transforce works really well, but we also said that Rank Collapse is a really horrible, terrible thing.


[User] Please transcribe this text

[Assistant] Uhm, it's really because the transformer has another part like escape connections, MLP normalization. So we will see the influence of other parts of transformers or the ramp collapse.


[User] Please transcribe this text

[Assistant] Uhm, revealed opposing impacts between self-attention and counter-reacting force to the rank collapse.


[User] Please transcribe this text

[Assistant] And so the whole idea is kind of summarized by these three points. This is one is path decomposition. The second one is rank collapse. And the third one is the influence of other parts to the rank collapse.


[User] Please transcribe this text

[Assistant] So we will learn these three parts in details. Next. Okay. And this part is methods and techniques.


[User] Please transcribe this text

[Assistant] So we will first, uh, start with the pass decomposition. And we can see this image here.


[User] Please transcribe this text

[Assistant] It's a structure of the sense. We have like L layers here, um, here, one, two, until L, but every, uh, inside every layers we have, um,


[User] Please transcribe this text

[Assistant] Many hats here, like SA1 means head 1 and SA2 means head 2 until we have SAH means we have each head inside one layer. And we also have the skip connections.


[User] Please transcribe this text

[Assistant] Uhm, of, of course, if in a sense we don't have this line, we don't have this skip connection line. And, but it's in the, uhm, in the transformers, right? And you can see that for under SA1, it's calculated by Q1, K1, V1 as we, uhm, I said earlier.


[User] Please transcribe this text

[Assistant] And like these red lines, these red lines, uhm, express one path of the, uh, one path.


[User] Please transcribe this text

[Assistant] You can see that in layer 1, it goes through the hub 2, and in layer 2, it goes through the escape connections, and until


[User] Please transcribe this text

[Assistant] And, uh, it's, it's from the image, but what about from the, uhm, mathematical view? Like here, uhm, we have this,