[13:17] <cmaloney> Morning
[13:20] <jrwren> mornin
[13:31] <cmaloney> Man, surprise covers abound
[13:31]  * cmaloney is listening to Deconbrio - Guilty
[13:31] <cmaloney> cover of Gravity Kills - Guilty
[13:31] <cmaloney> I like.
[13:31] <jrwren> rather it be a klute cover :p
[13:32] <cmaloney> Not familiar
[13:38] <jrwren> leather strip side project
[13:38] <jrwren> very aggro
[13:44] <cmaloney> Ah
[13:44] <cmaloney> laeeaeaeaaeeeaeeeather strip?
[13:44] <cmaloney> ;)
[17:36] <greg-g> weeee
[17:36] <greg-g> https://twitter.com/Wikimedia/status/563388375898411008
[17:36] <greg-g> "All Wikimedia sites are experiencing issues due to a network problem. We'll be back up shortly!"
[17:39] <cmaloney> greg-g: Woo woo
[18:26] <brousch> greg-g: Fix it!
[18:30] <greg-g> luckily, I don't have to
[18:30] <greg-g> poweroutage to an important switch
[18:54] <cmaloney> Lovely
[18:55] <greg-g> yeah, I feel bad for the DC tech
[18:55] <cmaloney> I'm sure his death will be swift.
[18:55] <cmaloney> Though not honorable
[18:58] <jrwren> single switch?
[18:58] <jrwren> that is a shit spof design.
[18:58] <jrwren> bridging is your friend FFS! :p
[18:58] <cmaloney> jrwren: Likely one switch with bad failover.
[18:59] <greg-g> yeah, I don't know all the details, but it sounds like it was a perfect shitty accidental storm
[19:00] <cmaloney> yeah, there's a lot of instances where if one component fails then things are fine, but if one component disappears (or conversely doesn't disappear enough) then shit doesn't work
[19:01] <cmaloney> "Hi, I know this is weird and all but I just powered up and I have no idea what a route is. Pleased to meet me"
[19:02] <greg-g> the best part is, it looks like our logging system kept us from coming back up in a timely manner, we had to disable logging for a $timespan
[19:02] <cmaloney> "Hi other router. Apparently you're up, so here's all the traffic.  We're still
[19:12] <greg-g> collecting all data, but we've tracked down the cause to multiple cascading
[19:12] <greg-g> issues including loss of power to a critical SPOF network switch and HHVM
[19:12] <greg-g> MediaWiki application servers getting blocked due to multiple unoptimal
[19:12] <greg-g> timeout settings. We'll post a full incident report soon, and work to
[19:12] <greg-g> correct the underlying issues as soon as possible.
[21:44] <brousch> hmmmm
[21:44] <brousch> https://www.irccloud.com/pastebin/oz47PtCo
[21:49] <brousch> Ah, it's docker.io, not docker
[21:57] <greg-g> https://wikitech.wikimedia.org/wiki/Incident_documentation/20150205-SiteOutage
[22:23] <rick_h_> evening
[22:23] <cmaloney> Hello from OCC
[22:24] <rick_h_> party!
[22:25] <cmaloney> W00t
[23:00]  * DrDaemonEye waves at cmaloney
[23:14] <cmaloney> Howdy
[23:17] <DrDaemonEye> how goes?
[23:18] <cmaloney> Writing
[23:18] <DrDaemonEye> fun times
[23:18] <cmaloney> Yeah


[01:42] <dilinger> alright, i might not be going to UBZ now
[01:42] <dilinger> since i no longer have a laptop
[01:43] <mjg59> Urgh.
[01:43] <dilinger> or a monitor
[01:43] <mjg59> How did that happen?
[01:43] <dilinger> my apt was broken into
[01:43] <mjg59> :(
[01:43] <mjg59> Fuck.
[01:43] <dilinger> those were amongst the things they took
[01:43] <mjg59> So far I've always got away with the fact that everything I own of value has been hidden under a pile of worthless shit
[01:43] <dilinger> amusingly, they grabbed the $200 monitor and the falling apart, no-name laptop, but left two $3k+ rackmount servers
[01:44] <dilinger> yea, my roommate lucked out that way
[01:44] <dilinger> he had credit cards, a camera, and other stuff under a pile of his laundry
[01:44] <dilinger> they missed it.  took my camera, though
[01:44] <dilinger> since i had recently cleaned, it was nice and easy to find
[01:44] <mjg59> Heh
[01:45] <mjg59> I have a pile of 15 or so laptops, only one of which I care about
[03:30] <zul> so who ami going to see tomorrow? ;)
[05:13] <jbailey> zul: When do you arrive / where are you staying?
[05:38] <infinity> zul : Now / in your living room.
[05:39] <infinity> s/zul/jbailey/
[06:22] <zul> jbailey: ill get in to the train station at noon.
[06:22] <zul> ill take the subway to the hotel
[06:31] <zul> so i should be there around 12:30
[06:37] <jbailey> zul: Cool.  No idea what the plans are for tomorrow.
[06:37] <zul> i was going to get some shopping in as well tomrrow
[06:37] <infinity> jbailey : Do I have a SIM yet? :)
[06:38] <infinity> jbailey : Your pants ETA is about 8 hours (going shopping with Zofia in the morning)
[06:38] <jbailey> infinity: Nope, the swarm of the coworkers yesterday prevented me from getting much of anything I had planned to do done.  I'm going at lunch today.
[06:39] <infinity> Coworkers.  Bah.
[06:39] <jbailey> infinity: I think they've all figured out the wifi enough that they don't need to be in my livingroom. =)
[06:39] <infinity> Heh.
[06:40] <zul> who is at your plcae jbailey?
[06:40] <jbailey> Just me and doko today.
[06:41] <jbailey> I have so far had lifeless, mvo, fabionne, kiko, bradb, seb128, um...
[06:41] <infinity> pitti
[06:41] <doko> pitti
[06:41] <jbailey> like 4 or 5 more, but I'm having trouble remembering who was here, and who was at dinner. =)
[06:41] <jbailey> Right. =)
[06:49] <zul> bunch of slackers
[06:51] <fabbione> zul: hey dude
[06:53] <jbailey> zul: Dude, we're ubunters.
[06:59] <dilinger> i'm an ex-slacker!
[07:03] <doko> somebody knows, if BenC already arrived?
[07:05] <Mithrandir> dilinger: if you just need something (as in _something_ for ubz, I can probably bring an extra laptop.
[07:07] <BenC> doko: not till Sat night
[07:07] <dilinger> Mithrandir: thanks for the offer.  i've got too much stuff to do this weekend now, though
[07:08] <Mithrandir> dilinger: ok.  It would be around next weekend too.
[07:08] <dilinger> coordinating w/ the landlord to get my doors/locks fixed, moving valuables to my gf's place, etc
[07:20] <zul> BenC: what time saturday?
[07:24] <zul> crap i have to carve pumpkin tonight
[07:25] <BenC> did that last night :)
[07:25] <BenC> going to be late tomorrow night
[07:38] <zul> BenC: heh i like leaving everything to the last minute
[07:42] <zul> jbailey: voyager is expensive compared to via
[08:28] <jbailey> zul: Err.. What?
[08:44] <zul> bus vs train
[09:36] <jbailey> zul: Ah, yeah.  That's why we caught the bus to Ottawa too.
[09:36] <zul> via is about $20 cheaper
[09:36] <jbailey> But it's only 2 hours.  So it's doable. I've moved my threshold up to 2.5 hours.
[09:36] <jbailey> Eh?
[09:36] <jbailey> Wasn't when we went.
[09:44] <zul> jbailey: depends on the time of day i guess..
[09:45] <zul> i think it was $60 one way for the bus
[09:45] <jbailey> Ouch.
[09:45] <jbailey> I think we paid that round trip.
[09:46] <zul> hmm..
[09:46] <zul> i hate the bus anywyahs
[09:46] <jbailey> But $40 one way for the train sounds about right.
[09:47] <zul> hehe...choo choo train
[10:35] <zul> right.see you guys tomorrow
[11:35] <infinity> Ahh, nothing instills confidence like this:
[11:35] <infinity> arch/ppc/kernel/idle.c: In function `default_idle':
[11:35] <infinity> arch/ppc/kernel/idle.c:58: warning: implicit declaration of function `cpu_die'
[11:35] <infinity> Of all the functions to throw a warning, why did it have to be "cpu_die"? :)
[11:40] <fabbione> BenC: probably Merlin is going to drive from Boston to visit on sunday
[11:54] <BenC> fabbione: cool
[11:55] <fabbione> yeah he gave the list of the cool place where to go
[11:55] <fabbione> they are all in less than a mile range from here :)
[11:55] <fabbione> i am heading of
[11:55] <fabbione> off
[11:55] <fabbione> later guys