[00:43] <wschaub> I've followed the instructions at https://dev.launchpad.net/Running and also https://dev.launchpad.net/Soyuz/HowToUseSoyuzLocally however I have no idea how to make launchpad know about arm so that I can register my armel launchpad-buildd from the web interface. anyone have any ideas?
[00:44] <wschaub> trying to put an arm chroot into the librarian like in the soyuz page just tells me that that arch does not exist and kicks me back to the shell.
[00:46] <wgrant> Does https://launchpad.dev/ubuntu/natty/+addport give you an ARM processor option?
[00:46] <wgrant> wschaub: ^^
[00:49] <wschaub> wgrant: let me try that.
[00:50] <wschaub> yes.
[00:52] <wgrant> wschaub: Add a new armel DistroArchSeries to your desired series using that form.
[00:52] <wgrant> wschaub: And you should see an ARM option on https://launchpad.dev/builders/+new
[00:54] <wschaub> great I will let you know if I have any more problems. I just want to get to the point where I can start throwing things at a bunch of builders (Efika MX smarttops)
[00:55] <wgrant> wschaub: I tried using my smartbook as a builder a few months ago... it sort of wasn't very happy about it, but I didn't try very hard.
[00:55] <wgrant> It was very slow :(
[00:55] <wgrant> Unsurprisingly.
[00:55] <wgrant> But OMAP4 devices are a bit happier.
[00:57] <wschaub> i must have done something wrong https://launchpad.dev/builders/+new doesnt have arm in the dropdown.
[00:58] <wschaub> do I have to restart launchpad or something?
[00:58] <wgrant> wschaub: Are you using the DB with sampledata, or a fresh one bootstrapped using one of my scripts?
[00:59] <wgrant> (HowToUseSoyuzLocally uses sampledata)
[00:59] <wschaub> most likely the sampledata.
[00:59] <wgrant> Ah, I see, the sampledata doesn't actually have an ARM processor, just a processor family.
[01:00] <wgrant> INSERT INTO processor (family, name, title, description) VALUES (5, 'armel', 'ARM', 'ARM');
[01:00] <wgrant> Then it should appear on /builders/+new
[01:02] <wschaub> any other pitfalls I'm likely to run into? (working with the database now)
[01:03] <wgrant> You'll need to use ports.ubuntu.com instead of archive.ubuntu.com in the external dependencies field of your PPA.
[01:03] <wgrant> But that's about it.
[01:08] <wschaub> I've been using pbuilder up to this point and havent done anything with launchpad yet (until now)
[01:10] <wschaub> sweet well its registered and the librarian took my chroot tarball.
[01:10] <wschaub> now I just need to feed it something.
[01:11] <wgrant> wschaub: Great. I wrote most of that page, so can probably clarify anything for you.
[01:11] <wschaub> you meantioned a bootstrap script should I be using that to set up launchpad/soyuz instead?
[01:11] <wgrant> Right, as you've probably noticed the default DB has lots of sample data in it.
[01:12] <wgrant> Which is often not desired.
[01:13] <wgrant> lp:~wgrant/launchpad/bootstrap-db-from-scratch has scripts to bootstrap an empty DB into a state where Ubuntu exists and PPAs are usable.
[01:13] <wgrant> Without all the extra cruft.
[01:13] <wschaub> will that clear out the current database that I got by running make schema?
[01:14] <wgrant> The branch changes make schema to create an empty DB. So you'll need to rerun make schema.
[01:14] <wgrant> It also probably doesn't work any more. Let's see.
[01:28] <wschaub> so what format do I use for the add ppa depdendency field?
[01:29] <wschaub> to get ports.ubuntu.com  added in to a new ppa?
[01:29] <wgrant> wschaub: On +admin, not +edit, you'll see an "External dependencies" textarea warning that it is to only be used by OEM migrations.
[01:29] <wgrant> Add something like 'deb http://ports.ubuntu.com/ubuntu-ports %(series) main restricted universe multiverse'
[01:33] <wgrant> wschaub: lp:~wgrant/launchpad/bootstrap-db-from-scratch works again now. make schema, utilities/bootstrap-lp-db $YOURUSERNAME, utilities/populate-ubuntu-from-scratch.py, then make run and you can log in as $YOURUSERNAME@example.com:test.
[01:33] <wgrant> You probably want to alter populate-ubuntu-from-scratch to add armel too.
[01:33] <wgrant> start-dev-soyuz is OK to use, but don't try soyuz-sampledata-setup after you've run this :)
[01:41] <wschaub> I'm also not too familar with bzr how to i change my branch to yours?
[01:41] <wgrant> bzr merge lp:~wgrant/launchpad/boostrap-db-from-scratch
[01:42] <wschaub> cool. I will try that in just a moment. I'm trying to upload bc to a PPA and see if it will successfully build.
[01:43] <aber> Yes, the launchpad build farm is back. nice. :)
[01:49] <wschaub> great. now I'm running into problems with gpg. is there anyway to turn that off? (or a quick way to set up the correct stuff so I can upload to a PPA and get this over with?)
[01:50] <wgrant> wschaub: Where'd you get the error?
[01:51] <wschaub> uploading to the ppa with dput, hrm wait a moment, its using launchpad.net
[01:51] <wschaub> I guess I have to use something other than ppa:
[01:51] <wschaub> to hit the local launchpad.
[01:52] <wgrant> See 'Upload a source to the PPA' on HowToUseSoyuzLocally.
[01:52] <wgrant> You'll see -C absolutely-anyyhing in the process-upload commandline there -- that accepts unsigned uploads.
[02:00] <wschaub> Ok, looks like the soyuz services werent running, now it says its successfully uploaded and i get a traceback that says that /var/tmp/poppy/incoming/.lock no such file or directory.
[02:10] <wgrant> wschaub: Did you follow the first instruction in 'Upload a source to the PPA' -- running process-upload.py before you upload?
[02:14] <wschaub> I missed that one..
[02:17] <wschaub> trying again.
[02:19] <wschaub> grrr. now the vm seems to have frozen just a mo.
[02:19] <wgrant> Heh.
[02:30] <wschaub> ok so its back up now. but it thinks I've uploaded that package already.
[02:31] <wgrant> Add the -f option to dput.
[02:34] <wschaub> ok, no traceback. now to run the other scripts.
[02:34] <wschaub> I'm guessing I can run those in cron or something every so often to have this happen automatically ?
[02:35] <wgrant> Right.
[02:39] <wschaub> witing for the first script to finish, this is really slow on my athlon X2.
[02:40] <wschaub> hrm or maybe its just decided to not respond again... I guess could be running out of memoory in the Vm or something.
[02:40] <wschaub> its only got like 512MB of ram allocated to it.
[02:41] <wschaub> I mean I cant even get anything on the virtualbox console.
[02:41] <wschaub> this is the only way I have to test this stuff currently.
[02:42] <StevenK> wschaub: 512 is painfully small for Launchpad
[02:43] <wschaub> how much do I need? more than 1GB?
[02:47] <wschaub> all right round 3 with 1380MB allocated to the VM which is about all I can do. I will see if I can get some extra swap on as well.
[02:49] <steev> wschaub: natty? try enabling zram
[02:53] <wgrant> wschaub: i386 or amd64?
[02:53] <wgrant> You can probably get away with 1GB on i386, just.
[02:53] <wgrant> amd64 will need more.
[02:53] <wschaub> its i386.
[02:54] <wgrant> You could also kill the test keyserver to free up a bit of RAM.
[02:54] <wschaub> I have an ancient second hand desktop running lucid + virtualbox a smarttop and a smartbook to test with and thats about it.
[02:54] <wgrant> Ah.
[02:55] <wschaub> I think its a 1gz atholn X2 with maybe 2GB of ram.
[03:02] <wschaub> ok now about to run scripts/process-upload.py /var/tmp/poppy -C absolutely-anything -vvv hopefully it will work this time.
[03:03] <wschaub> didn't lock up. trying the last few steps.
[03:04] <wschaub> hopefully my efika will come to life.
[03:07] <lifeless> steev: zram?
[03:09] <wschaub> crap.
[03:09] <wschaub> let me find someplace to paste what I got.
[03:09] <wschaub> I'm guessing I set up the PPA wrong or something.
[03:09] <StevenK> wschaub: http://pastebin.ubuntu.com/
[03:10] <wschaub> http://pastebin.com/sHrSJ8hz
[03:10] <wschaub> sorry already pasted it there.
[03:11] <wschaub> I can repaste to pastebin.ubuntu.com if thats required.
[03:11] <StevenK> No, it's fine.
[03:11] <StevenK> Your upload path isn't right
[03:12] <StevenK> The path itself determines where your upload is targetted -- name16/foo means the foo release of the name16 distribution -- and name16 doesn't exist as a distribution.
[03:13] <wschaub> ok so its not the same as the ppa path then.
[03:13] <wschaub> what would be a more correct path for that then?
[03:13] <wschaub> the page for the ppa just says "dput ppa:name16/foo <source.changes> "
[03:13] <wschaub> on the launchpad.dev
[03:14] <StevenK> I think you're missing a ~
[03:14] <wgrant> Ah, yeah, I wrote the lpdev dput.cf target to work for anything, not just PPAs.
[03:14] <StevenK> ppa:~name16/foo/ubuntu
[03:14] <wgrant> So you need the ~
[03:14] <wgrant> (see HowToUseSoyuzLocally)
[03:16] <lifeless> which all ppas should need, honestly.
[03:16] <StevenK> lifeless: This is a locally-hosted instance
[03:18] <wgrant> StevenK: Even so.
[03:18] <wgrant> The ppa upload target should be ppa:~user/ppa, so we can actually have project PPAs at some point.
[03:21] <wschaub> http://pastebin.ubuntu.com/603958/
[03:28] <wgrant> wschaub: Hm, did you use soyuz-sampledata-setup?
[03:29] <wschaub> will it break anything any more if i do that and then re-run that last command?
[03:29] <wgrant> You should not run it twice.
[03:30] <wschaub> I hope it doesnt remove the arm stuff from the db. 9I may not have run it pretty sure I didn't run it, I assumed make schema took care of that)
[03:34] <wschaub> crap, Ok so I think its puking because I tried to set up natty in the launchpad UI earlier.
[03:34] <wschaub> quick way to just nuke the database and start over from scratch?
[03:34] <wgrant> Right. You probably want to wipe it all and start again (maybe with my branch to get a clean dB)
[03:34] <wschaub> worth a shot since things are totally fubar now.
[03:34] <wgrant> The sampledata is designed for testing the web UI, not for using in a real Soyuz environment.
[03:38] <wschaub> so run bzr merge lp:~wgrant/launchpad/boostrap-db-from-scratch and then run make schema and I have a fresh db?
[03:38] <wschaub> or do I have to go through and drop all the postgres databases by hand?
[03:38] <wgrant> wschaub: Yes. That bootstrap-lp-db and populate-ubuntu-from-scratch
[03:38] <wgrant> s/That/Then/
[03:39] <wgrant> make schema will drop them for you.
[03:43] <wschaub> http://pastebin.ubuntu.com/603961/
[03:43] <wschaub> thats from trying to do the merge.
[03:44] <wgrant> wschaub: s/boostrap/bootstrap/
[03:45] <wschaub> thats better.
[03:48] <wschaub> so now run make schema and then /utilities/populate-ubuntu-from-scratch.py ?
[03:48] <wgrant> bootstrap-lp-db needs to be run before populate-ubuntu-from-scratch
[03:48] <wgrant> So: make schema, bootstrap-lp-db, populate-ubuntu-from-scratch
[03:49] <wschaub> ok, I assume I have to insert into that table to make it know arm exists as well.
[03:49] <wschaub> at the end of all that.
[03:49] <wgrant> wschaub: Edit populate-ubuntu-from-scratch.
[03:49] <wgrant> wschaub: You can see where it adds amd64.
[03:49] <wgrant> Add armel there too.
[03:57] <wschaub> http://pastebin.ubuntu.com/603966/ that look kosher ?
[03:58] <wschaub> or do i have armel in the wrong place.
[03:59] <wgrant> wschaub: You need to create a new ProcessorFamily, Processor, and then call newArch.
[04:01] <wschaub> sso that + later on where we have parent.newArch('amd64', x64, True, ubuntu.owner, True)
[04:02] <wschaub> the same thing with 'armel', arm ...
[04:02] <wgrant> Right.
[04:03] <wgrant> The only name that really matters is the first argument to newArch, which must be 'armel'.
[04:03] <wschaub> isnt the second argument the object we created earlier?
[04:03] <wgrant> It is.
[04:03] <wgrant> But I mean, you can call them all 'arm' or 'armel' or whatever.
[04:04] <wgrant> As long as you get the architecturetag in the first argument of newArch to match what Ubuntu wants, which is 'armel'.
[04:04] <wschaub> ok I will go ahead and add that extra line then.
[04:06] <wschaub> that section of the python script now looks like this http://pastebin.ubuntu.com/603967/
[04:06] <wgrant> wschaub: As long as you're also creating a ProcessorFamily, looks good.
[04:07] <wschaub> what you see is all I changed.
[04:07] <wgrant> Like 5 has 'family=arm', but you've not created the arm family yet.
[04:08] <wgrant> sigh. s/Like/Line/
[04:08] <wschaub> Ok I see it just a bit further above.
[04:12] <wschaub> http://pastebin.ubuntu.com/603968/
[04:12] <wschaub> ok hopefully thats all of the bits that matter in the paste this time.
[04:12] <wgrant> wschaub: Looks fine.
[04:13] <wschaub> guess we will find out.
[04:15] <wschaub> no errors, now to run LP and log in.
[04:20] <wschaub> yeah, and the logging in part is a problem.
[04:20] <wschaub> what does this thing use as the default login?
[04:20] <wgrant> USERNAME@example.com:test
[04:20] <wgrant> Where USERNAME is what you gave to bootstrap-lp-db.
[04:21] <wschaub> yep works.
[04:21] <wgrant> That's the sole user in the system, and it's a member of ~admins.
[04:21] <wgrant> So it has full power.
[04:22] <wschaub> so now I create a ppa under that account, register a builder and restart the running soyuz locally ommiting the sample data stuff.
[04:22] <wgrant> You'll need to add a chroot too.
[04:26] <wschaub> right, thats the librarian step, I have an arm chroot for that.
[04:26] <wschaub> havent gotten that far yet.
[04:31] <wschaub> ok, chroot added (at least I think so, it didn't complain)
[04:34] <wschaub> dput -u lpdev:~wschaub/ppa bc_1.06.95-2_armel.changes ?
[04:34] <wgrant> _armel? Do you mean _source?
[04:36] <wschaub> thats the only changes file I have, I ran the bc package through pbuilder and I'm working on what it spit out in the result directory.
[04:36] <wgrant> Ah. You need to use 'debuild -S -sa' in the package source dir.
[04:36] <wgrant> You need to upload a source, not binaries.
[04:45] <wschaub> right, just have to prepare that.
[04:48] <wschaub> ok uploaded
[04:48] <wschaub> running scripts/process-upload.py /var/tmp/poppy -C absolutely-anything -vvv
[04:50] <wschaub> http://pastebin.ubuntu.com/603969/
[04:51] <wgrant> wschaub: Your changelog says 'unstable', which isn't an Ubuntu series name.
[04:53] <wschaub> so change it to natty and re-upload?
[04:53] <wgrant> Yes.
[04:53] <wschaub> ok.
[04:55] <wschaub> format 1.0 is not permitted in natty.
[04:56] <wschaub> any way to just do this with a .dsc file instead?
[04:57] <ScottK> wschaub: Why do you say that?
[04:58] <ScottK> (format 1.0)
[04:58] <wschaub> bc_1.06.95-2.dsc: format '1.0' is not permitted in natty.
[04:58] <wschaub> thats what the script bombs out on.
[04:58] <wschaub> I can paste the whole thing.
[04:58] <ScottK> Source format 1.0 is allowed.
[04:58] <ScottK> That's not the actual problem.
[04:59] <wschaub> http://pastebin.ubuntu.com/603970/
[05:03] <ScottK> I'm not familiar with LP internals, so I've no idea about that, but the assertion that source format 1.0 is not allowed in Natty is incorrect.
[05:04]  * wschaub pulls out more hair.
[05:06] <wschaub> I didn't even want to use launchpad, someone else wants me to set up a builder image that works with launchpad though. I would have been just fine with a perl script that called pbuilder.
[05:08] <wschaub> either way I've spent too much time on this to quit now.
[05:11] <ScottK> First rule of project management is that sunk costs are irrelevant.
[05:11] <ScottK> Probably not what you want to hear right now though.
[05:12] <wschaub> not really, (what I want to hear is "ok, go ahead and write that perl script instead")
[05:13] <wschaub> until then I have to find a way to get this up and running.
[05:16] <ScottK> I suspect you need to take a step back and make sure you understand the process for preparing and uploading manually better, but that's just me.
[05:19] <StevenK> I suspect the bootstrapping has missed a table
[05:24] <ScottK> I'd go with StevenK's suspicion over mine.
[05:26] <StevenK> It's been an awfully long time since I thought about source format rules in the codebase ...
[05:27] <wschaub> StevenK: anything I can do about that? I'm guessing youve been following the discuession so far.
[05:28] <StevenK> I'm having trouble remembering the runes
[05:28] <wgrant> wschaub: INSERT INTO sourcepackageformatselection (distroseries, format) SELECT id, 0 FROM distroseries;
[05:29] <StevenK> Oh, and 0 is a DBItem for 1.0?
[05:30] <wgrant> Yes.
[05:30] <wgrant> 1 is 3.0 (quilt), 2 is 3.0 (native).
[05:30] <wschaub> just a mo while I do that. hopefully you can fix your script to take care of that. my goal is to document how to set this all up, not just get it working on my vm once.
[05:31] <wgrant> Yeah, I'll add that and armel to the scrip.t
[05:31] <wgrant> It was written before sourcepackageformatselection eixsted.
[05:32] <wschaub> Would be glad to share the document too once I have it all verified working. (no reason for someone else to pull their hair out)
[05:34] <wschaub> ok, done
[05:34] <wschaub> now to try again.
[05:36] <wschaub> ok didnt choke like before but I think its my fault now. "cant build requested arch any"
[05:37] <wgrant> That normally means the chroot is missing.
[05:37] <wgrant> You added it to the right series?
[05:38] <wschaub> I used scripts/ftpmaster-tools/manage-chroot.py -s natty -a armel add -f ~/chroot-ubuntu-natty-armel.tar.bz2
[05:39] <wgrant> And you're uploading to natty?
[05:39] <wgrant> Ah, I see the problem.
[05:40] <wgrant> https://launchpad.dev/ubuntu/natty/armel/+admin -- check 'PPA support available'
[05:41] <wschaub> yep was unchecked.
[05:41] <wgrant> The armel/sourcepackageformatselection is now in my branch.
[05:44] <wschaub> http://pastebin.ubuntu.com/603980/ is this success?
[05:45] <wgrant> wschaub: That is success.
[05:45] <wschaub> I'm gussing I run scripts/publish-distro.py -C next
[05:45] <wgrant> You should see a build in the queue.
[05:45] <wgrant> Or on the builder.
[05:45] <wgrant> ./scripts/publish-distro.py -vv --ppa
[05:45] <wgrant> No need for -C for PPAs.
[05:48] <wschaub> says its waiting to build.
[05:48] <wschaub> the command you gave me bombed though.
[05:48] <wschaub> pasting now.
[05:48] <wgrant> What was the error?
[05:48] <wgrant> Ah.
[05:49] <wschaub> http://pastebin.ubuntu.com/603981/
[05:49] <StevenK> Heh, no publisher config
[05:49] <wgrant> Ahh, no PublisherConfig. That was added a couple of months ago.
[05:49] <wgrant> Yeah.
[05:50]  * wgrant finds the right paths.
[05:50] <wgrant> https://launchpad.dev/ubuntu/+pubconf
[05:50] <wgrant> root directory should be /var/tmp/archive
[05:50] <wgrant> base URL http://archive.launchpad.dev/
[05:50] <wgrant> Copy base URL also http://archive.launchpad.dev/
[05:52] <wschaub> ok. re-running the script after updating on that page.
[05:54] <wschaub> looking better http://pastebin.ubuntu.com/603982/
[05:55] <wgrant> Success. If you look in http://ppa.launchpad.dev/ you should see your PPA.
[05:56] <wgrant> And populate-ubuntu-from-scratch now adds the publisher config automatically.
[05:57] <wschaub> the builder is still idle though.
[05:58] <wgrant> That's upsetting.
[05:58] <wgrant> Is the builder set to be virtual?
[05:59] <wgrant> Check the 'Virtualized' flag, and enter any garbage for the host field, since it's not a real virtualised host.
[05:59] <wgrant> But PPAs want something that at least looks like it's virtualised.
[06:00] <wschaub> yeah i unchecked virtual thinking that would be a problem.
[06:00] <wgrant> The dev config replaces the usual virt reset command with echo.
[06:00] <wgrant> In production it SSHs into the host to kill and restart the VM.
[06:00] <wgrant> So the VM host field doesn't matter in a dev instance, as long as it's set to something.
[06:02] <wschaub> ok so I set it to virtual and set the hostname as foo for the vm host.
[06:02] <wschaub> I think I will check the log on the builde to see what if anything has been said to it.
[06:03] <wgrant> tail -f /var/tmp/development-buildd-manager.log
[06:03] <wgrant> (buildd-manager is started by start-dev-soyuz, and is the thing that talks to the slaves)
[06:04] <wschaub> ok I will paste that in a second. /var/log/launchpad-buildd/default.log doesnt seem to have much useful info in it.
[06:05] <wschaub> other than a bunch of post requests with no ral info.
[06:06] <wgrant> They should be every 15 seconds, and still happening now?
[06:08] <wschaub> waiting. nope.
[06:08] <wgrant> Maybe buildd-manager died after the multitude of DB drops.
[06:09] <wgrant> Is it still running?
[06:09] <wgrant> Production sort of doesn't have to cope with DB drops very often :)
[06:09] <wschaub> what can I grep for with ps -ef ?
[06:09] <wgrant> grep buildd-manager
[06:10] <wschaub> yeah not running.
[06:10] <wgrant> ps aux | grep keyserver
[06:10] <wgrant> ps aux | grep poppy
[06:10] <wgrant> (those two and buildd-manager are what start-dev-soyuz runs... best to kill all three and run start-dev-soyuz again)
[06:12] <wschaub> ok killed the last two (buildd-manger was dead already) and its re-starting now.
[06:15] <wschaub> the hell, buildd-mangager didnt come up.
[06:16] <wgrant> Anything in its logs?
[06:17] <wschaub> nothing in the log saying it ever started either.
[06:17] <wgrant> It might spew errors everywhere, but it should at least start...
[06:17] <wschaub> let me paste what I have.
[06:17] <wschaub> it has some odler stuff about builder bob in there form earlier but nothing about crashing.
[06:17] <wschaub> thre is no builder bob now and it says nothing abotu efikamx.
[06:18] <wgrant> bin/twistd --logfile /var/tmp/development-buildd-manager.log --pidfile /var/tmp/development-buildd-manager.pid -y daemons/buildd-manager.tac
[06:18] <wgrant> Does that do anything?
[06:19] <wschaub> says another twistd server is running.
[06:20] <wschaub> except
[06:20] <wschaub> there is no pid 1752 like it says
[06:21] <wschaub> let me rm the pid file.
[06:21] <wschaub> hopefully that will kick it back into running.
[06:22] <wschaub> launchpad-buildd is getting stuff now.
[06:22] <wschaub> lets check the status page.
[06:22] <wschaub> 1 package building.
[06:23] <wgrant> It will probably explode saying it can't find the librarian or archive.launchpad.dev or something like that.
[06:23] <wgrant> Because it's on another host, and there's no DNS to help it.
[06:26] <wschaub> where would I see it explode? it says its not building now.
[06:26] <wschaub> and its idle again.
[06:26] <wschaub> but nothing in the ppa looking like a built package.
[06:28] <wschaub> http://pastebin.ubuntu.com/603987/
[06:28] <wschaub> where would I even see stuff like this in the web interface?
[06:29] <StevenK> 2011-05-06 01:22:39-0400 [HTTPPageDownloader,client] ***** efikamx is CHROOTWAIT *****
[06:30] <wgrant> wschaub: https://launchpad.net/~USERNAME/+archive/PPA/+packages
[06:30] <wschaub> so, I need to make this thing visible from outside and point launchpad.dev at it.
[06:30] <wschaub> on the builder.
[06:30] <wgrant> https://dev.launchpad.net/Running/RemoteAccess
[06:31] <wgrant> I normally do that.
[06:31] <wgrant> Or something like it.
[06:31] <wgrant> Then, in the builder's /etc/hosts, add archive.launchpad.dev, ppa.launchpad.dev, launchpad.dev pointing to the VM's IP address.
[06:31] <wschaub> is there a way to tell it to attempt to re-build the package without re-uploading it once I have that set up?
[06:32] <StevenK> Yes, you can give it back
[06:32] <wgrant> wschaub: You'll see a nice red X on the PPA page. There'll be a link around there, and behind that a Retry link.
[06:34] <wschaub> I see it.
[06:35] <wschaub> brb after I take the dog out. I will try and get the remote access stuff set up and retry the build.
[06:49] <wschaub> lots of editing.. hang on.
[06:54] <wschaub> would be nice to have a script for this bit, tempted to do just that.
[06:54] <wschaub> later.
[07:18] <wschaub> ok i think I have it ticking over, re-submitting the build.
[07:18] <wschaub> I have a local dnsmasq so I just added everything to it and reloaded.
[07:21] <wschaub> now I have to give the launchpad-buildd a valid ntp server, no biggie.
[07:24] <wschaub> bzip2 is running on the builder
[07:24] <wschaub> so i guess it got its tarball.
[07:24] <wschaub> good sign so far.
[07:27] <wgrant> wschaub: Great.
[07:27] <wgrant> wschaub: You might get a 404 about archive.launchpad.dev
[07:27] <wgrant> In which case try './scripts/publish-distro.py -C' to create the initial local Ubuntu tree.
[07:28] <wschaub> http://pastebin.ubuntu.com/603991/
[07:28] <wschaub> new problem.
[07:28] <wschaub> but thats probably something to do with my ppa.
[07:28] <wschaub> I'm guessing thats what you just said.
[07:29] <wschaub> dunno if there is enough space on the VM's disk to hold all those packages (if its going to mirror everything)
[07:29] <wgrant> It's not.
[07:29] <wgrant> It's just going to create an empty tree.
[07:29] <wgrant> Well, it will create a tree with empty indices.
[07:30] <wgrant> That's why you need to set an external dependency on ports.ubuntu.com: you don't have the whole Ubuntu archive locally.
[07:35] <wschaub> ok, giving it another go.
[07:38] <wschaub> now it says its failed because of dependency wait.
[07:39] <wschaub> http://pastebin.ubuntu.com/603993/
[07:40] <wgrant> Did you readd the external dependency after you rebuilt the DB?
[07:40] <wgrant> It appears not.
[07:41] <wschaub> I have this set up in the ppa.
[07:41] <wschaub> deb http://ports.ubuntu.com/ubuntu-ports %(series) main restricted universe multiverse
[07:41] <wschaub> under https://launchpad.dev/~wschaub/+archive/ppa/+admin
[07:44] <wgrant> Oh.
[07:44] <wgrant> A typo on my side. %(series)s, not %(series)
[07:44] <wgrant> And you are uploading to that same PPA?
[07:45] <wschaub> yes.
[07:45] <wschaub> thats the ppa I'm submitting the package builds from.
[07:45] <wgrant> So, try fixing the typo and retrying, I guess. But I would have expected that to produce a dispatch failure, not a build failure.
[07:45] <wschaub> so its "deb http://ports.ubuntu.com/ubuntu-ports %(series)s, main restricted universe"
[07:46] <wschaub> ?
[07:46] <wgrant> "deb http://ports.ubuntu.com/ubuntu-ports %(series)s main restricted universe"
[07:46] <wgrant> And probably with a " multiverse" at the end, but it's unlikely you'll use that.
[07:48] <wschaub> ok, done retrying build.
[07:51] <wschaub> seems to be working, its actually loading depends according to the log.
[07:51] <wgrant> Great.
[07:53] <wschaub> running autoconf.
[07:54] <wschaub> getting compiler lines in the log now.
[07:56] <wschaub> now it says uploading build.
[07:59] <wschaub> I dont see it in my pool though.
[07:59] <wschaub> I'm guessing theres more scripts to run.
[08:01] <wschaub> scripts/process-upload.py -vvv --builds -C buildd /var/tmp/builddmaster
[08:01] <wschaub> scripts/process-accepted.py -vv --ppa ubuntu
[08:01] <wschaub> scripts/publish-distro.py -vv --ppa
[08:01] <wschaub> right?
[08:04] <wschaub> yup! its in my pool.
[08:04] <wschaub> awesome.
[08:05] <wschaub> OK, I'm going to bed just going to save this irc log, save the VM state and see if I can re-create this all tomorrow. and document it.
[08:06] <wgrant> wschaub: Great! If you need any help at all, give me a poke.
[08:06] <wschaub> will do, thanks for your amazing patience with this.
[08:07] <wgrant> I remember when I was first working out how to do it.
[08:07] <wgrant> before there were docs :/
[08:07] <wgrant> At all :/
[08:07] <wschaub> doe syour new script have the arm stuff in itor will I have ot edit that part again?
[08:07] <wgrant> It has the ARM and PublisherConfig and SourcePackageFormatSelection stuff.
[08:07] <wgrant> You'll still have to flip the "PPA support available" flag, though.
[08:07] <wschaub> thats not so bad.
[08:08] <wgrant> A bit better than SQL :)
[08:10] <wschaub> the ppa stuff might not even be necessary the way this thing might be used. (rebuilding natty bits) I just figured a simple upload/build of bc to a ppa would be the easist way to see it working.
[08:15] <wschaub> anyway time to pass out.
[08:15] <wgrant> Night.
[09:00] <aviksil> I've been trying to upload a package to my ppa using dput. update is successful, but i never get a reply from launchpad. any idea?
[09:00] <aviksil> i'm using sftp method
[09:11] <henninge> aviksil: you are referring to a reply via email?
[09:12] <aviksil> henninge: no. i'm seeking help
[09:13] <henninge> aviksil: you said you "never get a reply from launchpad"
[09:13] <henninge> aviksil: I meant if you are expecting a reply via email?
[09:13] <aviksil> henninge: oh ok. misunderstood. yes, i'm referring to reply via email
[09:14] <henninge> aviksil: I have not used ppas much myself so I wasn't sure if that is the expected behavior.
[09:15] <henninge> aviksil: there has been work on reducing emails sent by Launchpad. Maybe you need to explicitly subscribe to such notifications now.
[09:15] <wgrant> aviksil: Did you sign the package properly?
[09:15] <aviksil> henninge: ok. actually i tried ftp method earlier. but it stalled while uploading the *source.changes file
[09:16] <henninge> aviksil, wgrant: I understood that the actual upload went fine?
[09:16] <aviksil> then i moved to sftp method with login = aviksil
[09:16] <bigjools> henninge: emails from soyuz were not part of the recent structural subscription wpork
[09:16] <henninge> I see
[09:16] <bigjools> https://answers.edge.launchpad.net/launchpad/+faq/227
[09:16] <aviksil> wgrant: yes, it was signed properly
[09:17] <bigjools> aviksil: please read the FAQ
[09:17] <aviksil> bigjools: ok
[09:26] <aviksil> bigjools: wgrant: i found that the GPG key that is used to sign the package is not registered with launchpad
[09:26] <aviksil> how can i add that key to launchpad?
[09:26] <bigjools> aviksil: did you not get a warning from dput about that?
[09:26] <wgrant> bigjools: Not through SFTP.
[09:26] <aviksil> bigjools: no
[09:26] <bigjools> he said he used FTP
[09:27] <aviksil> bigjools: in ftp, it stalled
[09:27] <wgrant> aviksil: https://launchpad.net/people/+me/+editpgpkeys
[09:27] <bigjools> ah the FTP problem
[09:27] <aviksil> bigjools: in sftp, it was uploaded, git not get any warning
[09:27] <bigjools> wgrant: the 1k stall is most perplexing
[09:28] <wgrant> bigjools: Yes :/
[09:29] <aviksil> wgrant: thanks
[10:30] <geser> wgrant: as this just appeared on #ubuntu-devel: can you explain what happened here: https://launchpad.net/ubuntu/+source/libipoddevice/+publishinghistory ? libipoddevice got deleted in lucid yet an older version is still published and got copied to maverick and later. but the published binaries are from the deleted version: https://launchpad.net/ubuntu/maverick/i386/libipoddevice0
[10:31] <wgrant> geser: Erm.
[10:31] <wgrant> Wow.
[10:32] <wgrant> geser: Oh.
[10:32] <wgrant> geser: I think I see what happened... a new upload was deleted before the publisher had run.
[10:33] <wgrant> geser: So the old one never got superseded.
[10:35] <wgrant> geser: Do you understand what happened?
[10:35] <wgrant> Not sure what happened with the binaries, but it's probably related to there being two active versions.
[10:36] <geser> I guess: bad timing: 0.5.3-3.2ubuntu2 got uploaded and build but killed before 0.5.3-3.2ubuntu1 got marked as superseded
[10:36] <wgrant> Right. Deletion just marks the latest publication as Deleted. But that goes a bit wrong if it's not yet published.
[10:38] <geser> but shouldn't soyuz have some checks that the published binaries match the published source?
[10:39] <wgrant> geser: Well, we normally assume that the archive doesn't become corrupt like this.
[10:44] <soren> Is there any way to check when someone got deactivated from a team?
[10:45] <wgrant> soren: It's in the DB, but we don't expose it in the UI or API.
[10:45] <soren> wgrant: Is it hard to get to if I wanted you to look it up for me?
[10:46] <wgrant> soren: Probably easier for you to file a bug. Or you could maybe coerce a team lead into getting it from staging for you.
[10:48] <soren> wgrant: Who are the team leads?
[10:48] <soren> Maybe one of them owes me a favour :)
[10:55] <soren> wgrant: Never mind, I finally found the e-mail launchpad sent me about the deactivation. Thanks!
[10:58] <wgrant> soren: Great!
[10:58] <wgrant> But still file a bug :)
[11:01] <soren> wgrant: Will do.
[11:04] <soren> wgrant: https://bugs.launchpad.net/launchpad/+bug/778411  <-- I never know which launchpad component to file stuff against.
[11:04] <wgrant> soren: There are no components any more! It's all just /launchpad now, nice and easy.
[11:21] <maxb> Could someone in ~launchpad click the "Build now" link for me on https://code.launchpad.net/~launchpad/+recipe/lpreview-body-daily ?
[11:22] <henninge> maxb: clicked
[11:22] <maxb> thanks
[11:22]  * henninge even reviewed that UI ... ;-)
[11:23] <soren> wgrant: Oh, lovely. :)
[11:52] <henninge> adeuring: I am off to lunch. Maybe you could take over already?
[11:52] <adeuring> henninge: sure, np
[11:52] <henninge> cool, thanks
[15:05] <deryck> adeuring, my turn. :-)
[15:05] <adeuring> deryck: thanks!
[15:05] <deryck> np
[16:38] <jero-> hi
[16:39] <deryck> hi
[16:40] <jero-> is launchpad localized ?
[16:41] <deryck> jero-, no, it's not.
[16:42] <jero-> deryck, is there any support for UI localization in the code or is it just zero
[16:42] <jero-> ?
[16:42] <bigjools> ScottK: around?
[16:42] <ScottK> bigjools: Yes.
[16:43] <bigjools> ScottK: hey there - I'm going to be at UDS for Friday only next week, are you there?
[16:43] <ScottK> Yes.
[16:43] <bigjools> ScottK: are you interested in doing some user testing on the derived distros feature we're working on?
[16:43] <ScottK> Possibly. Depends on what else is scheduled at the time.
[16:44] <bigjools> I am trying to work with the scheduler to make sure that nothing clashes
[16:44] <bigjools> I'm trying to get archive admins and anyone else who uses merges.u.c and wants to sync
[16:44] <ScottK> Hard to know if it will stay that way.
[16:45] <ScottK> OK.
[16:45] <deryck> jero-, no, we've not done any work to make it possible.
[16:45] <deryck> jero-, there are certain social concerns that have kept it from getting much uptake.  fearing bugs in different languages, and so on.
[16:46] <bigjools> ScottK: I'll put you down then, and we'll see how it works out.
[16:46] <bigjools> thanks
[16:46] <ScottK> bigjools: I think it would be good for me to test.  I just hesitate to make a firm commitment.
[16:46] <ScottK> OK.
[16:46] <bigjools> it would only need 15-20 minutes of your time :)
[16:46] <ScottK> OK
[16:49] <jero-> deryck, thank you!
[16:50] <deryck> jero-, np
[17:54] <steev> lifeless: http://code.google.com/p/compcache/wiki/zramperf
[18:01] <deryck> abentley, tag.  last time for the week! :-)
[18:04] <abentley> deryck[lunch]: roger
[20:31] <niemeyer> Yo
[20:31] <niemeyer> Quick question about API usage
[20:32] <niemeyer> https://api.staging.launchpad.net requires authentication against https://staging.launchpad.net/+request-token, etc, or can it use https://launchpad.net/+request-token and friends?
[20:36] <soren> abentley: Greetings. https://lists.launchpad.net/openstack/ doesn't have anything after May 2nd. Any bright ideas?
[20:36] <soren> abentley: (Yes, people have posted there)
[20:37] <abentley> soren: I'll see what I can find out.
[20:39] <soren> abentley: \o/ Thanks.
[20:40] <abentley> niemeyer: I don't know about that mechanism, but in general, the API auth stuff is per-instance.
[20:40] <abentley> niemeyer: So staging, qastaging production and dogfood each have their own OAUTH credentials.
[20:41] <niemeyer> abentley: That's what I imagined too.. might be worth saying a few words about it at https://help.launchpad.net/API/SigningRequests
[20:41] <niemeyer> abentley: The Hacking document speaks about staging the whole time
[20:41] <niemeyer> abentley: But the SigningRequests one refers to production
[20:50] <abentley> soren: I'm having trouble tracking down someone with the right knowledge.  Could you file a question so we don't lose track of this?
[20:52] <soren> abentley: Against launchpad itself?
[20:52] <soren> "against"
[20:52] <abentley> soren: yes.
[20:52] <ajlyon> Question re: SVN code import. I made a request, and immediately thereafter received a message from<EMAIL_ADDRESS>that "Your message was rejected". Just a spurious error? Or will the request not get reviewed?
[20:55] <abentley> ajlyon: Spurious error.  Sorry about that.
[20:56] <abentley> ajlyon: Approved.
[20:56] <ajlyon> Thanks
[20:57] <abentley> ajlyon: no problem.
[21:01] <wschaub> wgrant: Ok. I'm ready to go through last nights IRC log and do this from scratch documenting every step. I will let you know if I run into any snags in the process. and you can look at the steps I write down if you like (I want to be sure I don't miss anything)
[21:02] <wschaub> should take about forever to install a fresh vm and pull down launchpad.
[21:03] <soren> abentley: https://answers.launchpad.net/launchpad/+question/156317
[21:04] <sinzui> soren: We may be seeing caching issues with the archive. The mail is there, but the proxy is hiding them. Did you receive the missing emails?
[21:06] <soren> sinzui: Yes, lots of them.
[21:07] <sinzui> soren: okay. I do not see any emails in the archive (by url hacking) after the one we see
[21:08] <sinzui> soren: you confirmed the email you got was sent via the Lp mailing list?
[21:09] <soren> sinzui: We've gotten a lot of e-mail on that list since the 2nd.
[21:09] <soren> *Ĵust* got another one :)
[21:09] <soren> You want msgids or something? Would that be helpful at all?
[21:10] <sinzui> no, I cannot access the archive
[21:11] <sinzui> I can see less then yourself actually
[21:11] <sinzui> soren: all lists are stuck on the same date :(
[21:12] <sinzui> I think the queue to the archive is stuck.
[21:12] <sinzui> I will ask an admin to restart mailman
[21:12] <soren> sinzui: Cool beans.
[21:13]  * ajlyon_ ajlyon
[21:16] <ajlyon> I'm still working on getting an external SVN repo to import into Launchpad's bzr, and the importer is failing with an authorization error: subvertpy.SubversionException: ("PROPFIND of '/svn': authorization failed: Could not authenticate to server: rejected Basic challenge (https://www.zotero.org)", 170001)
[21:18] <ajlyon> This would make some sense, except that I'm actually requesting the branch https://www.zotero.org/svn/extension/trunk/ , which has no authorization enabled
[21:19] <ajlyon> It appears that subvertpy is attempting to access /svn nonetheless- which on this server is not publicly visible
[21:33] <abentley> ajlyon: bzr-svn scans the svn repo in order to determine its path layout.  You may be seeing this.
[21:36] <ajlyon> I think so-- but bzr-svn is failing because of the failed authentication-- even though it doesn't need to look at that part of the repo...
[21:37] <abentley> ajlyon: see https://bugs.launchpad.net/bzr-svn/+bug/675104 and note that this user was also attempting to use zotero.
[21:38] <ajlyon> interesting
[21:38] <ajlyon> so it would seem that zotero's repo is quite odd in this respect
[21:39] <ajlyon> I'll work manually for now and make a local bzr repo as described, then upload it
[21:39] <ajlyon> thanks for the support
[21:40] <abentley> ajlyon: You're welcome.
[22:39] <mdke> is someone available who could remove an erroneous upstream series/source package link?
[22:40] <mdke> or should I file a question?
[23:07] <soren> sinzui: Did you get mailman restarated?
[23:09] <sinzui> soren: I just upated your question with our findings: https://answers.launchpad.net/launchpad/+question/156317
[23:09] <sinzui> soren: restarting wont fix the issue.
[23:10] <soren> sinzui: Alright, thanks!
[23:10] <sinzui> We can see that most of the problem is cleared in the message at the top of the queue now. We cannot say for certain if there are more messages to the problem list
[23:12] <sinzui> soren: we were able to find the openstack messages in the queue BW
[23:12] <sinzui> BTW
[23:13] <sinzui> If the queue is not empty on Monday. We may write a script that pulls all the ubuntu-x-swat out of the queue
[23:18] <sinzui> I am pretty certain the that mega-archives are the cause of the late archive arrivals I reported a few month back