01:09:00<ivan`>just noticed that youtube-dl can actually grab whole blip.tv channels
01:09:00<ivan`>though I still need to patch to get the HD versions
01:13:00<Famicoman>how can you get it to download whole channels?
01:39:00<ivan`>Famicoman: just give it a blip.tv/username
01:39:00<ivan`>at least it works with http://blip.tv/linuxconfau
01:40:00<Famicoman>that does work, thanks
01:46:00<dashcloud>I'm not sure how many of the sites listed in this book: https://archive.org/details/cdrom-internetgamesdirectorycd are still around, but there could be some good things in the links there
01:50:00<dashcloud>here's a useful site that tracks (and keeps copies of) youtube videos that get flagged or taken down: http://youtomb.mit.edu/
01:52:00<chronomex>neat, do they get the advance drop or something?
01:53:00<chronomex>oh, hm
01:53:00<dashcloud>here's the about page: http://youtomb.mit.edu/about
01:54:00<chronomex>iirc, IA sucks in copies of youtube videos on twitter's abbreviated firehose
01:54:00<chronomex>*videos mentioned on
01:56:00<dashcloud>so I was wrong about it keeping copies of the videos- it doesn't
01:57:00<chronomex>aye
02:28:00<underscor>I am curious if they still do
02:29:00<underscor>and just don't publicize it for obvious reasons
02:41:00<Aranje>mostly dicks
02:54:00<chronomex>there are 3.5 billion dicks in the world
14:05:00<balrog>hah, my rsync to SketchCow's box is still going
18:52:00<Coderjoe>hmm... I wonder if I should pack up this old mirror of ftp.cavedog.com
18:52:00<Coderjoe>cavedog was a game developer, behind the Total Annihilation series. the hostname no longer resolves.
19:57:00<ivan`>I want to maintain a mirror of all of github, but I don't think I have the disk space, and it isn't really suitable for a one-time archiving job
19:57:00<ivan`>anyone have 10TB+ available?
19:58:00<ivan`>the main reason to do is that people rm their repos all the time
19:58:00<norbert79>Even by todays standards 10 TB is just damn hue
19:58:00<norbert79>huge
19:59:00<chronomex>10T is big, but not huge
19:59:00<chronomex>;)
19:59:00<norbert79>well, for you maybe :)
19:59:00<ivan`>I have about 60000 repos already
20:00:00<DFJustin>seems like the kind of thing that could really benefit from a compressing filesystem
20:00:00<balrog>git repos are already pretty compressed
20:01:00<ivan`>git packs are already very compressed
20:01:00<balrog>dedup might be useful
20:01:00<chronomex>ninja'd
20:01:00<balrog>wait who was first? :P
20:01:00<chronomex>balrog was
20:01:00<ivan`>you can actually share objects/ between repos, but I haven't tried it
20:01:00<ivan`>I think at that point you never gc
20:02:00<chronomex>I was going to say something but then I didn't
21:02:00<ersi>norbert79: 10TB is actually just 3.3 hard drives.. Without redundancy
21:02:00<chronomex>that's HYUUGE
21:02:00<ersi>which is like 500$
21:10:00<norbert79>ersi: Over there maybe, it's a bit more expensive around my place
21:12:00<ersi>oops, I was calculating on 2TB disks, so that's too low actually
23:13:00<godane>ivan`: there is some code out there that will allow you to put all the forks into one .git folder
23:13:00<godane>i would think that will save you some space
23:14:00<chronomex>hm, that would
23:14:00<chronomex>git-gc would take forEVer though
23:15:00<godane>there is stuff like this: https://github.com/joeyh/github-backup
23:15:00<chronomex>joeyh == closure ;)
23:15:00<godane>cool
23:17:00<godane>i wish he made it not in bash or python or perl
23:17:00<godane>* mean made in bash/python/perl
23:17:00chronomex shrugs
23:18:00<chronomex>maybe you should learn haskell ;)
23:18:00<godane>haskell needs itself just to compile haskell
23:19:00<chronomex>woop woop woop off-topic siren
23:22:00<NovaKing>http://git-annex.branchable.com/
23:22:00<NovaKing>you guys seen that project?
23:22:00<chronomex>git-annex is my lord and saviour
23:23:00<NovaKing>:)
23:25:00<NovaKing>closure really loves his haskell! ;D