01:09:00 | <ivan`> | just noticed that youtube-dl can actually grab whole blip.tv channels |
01:09:00 | <ivan`> | though I still need to patch to get the HD versions |
01:13:00 | <Famicoman> | how can you get it to download whole channels? |
01:39:00 | <ivan`> | Famicoman: just give it a blip.tv/username |
01:39:00 | <ivan`> | at least it works with http://blip.tv/linuxconfau |
01:40:00 | <Famicoman> | that does work, thanks |
01:46:00 | <dashcloud> | I'm not sure how many of the sites listed in this book: https://archive.org/details/cdrom-internetgamesdirectorycd are still around, but there could be some good things in the links there |
01:50:00 | <dashcloud> | here's a useful site that tracks (and keeps copies of) youtube videos that get flagged or taken down: http://youtomb.mit.edu/ |
01:52:00 | <chronomex> | neat, do they get the advance drop or something? |
01:53:00 | <chronomex> | oh, hm |
01:53:00 | <dashcloud> | here's the about page: http://youtomb.mit.edu/about |
01:54:00 | <chronomex> | iirc, IA sucks in copies of youtube videos on twitter's abbreviated firehose |
01:54:00 | <chronomex> | *videos mentioned on |
01:56:00 | <dashcloud> | so I was wrong about it keeping copies of the videos- it doesn't |
01:57:00 | <chronomex> | aye |
02:28:00 | <underscor> | I am curious if they still do |
02:29:00 | <underscor> | and just don't publicize it for obvious reasons |
02:41:00 | <Aranje> | mostly dicks |
02:54:00 | <chronomex> | there are 3.5 billion dicks in the world |
14:05:00 | <balrog> | hah, my rsync to SketchCow's box is still going |
18:52:00 | <Coderjoe> | hmm... I wonder if I should pack up this old mirror of ftp.cavedog.com |
18:52:00 | <Coderjoe> | cavedog was a game developer, behind the Total Annihilation series. the hostname no longer resolves. |
19:57:00 | <ivan`> | I want to maintain a mirror of all of github, but I don't think I have the disk space, and it isn't really suitable for a one-time archiving job |
19:57:00 | <ivan`> | anyone have 10TB+ available? |
19:58:00 | <ivan`> | the main reason to do is that people rm their repos all the time |
19:58:00 | <norbert79> | Even by todays standards 10 TB is just damn hue |
19:58:00 | <norbert79> | huge |
19:59:00 | <chronomex> | 10T is big, but not huge |
19:59:00 | <chronomex> | ;) |
19:59:00 | <norbert79> | well, for you maybe :) |
19:59:00 | <ivan`> | I have about 60000 repos already |
20:00:00 | <DFJustin> | seems like the kind of thing that could really benefit from a compressing filesystem |
20:00:00 | <balrog> | git repos are already pretty compressed |
20:01:00 | <ivan`> | git packs are already very compressed |
20:01:00 | <balrog> | dedup might be useful |
20:01:00 | <chronomex> | ninja'd |
20:01:00 | <balrog> | wait who was first? :P |
20:01:00 | <chronomex> | balrog was |
20:01:00 | <ivan`> | you can actually share objects/ between repos, but I haven't tried it |
20:01:00 | <ivan`> | I think at that point you never gc |
20:02:00 | <chronomex> | I was going to say something but then I didn't |
21:02:00 | <ersi> | norbert79: 10TB is actually just 3.3 hard drives.. Without redundancy |
21:02:00 | <chronomex> | that's HYUUGE |
21:02:00 | <ersi> | which is like 500$ |
21:10:00 | <norbert79> | ersi: Over there maybe, it's a bit more expensive around my place |
21:12:00 | <ersi> | oops, I was calculating on 2TB disks, so that's too low actually |
23:13:00 | <godane> | ivan`: there is some code out there that will allow you to put all the forks into one .git folder |
23:13:00 | <godane> | i would think that will save you some space |
23:14:00 | <chronomex> | hm, that would |
23:14:00 | <chronomex> | git-gc would take forEVer though |
23:15:00 | <godane> | there is stuff like this: https://github.com/joeyh/github-backup |
23:15:00 | <chronomex> | joeyh == closure ;) |
23:15:00 | <godane> | cool |
23:17:00 | <godane> | i wish he made it not in bash or python or perl |
23:17:00 | <godane> | * mean made in bash/python/perl |
23:17:00 | | chronomex shrugs |
23:18:00 | <chronomex> | maybe you should learn haskell ;) |
23:18:00 | <godane> | haskell needs itself just to compile haskell |
23:19:00 | <chronomex> | woop woop woop off-topic siren |
23:22:00 | <NovaKing> | http://git-annex.branchable.com/ |
23:22:00 | <NovaKing> | you guys seen that project? |
23:22:00 | <chronomex> | git-annex is my lord and saviour |
23:23:00 | <NovaKing> | :) |
23:25:00 | <NovaKing> | closure really loves his haskell! ;D |