| 01:09:00 | <ivan`> | just noticed that youtube-dl can actually grab whole blip.tv channels |
| 01:09:00 | <ivan`> | though I still need to patch to get the HD versions |
| 01:13:00 | <Famicoman> | how can you get it to download whole channels? |
| 01:39:00 | <ivan`> | Famicoman: just give it a blip.tv/username |
| 01:39:00 | <ivan`> | at least it works with http://blip.tv/linuxconfau |
| 01:40:00 | <Famicoman> | that does work, thanks |
| 01:46:00 | <dashcloud> | I'm not sure how many of the sites listed in this book: https://archive.org/details/cdrom-internetgamesdirectorycd are still around, but there could be some good things in the links there |
| 01:50:00 | <dashcloud> | here's a useful site that tracks (and keeps copies of) youtube videos that get flagged or taken down: http://youtomb.mit.edu/ |
| 01:52:00 | <chronomex> | neat, do they get the advance drop or something? |
| 01:53:00 | <chronomex> | oh, hm |
| 01:53:00 | <dashcloud> | here's the about page: http://youtomb.mit.edu/about |
| 01:54:00 | <chronomex> | iirc, IA sucks in copies of youtube videos on twitter's abbreviated firehose |
| 01:54:00 | <chronomex> | *videos mentioned on |
| 01:56:00 | <dashcloud> | so I was wrong about it keeping copies of the videos- it doesn't |
| 01:57:00 | <chronomex> | aye |
| 02:28:00 | <underscor> | I am curious if they still do |
| 02:29:00 | <underscor> | and just don't publicize it for obvious reasons |
| 02:41:00 | <Aranje> | mostly dicks |
| 02:54:00 | <chronomex> | there are 3.5 billion dicks in the world |
| 14:05:00 | <balrog> | hah, my rsync to SketchCow's box is still going |
| 18:52:00 | <Coderjoe> | hmm... I wonder if I should pack up this old mirror of ftp.cavedog.com |
| 18:52:00 | <Coderjoe> | cavedog was a game developer, behind the Total Annihilation series. the hostname no longer resolves. |
| 19:57:00 | <ivan`> | I want to maintain a mirror of all of github, but I don't think I have the disk space, and it isn't really suitable for a one-time archiving job |
| 19:57:00 | <ivan`> | anyone have 10TB+ available? |
| 19:58:00 | <ivan`> | the main reason to do is that people rm their repos all the time |
| 19:58:00 | <norbert79> | Even by todays standards 10 TB is just damn hue |
| 19:58:00 | <norbert79> | huge |
| 19:59:00 | <chronomex> | 10T is big, but not huge |
| 19:59:00 | <chronomex> | ;) |
| 19:59:00 | <norbert79> | well, for you maybe :) |
| 19:59:00 | <ivan`> | I have about 60000 repos already |
| 20:00:00 | <DFJustin> | seems like the kind of thing that could really benefit from a compressing filesystem |
| 20:00:00 | <balrog> | git repos are already pretty compressed |
| 20:01:00 | <ivan`> | git packs are already very compressed |
| 20:01:00 | <balrog> | dedup might be useful |
| 20:01:00 | <chronomex> | ninja'd |
| 20:01:00 | <balrog> | wait who was first? :P |
| 20:01:00 | <chronomex> | balrog was |
| 20:01:00 | <ivan`> | you can actually share objects/ between repos, but I haven't tried it |
| 20:01:00 | <ivan`> | I think at that point you never gc |
| 20:02:00 | <chronomex> | I was going to say something but then I didn't |
| 21:02:00 | <ersi> | norbert79: 10TB is actually just 3.3 hard drives.. Without redundancy |
| 21:02:00 | <chronomex> | that's HYUUGE |
| 21:02:00 | <ersi> | which is like 500$ |
| 21:10:00 | <norbert79> | ersi: Over there maybe, it's a bit more expensive around my place |
| 21:12:00 | <ersi> | oops, I was calculating on 2TB disks, so that's too low actually |
| 23:13:00 | <godane> | ivan`: there is some code out there that will allow you to put all the forks into one .git folder |
| 23:13:00 | <godane> | i would think that will save you some space |
| 23:14:00 | <chronomex> | hm, that would |
| 23:14:00 | <chronomex> | git-gc would take forEVer though |
| 23:15:00 | <godane> | there is stuff like this: https://github.com/joeyh/github-backup |
| 23:15:00 | <chronomex> | joeyh == closure ;) |
| 23:15:00 | <godane> | cool |
| 23:17:00 | <godane> | i wish he made it not in bash or python or perl |
| 23:17:00 | <godane> | * mean made in bash/python/perl |
| 23:17:00 | | chronomex shrugs |
| 23:18:00 | <chronomex> | maybe you should learn haskell ;) |
| 23:18:00 | <godane> | haskell needs itself just to compile haskell |
| 23:19:00 | <chronomex> | woop woop woop off-topic siren |
| 23:22:00 | <NovaKing> | http://git-annex.branchable.com/ |
| 23:22:00 | <NovaKing> | you guys seen that project? |
| 23:22:00 | <chronomex> | git-annex is my lord and saviour |
| 23:23:00 | <NovaKing> | :) |
| 23:25:00 | <NovaKing> | closure really loves his haskell! ;D |