HomeSearchPrevious dayNext day

00:41:18Connection closed.
00:41:28Connection closed.
00:44:01atirclog (atirclog) joins
00:44:01Topic: Lengthy Archive Team related discussions here | General archiving & offtopic: #archiveteam-ot | https://twitter.com/textfiles/status/1069715869994020867
00:44:01Topic set by Fusl at 2019-09-06 21:43:01Z
00:44:14Current users: atirclog (atirclog), sirvy, HackMii (hacktheplanet), nyany (nyany), MrKen, kiskaLogBot, systwi (systwi), Jake (Jake), Datechnom (Datechnom), yanome (yano), kallsyms, @ChanServ, pmlo, deni (deni), summerisle (summerisle), Sanqui (Sanqui), fionera (Fionera), FalconK (FalconK), hexa- (hexa-), purplebot, Muad-Dib, Craigle (Craigle), sec^nd (second), themadpro (themadpro), brad, girst (girst), luckcolors (luckcolors), ThisAsYou, fuzzy8021 (fuzzy8021), ftl, @arkiver (arkiver), lennier1, @kiskaWee1 (kiska), celestial_, Barto (Barto), DLoader, VerifiedJ (VerifiedJ), @chfoo (chfoo), @JAA (JAA), sknebel (sknebel), nothere, Suika, britmob2, endrift, Ajay, seatsea, Lord_Nightmare, Aoede, DopefishJustin, jodizzle, Dj-Wawa, balrog (balrog), pie_, Kenshin, Hecz (Hecz), treora
00:44:17klg (klg) joins
00:44:24step joins
00:44:33cadence (cadence) joins
00:44:57marked1957 joins
00:44:58dxrt joins
00:45:01dxrt quits [Changing host]
00:45:01dxrt (dxrt) joins
00:45:01@ChanServ sets mode: +o dxrt
00:45:23katocala joins
00:45:25colona joins
00:45:40nico_32 joins
00:45:52Larsenv (Larsenv) joins
00:45:54space (space) joins
00:45:54EggplantN joins
00:46:05justcool393 (justcool393) joins
00:46:15revi joins
00:46:19yano (yano) joins
00:46:20anelki (anelki) joins
00:46:20Ctrl-S joins
00:46:32Dragnog joins
00:46:37s-crypt (s-crypt) joins
00:46:39anarcat joins
00:46:43jrwr (jrwr) joins
00:46:43@ChanServ sets mode: +o jrwr
00:46:50HCross (HCross) joins
00:46:50@ChanServ sets mode: +o HCross
00:46:51voltagex joins
00:46:52Kaz__ joins
00:47:06hook54321 (hook54321) joins
00:47:06@ChanServ sets mode: +o hook54321
00:47:19mgrandi (mgrandi) joins
00:47:51jlu5 (jlu5) joins
00:47:51tech234a (tech234a) joins
00:47:59Fusl_ (Fusl) joins
00:47:59@ChanServ sets mode: +o Fusl_
00:48:13phuzion (phuzion) joins
00:48:14xit joins
00:48:41Wingy (Wingy) joins
00:48:45Jens (JensRex) joins
00:48:51c00k13 joins
00:49:12revi is now known as RJHacker50274
00:49:16thuban joins
00:49:32nerdguy1138 (nerdguy1138) joins
00:49:50Kaz (Kaz) joins
00:49:50@ChanServ sets mode: +o Kaz
00:50:06Peetz0r (Peetz0r) joins
00:50:08kpcyrd (kpcyrd) joins
00:50:13chip joins
00:50:15Fusl (Fusl) joins
00:50:15@ChanServ sets mode: +o Fusl
00:50:35sembiance (sembiance) joins
00:50:38Jonimus joins
00:51:04simon816 (simon816) joins
00:53:39OrIdow6 (OrIdow6) joins
00:55:15SketchTheCow joins
00:55:21AlsoJAA joins
00:55:21AlsoJAA quits [Changing host]
00:55:21AlsoJAA (JAA) joins
00:55:21@ChanServ sets mode: +o AlsoJAA
00:55:23programmerq (programmerq) joins
01:00:50lunik1 joins
01:01:54HP_Archivist (HP_Archivist) joins
01:04:38flashfire42 (flashfire42) joins
01:07:01tzt joins
01:07:14maxfan8 (maxfan8) joins
01:09:28mutantmonkey (mutantmonkey) joins
01:10:03mutantmonkey quits [Remote host closed the connection]
01:10:20mutantmonkey (mutantmonkey) joins
01:10:51mutantmonkey quits [Remote host closed the connection]
01:11:10mutantmonkey (mutantmonkey) joins
01:11:12Hackerpcs (Hackerpcs) joins
01:13:05Arcorann (Arcorann) joins
01:14:54Matthww joins
01:19:31Ryz (Ryz) joins
01:21:01kiska (kiska) joins
01:21:01@ChanServ sets mode: +o kiska
01:26:05rsn joins
01:26:40mupf joins
01:37:53benjins joins
01:38:16Mateon1 joins
01:46:02atphoenix (atphoenix) joins
02:10:57betamax (betamax) joins
02:31:02etnguyen03 (etnguyen03) joins
02:48:37jodizzle quits [Changing host]
02:48:37jodizzle (jodizzle) joins
02:57:47DLoader_ joins
02:57:58lennier2 joins
02:58:55yano1 (yano) joins
02:59:09deni_ (deni) joins
02:59:33RJHacker50274_ joins
02:59:35Jonimus quits [*.net *.split]
02:59:36Peetz0r quits [*.net *.split]
02:59:36kpcyrd quits [*.net *.split]
02:59:36@Kaz quits [*.net *.split]
02:59:37@Fusl_ quits [*.net *.split]
02:59:37mgrandi quits [*.net *.split]
02:59:37yano quits [*.net *.split]
02:59:37RJHacker50274 quits [*.net *.split]
02:59:39@chfoo quits [*.net *.split]
02:59:39DLoader quits [*.net *.split]
02:59:39Barto quits [*.net *.split]
02:59:39celestial_ quits [*.net *.split]
02:59:39@kiskaWee1 quits [*.net *.split]
02:59:39lennier1 quits [*.net *.split]
02:59:40@arkiver quits [*.net *.split]
02:59:40ftl quits [*.net *.split]
02:59:41ThisAsYou quits [*.net *.split]
02:59:42girst quits [*.net *.split]
02:59:43brad quits [*.net *.split]
02:59:44themadpro quits [*.net *.split]
02:59:45Muad-Dib quits [*.net *.split]
02:59:46purplebot quits [*.net *.split]
02:59:46FalconK quits [*.net *.split]
02:59:46Sanqui quits [*.net *.split]
02:59:46summerisle quits [*.net *.split]
02:59:46deni quits [*.net *.split]
02:59:47pmlo quits [*.net *.split]
02:59:47brad joins
02:59:47ThisAsYou joins
02:59:47themadpro (themadpro) joins
02:59:48DLoader_ is now known as DLoader
02:59:48RJHacker50274_ is now known as RJHacker50274
02:59:48lennier2 is now known as lennier1
02:59:48deni_ is now known as deni
02:59:49girst_ (girst) joins
02:59:53celestial joins
02:59:53arkiver (arkiver) joins
02:59:56@ChanServ sets mode: +o arkiver
02:59:56Kaz (Kaz) joins
02:59:59@ChanServ sets mode: +o Kaz
02:59:59Peetz0r (Peetz0r) joins
03:00:01chfoo (chfoo) joins
03:00:02@ChanServ sets mode: +o chfoo
03:00:08Barto (Barto) joins
03:00:09Sanqui joins
03:00:11ftl joins
03:00:12kiskaWee1 (kiska) joins
03:00:14@ChanServ sets mode: +o kiskaWee1
03:00:20Muad-Dib joins
03:00:24pmlo joins
03:00:28purplebot joins
03:00:40mgrandi (mgrandi) joins
03:01:01kpcyrd (kpcyrd) joins
03:01:04FalconK (FalconK) joins
03:01:13summerisle (summerisle) joins
03:01:51Jonimus joins
03:17:42whatever joins
03:18:11whatever quits [Remote host closed the connection]
04:02:58wickedplayer494 joins
04:03:00Doranwen joins
04:05:20<@jrwr>Starting a little archival work of beatsaver.com
04:05:38<@jrwr>Its a JS heavy API driven website, so WARC is mostly out of the question... mostly
04:07:50<@jrwr>I'm scraping the main API backwards to get a list of all current songs in the database. then ill work on WARCing them
04:38:17Doranwen quits [Client Quit]
04:38:31Doranwen joins
04:53:56etnguyen03 quits [Client Quit]
06:15:27<@JAA>I mean, unless it's WebSocket based, the API interaction could still be put into WARC.
06:16:08<@jrwr>Yeah that's what I'm thinking. It's got pretty bad API limits in place so I'm doing a low and slow
06:16:11<@JAA>Whether that's worth it is another question. But if it's unauthenticated and has metadata, I'd say it'd be nice.
06:17:48<@jrwr>Yep it has metadata. It's unauthenticated and it has gone mysteriously down at times
06:17:56<@jrwr>Matter of fact the owners are technically unknown
06:18:14<@jrwr>The API is pretty much just a MongoDB endpoint
06:31:27<@jrwr>Most people use the website just as an API point to begin with since it's really just mod hosting. They do have a stats page, The whole thing's about 768 gigs
06:32:29<@jrwr>And 4.3 million page hits per day
06:35:56<@jrwr>https://stats.beatsaver.com/
07:28:19ragu joins
07:46:14mgrandi quits [Read error: Connection reset by peer]
07:47:00mgrandi (mgrandi) joins
08:19:28qw3rty joins
08:36:44OrIdow6 quits [Ping timeout: 240 seconds]
08:39:33OrIdow6 (OrIdow6) joins
09:14:16HP_Archiv joins
09:14:25HP_Archiv quits [Remote host closed the connection]
09:44:22hooway joins
10:30:46Mateon1 quits [Remote host closed the connection]
10:30:51Mateon1 joins
10:38:07RJHacker50274 quits [Client Quit]
10:38:52revi (revi) joins
10:53:57fuzzy802 joins
10:53:57fuzzy8021 quits [Killed (NickServ (GHOST command used by fuzzy802!~fuzzy8021@173-224-26-244.ptcnet.net))]
10:57:01luckcolors quits [Ping timeout: 244 seconds]
10:57:07luckcolors (luckcolors) joins
10:57:32@JAA quits [Ping timeout: 244 seconds]
10:57:32VerifiedJ quits [Ping timeout: 244 seconds]
10:57:32Craigle quits [Ping timeout: 244 seconds]
10:58:53JAA (JAA) joins
10:58:53@ChanServ sets mode: +o JAA
11:06:39VerifiedJ (VerifiedJ) joins
11:38:07Zerote joins
11:45:01alexshpilkin (alexshpilkin) joins
11:50:39<alexshpilkin>hi! what’s the status of the Gitorious archive? it’s been down for close to a year, apparently, but I can find no status updates past “we made a mirror, it should be online”
12:35:58Matthww quits [Client Quit]
12:38:36Matthww joins
12:55:35<OrIdow6>alexshpilkin: Not completely sure what's going on with that (long before my time here), but if you need something from there https://archive.softwareheritage.org/ apparently was sent a copy
12:56:11<@Kaz>alexshpilkin: I think the usual vibe is 'it can be fixed if required', but usually comes with a question of 'why haven't you moved away from it yet'
12:56:24<@Kaz>I understand it's a bit error-prone, so needs some love to keep running (for very little use)
13:06:52<alexshpilkin>Kaz: I never used it much in the first place, but I’ve just come across a link to it in StackOverflow comments for a thing that seemed useful
13:07:17<alexshpilkin>(and apparently isn’t saved by the Wayback Machine)
13:08:36<alexshpilkin>Orldow6: oh, thanks. their posts linked to https://softwareheritage.org/archive/, which points at the API documentation. didn’t know they had a web interface as well
13:10:18<alexshpilkin>yes, it’s there, thanks
13:13:31<alexshpilkin>* if I may make a suggestion, maybe putting up a static page at / that links to Software Heritage and a 404 page that links to / at gitorious.org would be a relatively low-effort way to keep old links useful
13:14:35<alexshpilkin>(setting up more detailed URL rewrites left as an exercise for the reader...)
13:59:24Arcorann quits [Ping timeout: 240 seconds]
14:02:21etnguyen03 (etnguyen03) joins
14:51:59etnguyen03 quits [Ping timeout: 265 seconds]
14:52:15etnguyen03 (etnguyen03) joins
15:39:59<anarcat>i edited a page in the wiki and it seems i'm being moderated
15:40:04<anarcat>i wonder if that's normal
15:40:14<anarcat>page is https://archiveteam.org/index.php?title=Flickr
15:41:16<@kiska>Yes that is normal
15:51:47Matthww quits [Client Quit]
15:55:23<anarcat>tx
16:25:02Craigle (Craigle) joins
16:48:15EggplantN is now known as EggplantN_
17:13:22<purplebot>Discourse edited by Themadprogramer (+42, /* Active Discourses */) just now -- https://www.archiveteam.org/?diff=45997&oldid=45899
17:13:22<purplebot>Flickr edited by Anarcat (+131, /* Backup Tools */ add gallery-dl) just now -- https://www.archiveteam.org/?diff=45998&oldid=43207
17:13:37<@JAA>anarcat: You're automoderated now.
17:14:15<anarcat>awesome, thanks
17:47:25Ryz quits [Remote host closed the connection]
17:50:29Craigle quits [Read error: Connection reset by peer]
17:53:09VerifiedJ quits [Read error: Connection reset by peer]
18:01:20Ryz (Ryz) joins
18:33:49VerifiedJ (VerifiedJ) joins
18:45:42alexshpilkin quits [Client Quit]
18:57:22<purplebot>Webzdarma edited by Sanqui (+25, add part 17 /* ArchiveBot jobs …) just now -- https://www.archiveteam.org/?diff=46002&oldid=45920
19:14:53Matthww joins
19:18:44Aoede quits [Changing host]
19:18:44Aoede (Aoede) joins
19:43:26Craigle (Craigle) joins
19:55:28<EggplantN_>HCross #findelmundo
19:56:19<EggplantN_>Possibly start today
19:57:21<@HCross>ok
19:58:25<EggplantN_>Smack Jeeves has been requeued. Final 5k
20:00:43<Matthww>EggplantN_ out of curiousity how many IP's/concurrent workers were you running for Smackjeeves?
20:00:49<@HCross>too many
20:01:06<EggplantN_>1 IP. Many concurrent
20:01:10<Matthww>whaaat
20:01:27<Matthww>I had 14 ip's each running around 120 workers
20:01:30<EggplantN_>In fact I think I've just crashed them
20:01:54<Matthww>and I was doing 1/8th of you
20:02:49<Matthww>Atleast I'm 2nd place :)
20:08:17yano1 is now known as yano
20:37:25girst_ is now known as girst
20:39:22Matthww quits [Client Quit]
20:43:34Matthww joins
21:18:13<betamax>welp, sploder just announced an official shutdown: http://forums.sploder.com/index.php/topic,346613.0.html
21:18:18<betamax>tldr: main site now read-only (may not be shut down completely), all comments removed, forums going on Jan 1st
21:18:23<betamax>I will update the wiki page but thank you JAA / Ryz for help getting those games / members / comments archived in the last couple of days
21:18:30<betamax>we didn't get everything, but we got most of it!
21:26:20wessel1512 joins
21:32:21<@JAA>Oof
21:32:29<@JAA>Well, I think we did get all comments at least.
21:41:47Mateon1 quits [Remote host closed the connection]
21:42:02Mateon1 joins
21:50:44<Ryz>Mhm ><;
22:19:29godane (godane) joins
22:23:22<purplebot>Discourse edited by Themadprogramer (+45) just now -- https://www.archiveteam.org/?diff=46003&oldid=45997
22:24:22<purplebot>File:Endomondo-icon.png uploaded by Arkiver (+0) just now -- https://www.archiveteam.org/?diff=46004&oldid=0
22:24:24<betamax>JAA: not all the comments - those grabs through archivebot only got the last page of comments for all games and users (so no comments for groups, and no non-last pages of comments for anything else)
22:24:56<betamax>in a discussion the admin has indicated they may put the comments back online if they see value in it, I will message them and see what happens
22:27:42<@JAA>Oh, right.
22:33:34godane quits [Client Quit]
22:33:52<EggplantN_>Orldow6 got some logs for smackjeeves
22:33:55<EggplantN_>Final few bad items
22:34:42<EggplantN_>https://paste.ee/p/HJyGi
22:34:49<EggplantN_>lots of 403 around images
22:42:31<EggplantN_>I've requeued everything and set limit to 0
22:42:39<EggplantN_>For when you are ready to restart
22:55:49<atphoenix>if they can set the forum read only...that'd also be good...
23:06:46EggplantNBot joins
23:12:43rsn_ joins
23:15:04rsn quits [Ping timeout: 240 seconds]
23:15:35Arcorann (Arcorann) joins
23:18:52lunik1 quits [Client Quit]
23:19:18lunik1 joins
23:24:22<purplebot>Sploder edited by Betamax (+838, Updated with official Sploder shutdown …) just now -- https://www.archiveteam.org/?diff=46005&oldid=45953

HomeSearchPrevious dayNext day