HomeSearchPrevious dayNext day

00:21:45Wohlstand quits [Client Quit]
01:40:02LddPotato quits [Remote host closed the connection]
01:41:48LddPotato (LddPotato) joins
02:11:33nicolas17 quits [Quit: Konversation terminated!]
02:19:58nicolas17 joins
02:40:09<kiska>fuzzy80211: I moved and made smaller the leaderboard
02:47:07lunik12 joins
02:47:47<fuzzy80211>thanks kiska
02:50:31lunik1 quits [Ping timeout: 260 seconds]
02:50:31lunik12 is now known as lunik1
03:06:54Naruyoko5 quits [Quit: Leaving]
03:09:13<@OrIdow6>It sounds unlikely that E621.net will go down if they have plans, and that if it does we'll have plenty of notice
03:10:02<@OrIdow6>Nonetheless if does I'd like to do it (tho if it went down like, this weekend I would not have the time at all)
03:10:11<@OrIdow6>THo the site seems kinda ABable
03:14:56Naruyoko joins
03:20:26<nicolas17>hm optane10 has been full for hours
03:32:54hackbug quits [Remote host closed the connection]
03:37:39Naruyoko5 joins
03:41:16Naruyoko quits [Ping timeout: 260 seconds]
03:55:36hackbug (hackbug) joins
03:57:39Megame quits [Quit: Leaving]
04:09:02khaoohs quits [Read error: Connection reset by peer]
04:12:15dabs joins
04:25:54dabs quits [Client Quit]
04:29:13<h2ibot>SoyGODSwon uploaded File:Sharty.png: https://wiki.archiveteam.org/?title=File%3ASharty.png
04:29:14<h2ibot>SoyGODSwon uploaded File:Sharty favicon.png: https://wiki.archiveteam.org/?title=File%3ASharty%20favicon.png
04:31:13<h2ibot>SoyGODSwon created Soyjak.party (+3950, worked on this in notepad): https://wiki.archiveteam.org/?title=Soyjak.party
04:32:13<h2ibot>SoyGODSwon edited 4chan (+1): https://wiki.archiveteam.org/?diff=55637&oldid=55633
04:32:14<h2ibot>FounderOfBeans edited List of websites excluded from the Wayback Machine/Partial exclusions (+31): https://wiki.archiveteam.org/?diff=55638&oldid=55582
04:40:16ericgallager quits [Quit: This computer has gone to sleep]
04:40:36<@arkiver>the posts of e621.net seem to be sequential, if right there seem to be 'only' some 5.6 million posts
04:41:27<@arkiver>if ArchiveBot can archived it well (as mentioned by OrIdow6 ), i'd be fine with getting a quick copy now already with ArchiveBot
04:41:34<@arkiver>it's likely not too large
04:43:06<pokechu22>arkiver: the database dump is probably the most useful thing for it
04:43:19<nicolas17>there is a database dump?
04:43:27<pokechu22>IIRC normal navigation adds tags, which would make things a mess
04:43:47<pokechu22>Yes, see https://e926.net/wiki_pages/2425 - it's at https://e621.net/db_export/
04:44:08<@arkiver>pokechu22: did ArchiveBot finish a copy of https://e621.net/db_export/ ?
04:44:13<pokechu22>Yes
04:44:13<@arkiver>yes agreed
04:44:22<@arkiver>but - a copy of the web pages would be good too
04:44:29<pokechu22>ok, right, https://e926.net/posts -> https://e926.net/posts/5575697 but also https://e926.net/posts?tags=clothing -> https://e926.net/posts/5575697?q=clothing which would be a mess
04:44:38<pokechu22>Note that the DB export *doesn't* include images directly, just post IDs and other metadata
04:44:54<pokechu22>also https://e926.net/posts?tags=flash
04:45:12<nicolas17>I assume the idea is using the db export to get the list of URLs to archive, rather than recursive crawling
04:45:31<@arkiver>i did not have that idea
04:45:33<@arkiver>but fine with me
04:46:05<pokechu22>going to be away for a few minutes
04:46:07<nicolas17>who can look into optane10? I've had voa files trying to upload for 3 hours
04:47:02<nicolas17>if it's saturated with uploads then fine, we're making progress; just making sure it's not a full disk and a stuck warc packer :P
04:48:27<@arkiver>nicolas17: likelihood is high that's it's stuck yeah
04:48:31<@arkiver>i pinged some people
04:49:36<nicolas17>hm looking at the voa dashboard I see a lot of multi-gigabyte items completing
04:51:51<nicolas17>1.25GiB/min, maybe everyone is uploading video items
04:56:17cyanbox joins
04:58:53<@arkiver>nicolas17: interesting, yeah, that is some significant amount of stuff coming in
05:04:39Naruyoko joins
05:04:52<nicolas17>ok throughput just increased 10x, did someone add another target? :D
05:06:39<nicolas17>or 30x... that was some impressive unclogging
05:07:47Naruyoko5 quits [Ping timeout: 258 seconds]
05:12:07sec^nd quits [Remote host closed the connection]
05:12:30sec^nd (second) joins
05:17:21Chris50109 (Chris5010) joins
05:19:51Chris5010 quits [Ping timeout: 260 seconds]
05:19:51Chris50109 is now known as Chris5010
05:39:05lennier2 joins
05:41:54lennier2_ quits [Ping timeout: 258 seconds]
05:53:45pleasearchive joins
05:53:47<pleasearchive>Please archive: https://www.deviantart.com/avchonline/
05:53:53ericgallager joins
05:54:05<pleasearchive>Is anything being done about this? https://wiki.archiveteam.org/index.php?title=Flickr&oldid=55528
05:54:12pleasearchive quits [Client Quit]
06:07:29nicolas17_ joins
06:10:01nicolas17 quits [Ping timeout: 260 seconds]
06:40:50Island quits [Read error: Connection reset by peer]
06:55:38ericgallager quits [Client Quit]
07:07:29ericgallager joins
07:12:03<chrismrtn>There is also a stats page at https://e621.net/stats - 4,865,983 posts (excluding deleted ones, but comments and tags still exist on deleted posts, so they may be worth getting too), 9.84 TB of media
07:16:25<chrismrtn>Additionally, some items require being logged in to view, but again the comments and tags will still show up regardless.
07:36:53<@imer>nicolas17_: so, speeds are back to normal for you?
08:48:44Dada joins
09:14:44ConstantK quits [Quit: Ping timeout (120 seconds)]
09:15:06ConstantK joins
10:00:07MrMcNuggets (MrMcNuggets) joins
10:02:10Lunarian1 (LunarianBunny1147) joins
10:04:52LunarianBunny1147 quits [Ping timeout: 258 seconds]
10:05:08ConstantK quits [Client Quit]
10:05:23ConstantK joins
10:08:35<Snivy>pokechu22 LMK what the current plan is with E6, saw some chatter in here earlier about it
10:09:25<Snivy>chrismrtn: You can get around the logged in requirement with an API key or an account according to the API docs
10:10:58ConstantK quits [Client Quit]
10:11:10ConstantK joins
10:55:33etnguyen03 (etnguyen03) joins
11:00:03Bleo182600722719623455 quits [Quit: The Lounge - https://thelounge.chat]
11:02:46Bleo182600722719623455 joins
11:25:47etnguyen03 quits [Client Quit]
11:33:48ericgallager quits [Quit: This computer has gone to sleep]
11:49:19icedice quits [Read error: Connection reset by peer]
11:49:51CYBERDEV_ quits [Read error: Connection reset by peer]
11:50:21icedice (icedice) joins
11:50:27CYBERDEV joins
12:39:38khaoohs joins
12:53:34cyanbox quits [Read error: Connection reset by peer]
12:57:59Naruyoko5 joins
13:01:58Naruyoko quits [Ping timeout: 258 seconds]
13:02:17Naruyoko joins
13:03:01Naruyoko5 quits [Ping timeout: 260 seconds]
13:12:59Naruyoko5 joins
13:16:55Naruyoko quits [Ping timeout: 258 seconds]
14:02:29Wohlstand (Wohlstand) joins
14:17:06nicolas17_ quits [Ping timeout: 260 seconds]
14:40:11Naruyoko joins
14:42:46Naruyoko5 quits [Ping timeout: 260 seconds]
15:11:32jasons7 quits [Ping timeout: 258 seconds]
15:22:09jasons7 (jasons) joins
15:27:41riteo quits [Ping timeout: 260 seconds]
15:47:57Riku_V quits [Ping timeout: 258 seconds]
15:50:20Riku_V (riku) joins
15:51:45nicolas17_ joins
15:55:23IceCodeNew|m joins
16:23:58riteo (riteo) joins
16:40:16ericgallager joins
17:03:38<pokechu22>Snivy: an archivebot !ao < list job with a list generated from the DB export. I think the md5 and possibly file_ext columns are enough to generate such a list, though I'm not 100% sure how that works with flash and videos and thumbnail
17:06:08<Snivy>gatcha, flash stuff is just the raw flash file as the site no longer embeds them, im not sure for videos
17:06:49<pokechu22>That should only hit static content, and not the API/frontend, so hopefully it's cheaper and we can run it faster than the 2 requests/second rate limit mentioned on https://e926.net/wiki_pages/2425
17:06:52grill (grill) joins
17:10:10fuzzy8021 (fuzzy80211) joins
17:10:27fuzzy80211 quits [Read error: Connection reset by peer]
17:14:22<h2ibot>HadeanEon edited Deaths in 2000 (+400, BOT - Updating page: {{saved}} (117),…): https://wiki.archiveteam.org/?diff=55639&oldid=55477
17:14:23<h2ibot>HadeanEon edited Deaths in 2000/list (+29, BOT - Updating list): https://wiki.archiveteam.org/?diff=55640&oldid=55478
17:27:24<h2ibot>HadeanEon edited Deaths in 2002/list (-2, BOT - Updating list): https://wiki.archiveteam.org/?diff=55641&oldid=55121
17:32:25<h2ibot>HadeanEon edited Deaths in 2003 (+372, BOT - Updating page: {{saved}} (5),…): https://wiki.archiveteam.org/?diff=55642&oldid=55434
17:32:26<h2ibot>HadeanEon edited Deaths in 2003/list (+26, BOT - Updating list): https://wiki.archiveteam.org/?diff=55643&oldid=55008
17:38:26<h2ibot>HadeanEon edited Deaths in 2004/list (+1, BOT - Updating list): https://wiki.archiveteam.org/?diff=55644&oldid=55480
17:41:30Island joins
17:45:27<h2ibot>HadeanEon edited Deaths in 2005 (+834, BOT - Updating page: {{saved}} (9),…): https://wiki.archiveteam.org/?diff=55645&oldid=55436
17:45:28<h2ibot>HadeanEon edited Deaths in 2005/list (+52, BOT - Updating list): https://wiki.archiveteam.org/?diff=55646&oldid=54687
17:51:28<h2ibot>HadeanEon edited Deaths in 2006 (+417, BOT - Updating page: {{saved}} (7),…): https://wiki.archiveteam.org/?diff=55647&oldid=55437
17:51:29<h2ibot>HadeanEon edited Deaths in 2006/list (+39, BOT - Updating list): https://wiki.archiveteam.org/?diff=55648&oldid=55438
17:58:07dabs joins
18:04:30<h2ibot>HadeanEon edited Deaths in 2008/list (+44, BOT - Updating list): https://wiki.archiveteam.org/?diff=55649&oldid=55482
18:09:05DogsRNice joins
18:16:32<h2ibot>HadeanEon edited Deaths in 2009 (+424, BOT - Updating page: {{saved}} (8),…): https://wiki.archiveteam.org/?diff=55650&oldid=55441
18:16:33<h2ibot>HadeanEon edited Deaths in 2009/list (+27, BOT - Updating list): https://wiki.archiveteam.org/?diff=55651&oldid=55127
18:29:34BornOn420 quits [Remote host closed the connection]
18:30:23BornOn420 (BornOn420) joins
18:34:09nicolas17_ is now known as nicolas17
18:40:35<h2ibot>HadeanEon edited Deaths in 2010 (+1184, BOT - Updating page: {{saved}} (204),…): https://wiki.archiveteam.org/?diff=55652&oldid=55483
18:40:36<h2ibot>HadeanEon edited Deaths in 2010/list (+72, BOT - Updating list): https://wiki.archiveteam.org/?diff=55653&oldid=55484
18:42:51nine quits [Quit: See ya!]
18:43:03nine joins
18:43:03nine quits [Changing host]
18:43:03nine (nine) joins
18:44:17Megame (Megame) joins
18:56:02Webuser943935 joins
18:58:09Webuser943935 quits [Client Quit]
19:01:38<h2ibot>HadeanEon edited Deaths in 2011/list (+0, BOT - Updating list): https://wiki.archiveteam.org/?diff=55654&oldid=55486
19:16:23funderscore (funderscore) joins
19:22:47<h2ibot>HadeanEon edited Deaths in 2012 (+403, BOT - Updating page: {{saved}} (195),…): https://wiki.archiveteam.org/?diff=55655&oldid=55487
19:22:48<h2ibot>HadeanEon edited Deaths in 2012/list (+29, BOT - Updating list): https://wiki.archiveteam.org/?diff=55656&oldid=55488
19:26:00<@OrIdow6>Fairly dramatic decline in the volume of stackoverflow questions over the last few years - https://blog.pragmaticengineer.com/stack-overflow-is-almost-dead/ and their refutation of it https://meta.stackoverflow.com/questions/433864/do-you-agree-with-gergely-that-stack-overflow-is-almost-dead
19:26:56<@OrIdow6>As people point out, it's experiencing the "Wikipedia Effect" of more and more obvious questions already having been answered, but as good as that may be I don't think it speaks too well to profit opportunity
19:31:00ericgallager quits [Client Quit]
19:39:41grill quits [Ping timeout: 260 seconds]
19:40:49<h2ibot>HadeanEon edited Deaths in 2013 (+366, BOT - Updating page: {{saved}} (211),…): https://wiki.archiveteam.org/?diff=55657&oldid=55489
19:40:50<h2ibot>HadeanEon edited Deaths in 2013/list (+27, BOT - Updating list): https://wiki.archiveteam.org/?diff=55658&oldid=55490
19:50:11nine quits [Ping timeout: 260 seconds]
19:52:36nine joins
19:52:37nine quits [Changing host]
19:52:37nine (nine) joins
19:58:52<h2ibot>HadeanEon edited Deaths in 2014 (-524, BOT - Updating page: {{saved}} (15),…): https://wiki.archiveteam.org/?diff=55659&oldid=55448
19:58:53<h2ibot>HadeanEon edited Deaths in 2014/list (-36, BOT - Updating list): https://wiki.archiveteam.org/?diff=55660&oldid=55449
20:09:00Snivy quits [Ping timeout: 258 seconds]
20:14:02Snivy (Snivy) joins
20:20:31lennier2_ joins
20:23:01lennier2__ joins
20:23:11lennier2 quits [Ping timeout: 258 seconds]
20:23:43PredatorIWD25 quits [Read error: Connection reset by peer]
20:25:02lennier2___ joins
20:25:36Lunarian1 is now known as LunarianBunny1147
20:25:46lennier2_ quits [Ping timeout: 260 seconds]
20:26:56<h2ibot>HadeanEon edited Deaths in 2015 (-290, BOT - Updating page: {{saved}} (316),…): https://wiki.archiveteam.org/?diff=55661&oldid=55450
20:26:57<h2ibot>HadeanEon edited Deaths in 2015/list (-32, BOT - Updating list): https://wiki.archiveteam.org/?diff=55662&oldid=55451
20:27:24lennier2__ quits [Ping timeout: 258 seconds]
20:28:31lennier2_ joins
20:31:14lennier2___ quits [Ping timeout: 258 seconds]
20:32:06lennier2 joins
20:34:41lennier2_ quits [Ping timeout: 258 seconds]
20:35:35lennier2_ joins
20:36:25NatTheCat (NatTheCat) joins
20:38:36lennier2 quits [Ping timeout: 260 seconds]
20:40:46FiTheArchiver joins
20:48:00<h2ibot>HadeanEon edited Deaths in 2016 (+972, BOT - Updating page: {{saved}} (131),…): https://wiki.archiveteam.org/?diff=55663&oldid=55452
20:48:01<h2ibot>HadeanEon edited Deaths in 2016/list (+42, BOT - Updating list): https://wiki.archiveteam.org/?diff=55664&oldid=55491
20:50:20chunkynutz6 quits [Quit: The Lounge - https://thelounge.chat]
20:51:46chunkynutz6 joins
21:04:02^ quits [Remote host closed the connection]
21:04:05^ (^) joins
21:08:56^ quits [Ping timeout: 260 seconds]
21:10:05^ (^) joins
21:10:58camrod636 (camrod) joins
21:12:03MrMcNuggets quits [Quit: WeeChat 4.3.2]
21:12:26camrod63 quits [Ping timeout: 260 seconds]
21:12:26camrod636 is now known as camrod63
21:17:41^ quits [Ping timeout: 260 seconds]
21:18:35^ (^) joins
21:21:05<h2ibot>HadeanEon edited Deaths in 2017 (+866, BOT - Updating page: {{saved}} (373),…): https://wiki.archiveteam.org/?diff=55665&oldid=55492
21:21:06<h2ibot>HadeanEon edited Deaths in 2017/list (+125, BOT - Updating list): https://wiki.archiveteam.org/?diff=55666&oldid=55493
21:31:55etnguyen03 (etnguyen03) joins
21:32:15FiTheArchiver1 joins
21:34:06FiTheArchiver quits [Ping timeout: 258 seconds]
21:36:48^ quits [Remote host closed the connection]
21:36:59^ (^) joins
21:45:48Wohlstand quits [Quit: Wohlstand]
21:47:31^ quits [Ping timeout: 258 seconds]
21:53:42^ (^) joins
21:55:10<h2ibot>HadeanEon edited Deaths in 2018 (+1100, BOT - Updating page: {{saved}} (457),…): https://wiki.archiveteam.org/?diff=55667&oldid=55337
21:55:11<h2ibot>HadeanEon edited Deaths in 2018/list (+79, BOT - Updating list): https://wiki.archiveteam.org/?diff=55668&oldid=55338
22:05:18etnguyen03 quits [Client Quit]
22:08:38etnguyen03 (etnguyen03) joins
22:25:28Dada quits [Ping timeout: 258 seconds]
22:35:15FiTheArchiver1 quits [Client Quit]
22:36:16<h2ibot>HadeanEon edited Deaths in 2019 (+76, BOT - Updating page: {{saved}} (490),…): https://wiki.archiveteam.org/?diff=55669&oldid=55494
22:36:17<h2ibot>HadeanEon edited Deaths in 2019/list (-3, BOT - Updating list): https://wiki.archiveteam.org/?diff=55670&oldid=55495
22:46:56ericgallager joins
22:49:51pleasearchive joins
22:49:54<pleasearchive>Please archive: https://www.deviantart.com/avchonline/
22:49:57<pleasearchive>Is anything being done about this? https://wiki.archiveteam.org/index.php?title=Flickr&oldid=55528
22:52:37<nicolas17>I don't know if we have a way to archive deviantart
23:14:41etnguyen03 quits [Client Quit]
23:15:22<h2ibot>HadeanEon edited Deaths in 2020 (+597, BOT - Updating page: {{saved}} (57),…): https://wiki.archiveteam.org/?diff=55671&oldid=55456
23:15:23<h2ibot>HadeanEon edited Deaths in 2020/list (+6, BOT - Updating list): https://wiki.archiveteam.org/?diff=55672&oldid=55496
23:22:31jasons7 quits [Ping timeout: 260 seconds]
23:23:12pleasearchive quits [Client Quit]
23:23:29Webuser819913 quits [Quit: Ooops, wrong browser tab.]

HomeSearchPrevious dayNext day