HomeSearchPrevious dayNext day

00:01:07APOLLO03 joins
00:13:14Webuser824872 quits [Quit: Ooops, wrong browser tab.]
00:14:12nine quits [Quit: See ya!]
00:14:42nine joins
00:27:40wickedplayer494 (wickedplayer494) joins
01:28:34Webuser670001 joins
01:28:37<Webuser670001>https://xcancel.com/gelbooru/status/2069889788908331451
01:28:41Webuser670001 leaves
01:37:01<nicolas17>oh no
01:55:32useretail__ joins
01:57:35useretail_ quits [Ping timeout: 248 seconds]
02:18:54skankhunt42 quits [Quit: Ping timeout (120 seconds)]
02:19:14skankhunt42 (skankhunt42) joins
02:29:24nine quits [Client Quit]
02:29:39nine joins
02:38:21rohvani quits [Quit: Ping timeout (120 seconds)]
02:38:37rohvani joins
03:24:16DogsRNice quits [Read error: Connection reset by peer]
03:31:19PredatorIWD81 joins
03:32:41Island quits [Read error: Connection reset by peer]
03:33:06nine quits [Client Quit]
03:33:20nine joins
03:33:53PredatorIWD8 quits [Ping timeout: 268 seconds]
03:33:53PredatorIWD81 is now known as PredatorIWD8
04:25:48skankhunt42 quits [Client Quit]
04:26:03skankhunt42 (skankhunt42) joins
04:54:31balrog quits [Quit: Bye]
04:57:34balrog (balrog) joins
05:45:55nexussfan quits [Remote host closed the connection]
06:00:56rohvani quits [Quit: The Lounge - https://thelounge.chat]
06:04:27rohvani joins
06:20:35Justin[home] (DopefishJustin) joins
06:21:31cyan_box quits [Read error: Connection reset by peer]
06:22:14DopefishJustin quits [Ping timeout: 268 seconds]
06:23:32cyanbox joins
07:14:35Wohlstand (Wohlstand) joins
07:22:47scotrod2 quits [Quit: The Lounge - https://thelounge.chat]
07:24:15scotrod2 joins
08:07:04BornOn420 quits [Ping timeout: 268 seconds]
08:16:04<h2ibot>Cruller edited Anubis/uncategorized (+76, Added colnect.com redlib.pussthecat.org…): https://wiki.archiveteam.org/?diff=62827&oldid=62715
08:28:39ThreeHM quits [Ping timeout: 268 seconds]
08:28:39Doomaholic quits [Read error: Connection reset by peer]
08:29:25Doomaholic (Doomaholic) joins
08:30:07scotrod2 quits [Client Quit]
08:41:53beastbg8__ joins
08:45:55beastbg8_ quits [Ping timeout: 268 seconds]
08:56:06amphitryon joins
08:58:32scotrod2 joins
08:58:52amphitryon_ quits [Ping timeout: 268 seconds]
09:01:51Wohlstand quits [Client Quit]
09:02:22nine quits [Quit: See ya!]
09:02:34ThreeHM (ThreeHeadedMonkey) joins
09:02:36nine joins
09:07:12Wohlstand (Wohlstand) joins
09:32:04<h2ibot>Usernam edited List of websites excluded from the Wayback Machine (+24, …): https://wiki.archiveteam.org/?diff=62828&oldid=62826
10:09:29<h2ibot>Manu edited Discourse/active (+76, https://bbs.aprbrother.com/ works in AB): https://wiki.archiveteam.org/?diff=62829&oldid=62805
10:09:30<h2ibot>Manu edited Discourse/lost (-89, https://bbs.aprbrother.com/ works in AB): https://wiki.archiveteam.org/?diff=62830&oldid=62806
10:29:11<c3manu>pagination on Gelbooru is limited, and sitemap.xml doesn't exist :|
10:29:25<c3manu>https://gelbooru.com/index.php?page=forum&s=view&id=1549 (via FAQ: https://gelbooru.com/index.php?page=forum&s=view&id=19 )
10:29:39<c3manu>https://gelbooru.com/index.php?page=post&s=list&tags=all&pid=12747924
10:29:45<c3manu>(for the error message)
10:29:59<c3manu>max is 20k pages per category
10:42:36<klea>What should we do about sites that have a exclusion notice, but don't pop up the this site has been excluded, but have no captures either?
10:43:05h|ca2 quits [Ping timeout: 268 seconds]
10:45:11h|ca2 (h) joins
11:00:16Bleo18260072271962345522201107 quits [Quit: The Lounge - https://thelounge.chat]
11:03:01Bleo18260072271962345522201107 joins
12:27:55benjins3__ quits [Ping timeout: 268 seconds]
12:55:34khaoohs__ joins
12:59:22khaoohs_ quits [Ping timeout: 268 seconds]
13:11:33Island joins
13:13:52<h2ibot>Cruller edited Samsung Open Source (+96, How to save as warcs /cc nicolas17): https://wiki.archiveteam.org/?diff=62833&oldid=60042
13:15:48<klea>cruller: (re SOS) Not sure we really want them as WARCs now.
13:15:58<h2ibot>Cruller edited Samsung Open Source (+0, fix typo): https://wiki.archiveteam.org/?diff=62834&oldid=62833
13:19:15<klea>Specially after having gotten 1TB of files from it as not-WARC, and the download link being a POST to <https://opensource.samsung.com/downSrcCode>.
13:19:21<cruller>klea: I had a feeling. I just thought it was an interesting example of using hCaptcha and Cloudflare together, so I gave it a try.
13:19:44<klea>Ah, yeah. Another issue we might get is harsher limiting.
13:21:33<klea>nicolas17: Is linking your download front thingy on the wiki a good idea?, I know it's been passed around a few times.
13:22:39<klea>cruller: Although capturing the hCaptcha samples sounds like a good idea.
13:23:57<klea>Oh, i'm stupid, the tracker link already links to that.
13:24:08<klea>klea bonk++
13:24:08<eggdrop>[karma] self karma is a selfish pursuit.
14:11:44Webuser177757 joins
14:12:19Webuser177757 quits [Client Quit]
14:22:33nexussfan (nexussfan) joins
14:30:54DLoader_ (DLoader) joins
14:34:57DLoader quits [Ping timeout: 268 seconds]
14:43:35ThreeHM quits [Ping timeout: 268 seconds]
14:45:13ThreeHM (ThreeHeadedMonkey) joins
14:51:59ThreeHM quits [Ping timeout: 248 seconds]
14:53:43ThreeHM (ThreeHeadedMonkey) joins
15:06:45Wohlstand quits [Remote host closed the connection]
15:15:17benjins3__ joins
16:10:17<justauser>X thread shows some purpose-made scraper: https://pbs.twimg.com/media/HLo1ltKWMAAUsg9.png?name=orig and probably https://github.com/catmandoe1/gelbooruScraper ?
16:19:41dabs joins
16:21:35<h2ibot>Manu edited Discourse/active (+61, https://aregames.art/ is alive): https://wiki.archiveteam.org/?diff=62835&oldid=62829
16:21:36<h2ibot>Manu edited Discourse/lost (-120, https://aregames.art/ is alive): https://wiki.archiveteam.org/?diff=62836&oldid=62830
16:31:04Webuser150466 joins
17:04:55nine quits [Quit: See ya!]
17:05:08nine joins
17:10:58<klea>https://github.com/catmandoe1/gelbooruScraper 404
17:13:55<justauser>Huh. Copied it from search without checking.
17:14:16<justauser>But you know where to find a copy.
17:14:38<pokechu22>Ryz pointed to https://github.com/LuanBogoqb/GelBoorou-Bulk-Downloader yesterday but it looks like it needs an API key
17:15:13<pokechu22>What would really be nice is a bulk DB export like e621 has, but I couldn't find one of those
17:16:53<klea>From irclogs.a.at, someone made a downloader thing based on Google Translate.
17:18:57<justauser>The one I linked doesn't seem to need API keys.
17:28:13Webuser150466 quits [Client Quit]
17:50:31nimaje quits [Quit: WeeChat 4.9.2]
17:52:54nimaje joins
17:57:01<nicolas17>current situation is basically "I watch for changes and get new releases from the samsung opensource website *manually*, except I outsource the actual download of the large files to others"
18:00:10<klea>That sounds like a lot of work.
18:00:23<klea>You should have somewhere where you meow when you add items, if you want I can give a url to post to.
18:01:35<justauser>I think this channel is the place?
18:01:56<justauser>There used to be automation, before Samsung blocked everything.
18:03:44<nicolas17>thing is
18:04:01<nicolas17>when they added captchas, I already had the popup for every item archived
18:04:14<nicolas17>so from there I had the filename and file size of everything
18:04:37n9nes quits [Ping timeout: 268 seconds]
18:04:53<nicolas17>so I made my samsung-grab thing to let others deal with the captcha and download the file, but I already had the metadata to put in the queue
18:05:06n9nes joins
18:06:27<nicolas17>I also crowdsourced items with a single file while I downloaded multi-file items myself
18:06:45<nicolas17>for new items added since then, I have to get the metadata first
18:11:24nimaje quits [Read error: Connection reset by peer]
18:16:59nimaje joins
18:19:30<klea>You want help getting metadata too?
18:22:23benjins3__ quits [Read error: Connection reset by peer]
18:36:12nine quits [Client Quit]
18:36:24nine joins
18:55:07Guest58 quits [Quit: My Mac has gone to sleep. ZZZzzz…]
19:07:42DogsRNice joins
19:19:14dabs quits [Ping timeout: 268 seconds]
19:20:09dabs joins
19:22:19moth3 quits [Ping timeout: 268 seconds]
19:33:45Radzig quits [Read error: Connection reset by peer]
19:40:17Radzig joins
19:50:41balrog quits [Ping timeout: 268 seconds]
19:52:44@imer quits [Killed (NickServ (GHOST command used by imer0))]
19:52:59imer (imer) joins
19:52:59@ChanServ sets mode: +o imer
20:00:49balrog (balrog) joins
20:01:03@imer quits [Killed (NickServ (GHOST command used by imer3))]
20:01:18imer (imer) joins
20:01:18@ChanServ sets mode: +o imer
20:06:07balrog quits [Client Quit]
20:09:53balrog (balrog) joins
20:30:54mls (mls) joins
20:36:47Radzig quits [Client Quit]
20:39:46Radzig joins
20:50:30rohvani quits [Ping timeout: 268 seconds]
20:51:02simon816 quits [Quit: ZNC 1.10.2 - https://znc.in]
20:56:06Aimnp2 joins
20:56:13Aimnp2 quits [Client Quit]
21:00:42simon816 (simon816) joins
21:01:36nyakase5 quits [Ping timeout: 268 seconds]
21:06:08BornOn420 (BornOn420) joins
21:17:14dabs quits [Read error: Connection reset by peer]
21:30:38thewinwin83 joins
21:31:12thewinwin8 quits [Ping timeout: 268 seconds]
21:31:15thewinwin83 is now known as thewinwin8
21:39:56benjins3 joins
21:43:04etnguyen03 (etnguyen03) joins
22:00:20McAfee joins
22:14:57driib975 quits [Quit: The Lounge - https://thelounge.chat]
22:18:17driib975 (driib) joins
22:26:50hexagonwin quits [Remote host closed the connection]
22:27:05hexagonwin (hexagonwin) joins
22:45:49Radzig quits [Ping timeout: 268 seconds]
22:51:52Webuser657881 joins
22:56:57Webuser657881 quits [Client Quit]
23:22:03etnguyen03 quits [Client Quit]
23:30:08thalia (thalia) joins
23:46:33<@arkiver>hexagonwin: do you know if there is a deadline on https://www.joongang.co.kr/ https://jtbc.co.kr/ ?
23:49:23Radzig joins
23:52:35<@arkiver>hexagonwin: for blice, do you have an example of one that does not require a login?

HomeSearchPrevious dayNext day