HomeSearchPrevious dayNext day

00:00:22<pokechu22>looks like http://www.random.fora.pl/ itself isn't listed on there, but that's reasonable since it's not "supposed to" be an actual forum presumably
00:00:56<flashfire42>http://www.icewarriors.fora.pl/ well the random forum isnt very good
00:02:24<pokechu22>it looks like the catalog in the sidebar orders them by the number of posts, which is also good for getting an idea of how big some of them are.
00:02:51wickedplayer494 joins
00:03:40<pokechu22>This is probably a situation where !a < list would be nice if it weren't completely broken :|
00:03:41<mikolaj|m>the list of the forums should be also obtainable by scraping the "katalog"
00:25:50lennier1 quits [Ping timeout: 252 seconds]
01:57:15dumbgoy joins
02:10:00justmolamola joins
02:32:20AmAnd0A quits [Read error: Connection reset by peer]
02:32:42AmAnd0A joins
03:07:42dumbgoy quits [Ping timeout: 258 seconds]
03:35:02nicolas17 quits [Ping timeout: 252 seconds]
03:35:09DigitalDragons (DigitalDragons) joins
03:42:30nicolas17 joins
04:05:35Ketchup901 quits [Remote host closed the connection]
04:05:47Ketchup901 (Ketchup901) joins
04:14:53<yts98>I'm looking for an operator with ArchiveBot access to save the list of games I provide for Game Atsumaru.
04:14:53<yts98>The lists I want to archive are data/public.txt, data/public_payment.txt, data/key_valid.txt in https://github.com/yts98/game-atsumaru-discovery.
04:14:53<yts98>This site will close in 47 hours.
04:18:32<yts98>https://ch.nicovideo.jp/indies-game will be taken down together definitly, and https://atsumaru.github.io/api-references/ https://github.com/atsumaru are possibly in danger.
04:19:25<flashfire42>yts98 3tt38940863qg137qhybq2xbe see this job on the dashboard It is already running
04:19:49dumbgoy joins
04:20:58<flashfire42>and yts98 #gitgud for Github stuff
04:21:12<yts98>Got it, thanks for your help!
04:21:29<flashfire42>I dont know how to throw in those lists you provided or if I need ops to do it
04:22:12<flashfire42>Granted its at concurrency 1 because I cant actively babysit it. but it should run through a lot
04:22:57<yts98>Also, I'm sweeping its API to discover dynamically loaded danmaku comments and scoreboards. I would have an API url list later.
04:23:09<flashfire42>I am gonna try doing the lists you gave us too
04:24:22<yts98>data/key_valid.txt are unlisted games found on Google.
04:24:22<yts98>And also, I'm doing static analysis for the game to discover lazily loaded resources,
04:24:46graham quits [Client Quit]
04:25:24<yts98>but they're guarded by the session cookie: https://wiki.archiveteam.org/index.php/Niconico#Game_loading_mechanism
04:26:27<yts98>so when I have the resource lists, they cannot be digested by Archive Bot of WBM SPN directly.
04:28:51<yts98>so jobs e83a218c9a0dff1eac9a5c1f641eee49 9301dfd206dc1b81e97b8593564d63e9 will be all 404
04:41:42Island quits [Read error: Connection reset by peer]
04:47:11<vokunal|m>Ever since I posted like 100 links in the telegrab chat this happened https://imgur.com/a/ePYCcur
04:47:39<vokunal|m>I completely broke the chat. It's on matrix too, so leaving the room didn't fix it
04:49:14Ketchup901 quits [Remote host closed the connection]
04:49:40Ketchup901 (Ketchup901) joins
04:55:34<fireonlive>oh no
04:59:09<fireonlive>there's a 'clear cache and reload' button in the advanced section of settings (bottom) but i'm not entirely sure what it does other than what it sounds like (clear the entire cache/room states for all rooms on all servers)
05:01:39<fireonlive>this never happened, but a comment on https://github.com/vector-im/element-web/issues/5800 says "initial sync (same thing the clear cache & reload does)" so i mean it could take a long time depending how you use matrix (and depending on hackint retention you could lose older messages) so perhaps look for a solution from elsewhere before touching
05:01:40<fireonlive>the big red button
05:03:32<thuban>yts98: you may want to use grab-site (https://github.com/ArchiveTeam/grab-site/) or just wget to handle the resources gated by the session cookie--both can accept cookies and output warcs
05:03:37<thuban>said warcs won't be whitelisted and can't go in the wbm, but you can still upload them to the internet archive for safekeeping
05:05:22<thuban>(the wbm can't play back post requests, so the games wouldn't work through it anyway)
05:06:37<yts98>thuban: I'm currently using my scripts to let wget produce warcs, but my bandwidth is relatively limited :/
05:13:41<thuban>i have to go afk for now, but if (it's necessary and) you upload the details of your wget process to your github repo, i will help save stuff on my fat pipe tomorrow
05:14:28<fireonlive>:3
05:15:13<vokunal|m>I'll look into it. hackint.org works fine, and I never really browsed telegrab
05:24:22Ivan226 joins
05:24:31<Ivan226>someone get these for me thanks https://transfer.archivete.am/BXpPB/honkaiwiki-newlinks.txt https://transfer.archivete.am/S8TgV/honkaiwiki-newfiles.txt
05:29:36<fireonlive>vokunal|m: kk
05:30:07<fireonlive>might even be able to have fun with sqlite ™ or something (but ya know be sure to backup)
06:14:17gfhh joins
06:20:25Megame (Megame) joins
06:34:11<vokunal|m>tartarus needs to put his stuff on downthetube, not mediafire. I've been silently crying since I saw them join it, knowing they'd eventually cement a spot out of the top list forever, and now they've finally passed me by .01TiB
06:44:04nicolas17 quits [Ping timeout: 265 seconds]
07:00:03nfriedly quits [Remote host closed the connection]
07:08:17BlueMaxima quits [Read error: Connection reset by peer]
07:40:15IDK (IDK) joins
07:49:20IDK quits [Max SendQ exceeded]
07:50:07IDK (IDK) joins
08:22:17Arcorann (Arcorann) joins
08:31:44qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
08:45:52hitgrr8 joins
08:53:30AmAnd0A quits [Remote host closed the connection]
08:53:30yts98 leaves
08:53:39yts98 joins
08:53:43AmAnd0A joins
09:10:02Naruyoko quits [Ping timeout: 265 seconds]
09:19:42Megame quits [Client Quit]
09:29:53nfriedly joins
10:00:01railen63 quits [Remote host closed the connection]
10:00:18railen63 joins
10:22:47gfhh quits [Ping timeout: 258 seconds]
10:24:12<h2ibot>Yts98 edited Niconico (+708, Saving Game Atsumaru): https://wiki.archiveteam.org/?diff=50014&oldid=50006
10:24:42gfhh joins
10:32:28Ketchup901 quits [Remote host closed the connection]
10:32:42Ketchup901 (Ketchup901) joins
10:51:30Chris5010 (Chris5010) joins
11:27:07yano quits [Quit: WeeChat, the better IRC client, https://weechat.org/]
11:27:24yano (yano) joins
11:46:44wickedplayer494 quits [Ping timeout: 258 seconds]
11:46:44yts98 leaves
11:46:51yts98 joins
11:50:03wickedplayer494 joins
12:06:39beario joins
12:06:40beario_ joins
12:12:38beario quits [Client Quit]
12:37:37railen63 quits [Remote host closed the connection]
12:40:29railen63 joins
12:46:03justmolamola quits [Remote host closed the connection]
12:48:30AmAnd0A quits [Ping timeout: 265 seconds]
12:48:34AmAnd0A joins
12:52:53justmolamola joins
12:53:33justmolamola quits [Remote host closed the connection]
13:05:14bilboed quits [Quit: The Lounge - https://thelounge.chat]
13:18:57bilboed joins
13:19:36katocala quits [Remote host closed the connection]
13:23:46katocala joins
13:42:47Arcorann quits [Ping timeout: 252 seconds]
14:17:32Island joins
14:36:26spirit joins
15:03:04Naruyoko joins
15:17:08<h2ibot>Switchnode edited Niconico (+13, /* Game Atsumaru */ correct archiving type): https://wiki.archiveteam.org/?diff=50015&oldid=50014
15:17:45<thuban>yts98: back, ping me if you want me to run something
15:30:25AmAnd0A quits [Ping timeout: 265 seconds]
15:30:32AmAnd0A joins
15:31:17<yts98>thuban: you can run step6-MV_iterate_.py on github.com/yts98/game-atsumaru-discovery at first.
15:31:17<yts98>you can specify the gameId range, and it will find game resources for 61% of the games.
15:37:12Dango360 (Dango360) joins
15:38:24spirit quits [Client Quit]
15:45:41<thuban>yts98: is there an id range i should choose to avoid duplicating your work, or have you not run this step yet?
15:47:23<yts98>I only run a little (3~190), so you could archive all the RPGMaker MV games.
15:50:14<yts98>I'm going to analyze RPGMakerMZ and EasyRPG, and I'm still looking for many volunteers to analyze other game frameworks, or find scraping tools off the shelf
15:50:52<@arkiver>off the shelf scraping tools for this type of stuff can be difficult
15:51:12<@arkiver>especially when it comes to archiving work where one really needs to make sure all required URLs are preserved
15:52:08<yts98>Agree. other games use Akashic Engine, TyranoBuilder, Unity and others. I guess there may be some tools for Unity?
15:53:59Ruthalas5 (Ruthalas) joins
15:57:23<thuban>yts98: ok, running
16:14:13<thuban>yts98: i'm seeing a lot of 404s on some games (eg 191); is this correct or is there a problem with the script?
16:15:28<yts98>it's correct because some creators removed resources but not removed their reference from the script
16:16:59<thuban>ok, good
16:18:56<yts98>the script you're running is also doing plugin statistics across the games, in order to find out rarely used plugins that may point to more resources.
16:23:11foo3457dt6yicio7 joins
16:24:53foo3457dt6yicio7 quits [Remote host closed the connection]
16:34:23pabs quits [Ping timeout: 252 seconds]
16:35:00pabs (pabs) joins
16:42:50spirit joins
17:40:25kdy quits [Quit: Fly Away~]
17:42:00spirit quits [Read error: Connection reset by peer]
17:45:11kdy (kdy) joins
18:50:48spirit joins
18:52:11<thuban>yts98: i am working on ids 191-6500, but my provider is having some storage issues i need to work around, so if you or anyone else wants to grab another id range, that would be helpful
18:53:14<thuban>(unfortunately i think the bottleneck here is not client-side bandwidth; 12x parallelized i've gotten ~230 games down so far)
19:11:42<@arkiver>in other words - site is too slow?
19:12:35<thuban>not sure, suspect that python/wget could also be more efficient
19:43:22<thuban>yts98: error on game 262: https://transfer.archivete.am/qVG89/atsumaru_262.log
19:44:01AmAnd0A quits [Read error: Connection reset by peer]
19:44:18AmAnd0A joins
19:45:52<thuban>ditto 4053
19:46:18<thuban>and 5047
19:47:40<thuban>5533 has a different error due to a bad start byte: https://transfer.archivete.am/DclPO/atsumaru_5533.log
19:57:04killsushi joins
19:59:01<thuban>ditto 1695
19:59:27<thuban>(just dumping the ids here so i know what i've skipped)
20:03:39<thuban>4078 has the dict error
20:11:00none joins
20:11:33<none>hello is anyone on
20:25:02<thuban>1116 has a different error: https://transfer.archivete.am/2uLFe/atsumaru_1116.log
20:29:12yts98 leaves
20:29:15yts98 joins
20:43:22ZhalekXishailri13 joins
20:43:29ZhalekXishailri13 quits [Remote host closed the connection]
20:54:32@rewby quits [Ping timeout: 252 seconds]
20:58:49fuzzy8021 quits [Read error: Connection reset by peer]
20:59:24Bleo quits [Quit: Ping timeout (120 seconds)]
20:59:25fuzzy8021 (fuzzy8021) joins
20:59:28rewby (rewby) joins
20:59:28@ChanServ sets mode: +o rewby
20:59:40Bleo joins
21:07:25<tzt>tiki.video is shutting down tomorrow https://techcrunch.com/2023/06/11/tiki-india/
21:09:08<@arkiver>what
21:09:38<@arkiver>how many hours do we have?
21:09:51<@arkiver>eef this articles was posted June 11 and we didn't know
21:10:37<@JAA>Oof
21:10:39<@arkiver>and we didn't know about this either https://techcrunch.com/2023/02/24/xiaomi-zili-app-shutdown/
21:11:39<@arkiver>rewby: i hope you are still around
21:11:43<@arkiver>we have a deadline for tomorrow
21:11:52<@arkiver>can someone please figure out how many hours we have left given timezones?
21:12:07<tzt>21 hours
21:12:07<@arkiver>> We regret to inform you that Tiki will be shutting down its operations. As of 11.59 PM India time, June 27, 2023, all Tiki functions and services will cease
21:12:10<Barto>oh crap
21:12:12<@arkiver>alright
21:12:33<@arkiver>rewby: we need an urgent target
21:12:38<@arkiver>archiveteam_tiki_
21:12:39<@arkiver>tiki_
21:12:42<@arkiver>Archive Team Tiki:
21:13:50<@arkiver>let's make a channel
21:13:54<@arkiver>i have no ideas
21:14:02<@arkiver>we'll get at least metadata
21:14:31<@arkiver>tzt: how did you find out about this? i wonder how we can better monitor for this in the future
21:15:54<tzt>arkiver: shutting down OR "closing down" AND site OR service OR server after:2023-05-30
21:16:21<tzt>tiki'd off ?
21:16:56<@JAA>Ah, India Time, one of those lovely half-hour-offset-because-fuck-you-that's-why time zones.
21:17:21<@JAA>2023-06-27 18:29 UTC
21:17:27<Barto>oh boy
21:17:34<Barto>tikingbomb
21:20:53@arkiver is rushing something together
21:21:12<@arkiver>blegh much of this is POST requests
21:21:17<Barto>i've thrown some stuffs into ab
21:21:34<Barto>it aint much, but it's honest work
21:22:51<@JAA>I have a German feces and football pun, but that's not a good idea. :-P
21:23:24<@JAA>I like tikingbomb.
21:23:43<@arkiver>JAA: please do tell
21:23:49<@JAA>tiki-kacka
21:23:55<fireonlive>google says lei'dback
21:23:57<fireonlive>lol
21:24:08<@arkiver>JAA: i'm for tiki-kacka given this SHITTY timing
21:24:14<@JAA>lol
21:24:15<@arkiver>ticking shit bomb
21:24:16<Barto>arkiver: interesting thing that ab spotted: a load of videos can be found via sitemap
21:24:29<@arkiver>Barto: very nice!
21:24:31<@JAA>I mean, I'm fine with that. :-P
21:24:33<manu|m>wait what’s the football part in this?
21:24:38<@arkiver>#tiki-kacka
21:24:58<@JAA>manu|m: Tiki Taka is a football play strategy thingy. The Spanish national team is well-known for it.
21:25:23<Barto>also titicaca lake is a thing
21:25:31<Barto>almost sounds the same
21:27:00<manu|m>JAA: oh okay i just don’t know enough about football then, i can live with that. thought for a moment I was stupid or sth ;)
21:27:34<fireonlive>🏈 this kind, right? ;)
21:27:41<fireonlive>:D
21:28:00<@JAA>No, football, not handegg. :-)
21:28:28<fireonlive>:3
21:28:35<fireonlive>⚽ there ya go
21:34:53W7RFa6AbNFz_ quits [Read error: Connection reset by peer]
21:35:10W7RFa6AbNFz_ joins
21:46:23<@arkiver>datechnoman: we might need you at #tiki-kacka
21:53:48<datechnoman>arkiver - Joining channel now
21:56:25<yts98>thuban: my new commit b2cf0ff fixs game 262 1116 5533. going to deal with 4078.
21:59:49<thuban>yts98: thanks! 4078 is the same error, the other one was 5533, 1695, and now 2755
22:00:27<thuban>(did you mean 5047?)
22:03:14<yts98>thuban: 1695 5047 also work now
22:03:27<h2ibot>JustAnotherArchivist created Tiki (+471, Created page with "{{Infobox project | URL =…): https://wiki.archiveteam.org/?title=Tiki
22:03:28<h2ibot>JustAnotherArchivist edited Deathwatch (+20, /* 2023 */ Add Tiki): https://wiki.archiveteam.org/?diff=50017&oldid=50005
22:05:48<thuban>yts98: i assume i should keep my local copy of data/MV_plugins.json, but what about data/iterate/urls_gm*.txt ?
22:08:06<thuban>nvm, appear to be identical
22:08:08<yts98>I thought the url list data/iterate/urls_gm*.txt could be sent to operators trusted by IA, but you can freely delete them because urls can be derived form warcs
22:08:33<thuban>do those urls work without the session cookie?
22:08:36<yts98>s/form/from
22:09:09<yts98>no, they must be fetched with session cookie
22:09:38<yts98>and I wonder whether the session cookie is binding with IP
22:13:02AmAnd0A quits [Ping timeout: 265 seconds]
22:13:38AmAnd0A joins
22:47:17hogchips_ quits [Ping timeout: 252 seconds]
22:47:35hogchips (shoghicp) joins
22:52:58<thuban>yts98: https://transfer.archivete.am/L5IEb/atsumaru_703.log
22:53:44nicolas17 joins
22:55:51Ketchup901 quits [Ping timeout: 245 seconds]
22:56:20Ketchup901 (Ketchup901) joins
23:04:05AmAnd0A quits [Ping timeout: 258 seconds]
23:05:08AmAnd0A joins
23:07:00sepro quits [Quit: Bye!]
23:08:13<yts98>thuban: commit 2e4fc6c fix 703.
23:10:03<yts98>there is new step6-ER_iterate_.py that can be run in parallel for 299 RM2000/RM2003 games.
23:11:59hitgrr8 quits [Client Quit]
23:15:52<yts98>oh no, data/tmp conflicts. I'll fix it.
23:20:31sepro (sepro) joins
23:25:46tiger_billionaire joins
23:29:05tiger_millionaire quits [Ping timeout: 252 seconds]
23:38:25Unholy236131 (Unholy2361) joins
23:42:17Unholy23613 quits [Ping timeout: 252 seconds]
23:42:17Unholy236131 is now known as Unholy23613
23:45:48<yts98>wget url list file conflicts fixed (for Atsumaru).
23:47:38<thuban>i'm elbow deep in the storage thing, so you probably want to run ER yourself
23:51:03BlueMaxima joins
23:51:56BlueMaxima quits [Read error: Connection reset by peer]
23:52:14BlueMaxima joins
23:54:03lk quits [Ping timeout: 265 seconds]
23:54:52lk (lk) joins
23:58:04<yts98>thuban: got it. start running ER and start analyzing RMMZ.
23:59:48<h2ibot>Ryz edited Deathwatch (+104, /* 2023 */ Add Microsoft Language Portal): https://wiki.archiveteam.org/?diff=50018&oldid=50017

HomeSearchPrevious dayNext day