HomeSearchPrevious dayNext day

00:00:12tzt (tzt) joins
00:08:16BlueMaxima_ joins
00:11:35BlueMaxima quits [Ping timeout: 252 seconds]
00:39:15susu joins
00:46:09DogsRNice joins
00:57:44<flashfire42>is tracker supposed to be paused still?
01:42:19<rktk>blah-ray.blogspot.com
01:42:32<rktk>https://wiki.archiveteam.org/index.php/Blogger#Downloading_a_single_blog_with_Wget
01:42:47<rktk>the updated script here for blogspot does not seem to dowload all the articles as found on this blog. it only grabs maybe... 10 ish.
01:42:57<rktk>am I doing something wrong? or should I just poke the wikibot
01:43:03W7RFa6AbNFz quits [Read error: Connection reset by peer]
02:25:49<h2ibot>TheTechRobo edited Dev/New Project (+1234, Add some more details; feel free to correct me…): https://wiki.archiveteam.org/?diff=50469&oldid=48530
02:30:44dumbgoy quits [Ping timeout: 252 seconds]
02:30:50<h2ibot>TheTechRobo edited Dev/Seesaw (+311, Note that much of this is outdated and that the…): https://wiki.archiveteam.org/?diff=50470&oldid=23600
02:31:50<h2ibot>TheTechRobo edited Dev/Tracker (+38, Improve the link to the Docker container): https://wiki.archiveteam.org/?diff=50471&oldid=50326
02:37:32HP_Archivist quits [Client Quit]
02:39:34susu quits [Remote host closed the connection]
02:42:41<@arkiver>something is not right with backfeed yet
02:44:00<flashfire42>Yeah I thought that was still the case
02:44:52<h2ibot>Arkiver uploaded File:Gfycat-icon.jpg: https://wiki.archiveteam.org/?title=File%3AGfycat-icon.jpg
02:45:19<nicolas17>remember to ramp up the rate limit slowly when we come back...
02:48:13<fireonlive>9999999999999999/sec tbh
02:48:48<nicolas17>problem is flashfire42 alone will get all those 9999999999999999
02:48:54<nicolas17>then get banned
02:49:11<nicolas17>then kill the targets with the sudden upload flood
02:49:50<nicolas17>we should buy arkiver one of these to adjust the rate limit https://m.media-amazon.com/images/I/61a9wzv6VnL._AC_UF894,1000_QL80_.jpg
02:49:54<flashfire42> https://server8.kiska.pw/uploads/91b08eb93179162f/I%20aplogise%20for%20nothing.mp4
02:51:10<fireonlive>flashfire42: :D
02:54:56Naruyoko quits [Ping timeout: 252 seconds]
02:56:27PL12 joins
02:57:51<TheTechRobo>we need a big red button for the admins to set the ratelimit to 0
03:02:19<nicolas17>TheTechRobo: those exist too
03:02:28<TheTechRobo>Ik :P
03:02:30<nicolas17>button needs a molly-guard too
03:02:33<nicolas17>for full aesthetics
03:02:46<TheTechRobo>someone in the Uplink discord did that for a 'Disconnect' binding
03:02:50<PL12> Los Angeles Radio People (www.laradio.com), a website about radio personalities that could be heard on Los Angeles radio stations will shut down for a second time, this time permanently, because of the owner's liver cancer spreading. Source: https://old.reddit.com/r/LosAngeles/comments/15qbofu/la_radio_website_closing_host_is_leaving/
03:02:52Naruyoko joins
03:04:09<PL12>www.laradio.com is excluded from the WB, and archive today has a partial backup
03:04:27geezabiscuit quits [Read error: Connection reset by peer]
03:04:43geezabiscuit (geezabiscuit) joins
03:05:00<PL12>www.laradio.com's Archives access is paid
03:06:08PL12 quits [Remote host closed the connection]
03:06:12fireonlive is now known as \
03:06:16<nicolas17>TheTechRobo: I saw someone who got a toilet flush pull chain to disconnect from the video call
03:06:54<\>nice
03:07:52<nicolas17>https://hackaday.com/2020/12/28/a-pull-chain-to-end-your-zoom-pain/
03:09:56<TheTechRobo>nicolas17: https://transfer.archivete.am/inline/5atUg/2023-07-12_22-20-12.mp4
03:10:03<TheTechRobo>(not my video)
03:12:30<\>video is their own person, and does'nt belong to anyone
03:12:36<@arkiver>\: nice
03:12:42<\>:3
03:12:46susu joins
03:12:53<@arkiver>JAA: ^ :P
03:33:59atphoenix quits [Ping timeout: 252 seconds]
03:51:19DogsRNice quits [Read error: Connection reset by peer]
04:17:41kiryu quits [Remote host closed the connection]
04:19:09kiryu joins
04:36:23whoami quits [Quit: Someone reboot me.]
04:37:46whoami (whoami) joins
04:40:43lflare quits [Ping timeout: 265 seconds]
04:50:37lflare (lflare) joins
04:58:35dumbgoy joins
05:00:07Letur quits [Remote host closed the connection]
05:01:07Letur joins
05:04:21Letur quits [Remote host closed the connection]
05:04:43Letur joins
05:04:57Island quits [Read error: Connection reset by peer]
05:06:26<project10>how does one set the rsync_threads value when running a pipeline manually/through docker (i.e. not the warrior with its config UI)? Do I need to use "--context-value"?
05:16:52BearFortress_ joins
05:18:00Exorcism (exorcism) joins
05:20:08BearFortress quits [Ping timeout: 252 seconds]
05:30:31\ is now known as fireonlive
05:32:54<Video>\: what lmao
05:33:29<DigitalDragons>project10: You shouldn't need to mess with rsync stuff. When running through docker you should use this command or similar: docker run -d --name X --label=com.centurylinklabs.watchtower.enable=true --restart=unless-stopped atdr.meo.ws/archiveteam/X-grab --concurrent 6 DigitalDragon
05:33:46<DigitalDragons>(obviously, replace DigitalDragon with your own username, and replace 6 with the concurrency you want to run at)
05:33:57<DigitalDragons>(and X is the project name)
05:35:00<DigitalDragons>Running the projects on bare metal (ie, without docker) isn't supported anymore
05:36:38<fireonlive>Video: :D
05:36:40<appledash>Which is stupid mind you
05:37:02<fireonlive>is it though
05:37:29<fireonlive>delicious yummy consistent environments mmmmmmmmm
05:37:39<fireonlive>😋
05:38:09<DigitalDragons>fireonlive stop eating the docker containers
05:38:33<DigitalDragons>they don't contain food
05:38:34<DigitalDragons>:p
05:38:44katocala quits [Remote host closed the connection]
05:38:51<fireonlive>*mouth full* they don't?
05:42:56<aninternettroll>they have _laaayers_
05:43:08<Exorcism>😭
05:44:02Letur quits [Remote host closed the connection]
05:44:21Letur joins
05:47:20katocala joins
06:02:07fireonlive is now known as \
06:24:30medecau quits [Ping timeout: 258 seconds]
06:25:07dumbgoy quits [Ping timeout: 265 seconds]
06:25:11xarph_ joins
06:25:26medecau (medecau) joins
06:27:32xarph quits [Ping timeout: 265 seconds]
06:38:13<Video>is it just becoming a common occurrence for people to jokingly ping me lol
06:48:41nicolas17 quits [Client Quit]
06:52:04<\>Video: cant believe you killed the radio star tbh
06:53:24<Video>you are not the first to make that joke I'm afraid
06:53:58<\>darn
06:54:12<\>for the zoomers: https://youtu.be/W8r-tXRLazs
06:59:04Arcorann (Arcorann) joins
07:00:08nfriedly quits [Remote host closed the connection]
07:04:53railen64 joins
07:05:02Unholy23613166180 quits [Remote host closed the connection]
07:06:23Unholy23613166180 (Unholy2361) joins
07:12:56<project10>DigitalDragons: sorry, I wasn't clear. I am not running it 'bare metal', it's through a docker-compose setup. Still, I'm wondering, is it possible to tweak rsync_threads via docker args/env, like I can with the warrior ui?
07:16:19JohnnyJ joins
07:16:22<@rewby|backup>project10: To what end? For what purpose?
07:22:09<project10>to hammer the targets ;)
07:22:38<project10>just finding that the default of 2 didn't keep up with a concurrency of 20, e.g. on the urls project
07:23:24<project10>what is the purpose of exposing the tunable in the warrior ui?
07:33:50<@rewby|backup>Ask arkiver
07:34:01<@rewby|backup>But usually, people are fine with concurrency 2
07:34:13<@rewby|backup>Although I think the default could be like 6 or whatever
07:34:30W7RFa6AbNFz joins
07:34:40<@rewby|backup>But iirc its 2 per pipeline?
07:35:09<@rewby|backup>Oh actually
07:35:26Exorcism|Core quits [Ping timeout: 252 seconds]
07:35:40<project10>seems to be, yeah. it's just a shitty ovh kimsufi, it seems they throttle individual flows. Aggregate I can do 100mbps but individual tcp flows are only like 5-10mbps
07:35:43<@rewby|backup>arkiver: I think you have rsync threads set as a typo in urls grab. Default is 20 in other projects and only 2 for urls.
07:36:26<@rewby|backup>project10: Looks like it's a typo. It's 20 on all other projects as a default.
07:36:31<project10>seems to be 2 for youtube-grab as well
07:37:23<@rewby|backup>Interesting
08:04:43jacksonchen666 quits [Client Quit]
08:04:57yts98 leaves
08:05:05yts98 joins
08:07:20Megame quits [Ping timeout: 252 seconds]
08:46:23Arcorann quits [Ping timeout: 252 seconds]
08:48:25Arcorann (Arcorann) joins
09:20:02BlueMaxima_ quits [Read error: Connection reset by peer]
09:29:36vitzli (vitzli) joins
09:52:34AmAnd0A quits [Remote host closed the connection]
09:52:50AmAnd0A joins
09:54:33nfriedly joins
10:00:01railen64 quits [Remote host closed the connection]
10:00:17railen64 joins
10:04:50railen63 joins
10:06:29railen64 quits [Ping timeout: 265 seconds]
10:09:23JohnnyJ quits [Ping timeout: 265 seconds]
10:13:32JohnnyJ joins
10:36:03qwertyasdfuiopghjkl quits [Client Quit]
10:37:40qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
10:53:12qwertyasdfuiopghjkl quits [Client Quit]
10:55:07qwertyasdfuiopghjkl (qwertyasdfuiopghjkl) joins
11:24:18kiryu quits [Ping timeout: 265 seconds]
11:24:29kiryu joins
11:38:14Exorcism|Core (exorcism) joins
11:38:35toss (toss) joins
11:42:48bf_ joins
12:12:17<immibis>throttling flows isn't necessarily a hosting thing, it could also be a configuration thing at either end
12:12:28<immibis>there's a whole thing about TCP and "bandwidth delay product"
12:13:09<immibis>where if it's high, one end sends the maximum amount of data it's willing to send without an acknowledgement, and then has to wait for an acknowledgement before it sends more. There are supposed to be algorithms to avoid this being a problem, but...
12:19:10toss quits [Client Quit]
12:54:21W7RFa6AbNFz quits [Read error: Connection reset by peer]
12:54:40W7RFa6AbNFz joins
12:56:08xarph_ quits [Ping timeout: 265 seconds]
13:21:52Megame (Megame) joins
14:02:28BigBrain quits [Remote host closed the connection]
14:02:47BigBrain (bigbrain) joins
14:03:08<nstrom|m>Do we want to unpause telegram, reddit, imgur now that backfeed is fixed?
14:06:21<@arkiver>rewby|backup: do we want to up it to 20? fine with me
14:06:48<@arkiver>historically it used to be lower so slow connections don't clog things up
14:53:57Island joins
15:11:20\ is now known as fireonlive
15:24:43vitzli quits [Client Quit]
15:40:32Arcorann quits [Ping timeout: 252 seconds]
16:04:29<@rewby|backup>arkiver: Make it like 10 for now
16:05:39dumbgoy joins
16:18:10AmAnd0A quits [Ping timeout: 265 seconds]
16:18:43AmAnd0A joins
16:21:39BearFortress_ quits [Client Quit]
16:45:54Exorcism|Core quits [Read error: Connection reset by peer]
16:46:10Exorcism|Core (exorcism) joins
16:46:20Core8585 (exorcism) joins
16:46:42Core8585 quits [Remote host closed the connection]
16:47:42<@arkiver>rewby|backup: alright, will update the projects
16:50:23Exorcism|Core quits [Ping timeout: 252 seconds]
16:56:17BearFortress joins
17:10:20Exorcism|Core (exorcism) joins
17:17:34@Sanqui_ is now known as @Sanqui
17:21:32fangfufu quits [Read error: Connection reset by peer]
17:39:30gfhh joins
17:42:55nicolas17 joins
17:57:48AmAnd0A quits [Read error: Connection reset by peer]
17:58:00AmAnd0A joins
18:04:59Exorcism|Core quits [Read error: Connection reset by peer]
18:05:28Exorcism|Core (exorcism) joins
18:06:01Core6392 (exorcism) joins
18:06:21Core6392 quits [Remote host closed the connection]
18:10:18Exorcism|Core quits [Ping timeout: 265 seconds]
18:11:47AmAnd0A quits [Ping timeout: 252 seconds]
18:11:49AmAnd0A joins
18:27:11bf_ quits [Ping timeout: 252 seconds]
18:27:18treora quits [Remote host closed the connection]
18:27:18treora joins
18:39:50<h2ibot>FireonLive edited Current Projects (+0, move Gfycat to current): https://wiki.archiveteam.org/?diff=50473&oldid=50456
18:41:51<h2ibot>FireonLive edited Gfycat (+109, let's-a-go!): https://wiki.archiveteam.org/?diff=50474&oldid=50353
18:48:15AmAnd0A quits [Read error: Connection reset by peer]
18:48:33AmAnd0A joins
18:53:52<h2ibot>FireonLive edited Current Projects (+0, Move DPReview to on haitus?): https://wiki.archiveteam.org/?diff=50475&oldid=50473
19:01:35xarph joins
19:15:52DogsRNice joins
19:26:50<nicolas17>btw during the tracker downtime, a lot of items accumulated in the reddit tracker
19:28:02<nicolas17>so we could use some more workers there - but don't spend extra money or stop other projects for it :P
19:28:38<Barto>why not both? :-)
19:29:13<nicolas17>run it in parallel to other projects!
19:30:29<Barto>*exactly*
19:30:46<Barto>*run all projects*, except url-grab if its your home internet
19:45:31nicolas17 quits [Ping timeout: 265 seconds]
19:48:46nicolas17 joins
19:53:37<nicolas17>reddit pushing 200MiB/s
20:28:05PergolaWorld joins
20:30:49<nicolas17>reddit ETA 20h
20:33:53PergolaWorld quits [Remote host closed the connection]
20:35:45<fireonlive>12:40:51 PM -+rss- We mourn the loss of Stefan Tilkov: https://www.innoq.com/en/news/2023/08/stefan-tilkov-english/ https://news.ycombinator.com/item?id=37124373
20:59:23<project10>what is the "round trip time" in the context of the tracker? rtt to/from where?
21:00:23ThetaDev quits [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
21:00:30ThetaDev joins
21:00:54<nicolas17>I think it's average time between someone getting an item and returning it completed
21:01:02<nicolas17>but it might not be "average"
21:01:19<project10>ah, so end to end time of an item/claim?
21:05:06Exorcism quits [Client Quit]
21:30:19eafaefaew quits [Remote host closed the connection]
21:33:40fche leaves [Leaving]
21:42:34hauntedwagon joins
21:42:45<hauntedwagon>Hi
21:42:58<hauntedwagon>Does anyone here know who ran Blingee?
21:45:24hauntedwagon quits [Remote host closed the connection]
21:51:53tttc joins
21:52:34katocala quits [Remote host closed the connection]
22:07:28nicolas17 quits [Read error: Connection reset by peer]
22:08:06nicolas17 joins
22:13:14pabs quits [Ping timeout: 252 seconds]
22:15:54pabs (pabs) joins
23:00:38<h2ibot>JAABot edited CurrentWarriorProject (-1): https://wiki.archiveteam.org/?diff=50476&oldid=50433
23:17:42AmAnd0A quits [Ping timeout: 265 seconds]
23:18:13AmAnd0A joins
23:22:03AmAnd0A quits [Read error: Connection reset by peer]
23:22:34AmAnd0A joins
23:28:17BlueMaxima joins
23:53:20Perk quits [Ping timeout: 252 seconds]

HomeSearchPrevious dayNext day