| 00:07:34 | | Arcorann (Arcorann) joins |
| 00:10:29 | | Arcorann quits [Remote host closed the connection] |
| 00:14:21 | | rocketdive quits [Remote host closed the connection] |
| 00:16:32 | | Arcorann (Arcorann) joins |
| 00:32:53 | | dm4v_ joins |
| 00:34:03 | | dm4v quits [Ping timeout: 265 seconds] |
| 00:34:03 | | dm4v_ is now known as dm4v |
| 00:42:09 | | driib quits [Quit: The Lounge - https://thelounge.chat] |
| 00:42:36 | | driib5 (driib) joins |
| 01:02:17 | | BlueMaxima joins |
| 01:02:40 | | dm4v_ joins |
| 01:04:01 | | dm4v quits [Ping timeout: 265 seconds] |
| 01:04:01 | | dm4v_ is now known as dm4v |
| 01:09:24 | | Gray_cat quits [Ping timeout: 246 seconds] |
| 01:14:29 | | Ryz20 (Ryz) joins |
| 01:14:31 | | s-crypt6 (s-crypt) joins |
| 01:15:22 | | Ryz2 quits [Client Quit] |
| 01:15:22 | | kiska quits [Client Quit] |
| 01:15:22 | | s-crypt quits [Client Quit] |
| 01:15:22 | | driib5 quits [Client Quit] |
| 01:15:22 | | dm4v quits [Client Quit] |
| 01:15:22 | | qwertyasdfuiopghjkl quits [Client Quit] |
| 01:15:23 | | Ryz20 is now known as Ryz2 |
| 01:15:23 | | s-crypt6 is now known as s-crypt |
| 01:15:27 | | driib5 (driib) joins |
| 01:15:27 | | dm4v joins |
| 01:15:28 | | kiska (kiska) joins |
| 01:24:44 | <@arkiver> | let's also use #recordedjournal for livejournal channel |
| 01:25:09 | <@arkiver> | do we have a source on the latest livejournal news? |
| 01:25:28 | | qwertyasdfuiopghjkl joins |
| 02:12:32 | | Gray_cat joins |
| 02:13:24 | | wickedplayer494 quits [Remote host closed the connection] |
| 02:23:07 | | La_Gatta_Grigia joins |
| 02:24:34 | | Deewiant_ (Deewiant) joins |
| 02:24:56 | | driib5 quits [Client Quit] |
| 02:24:56 | | Gray_cat quits [Remote host closed the connection] |
| 02:24:56 | | sknebel quits [Remote host closed the connection] |
| 02:24:56 | | dm4v quits [Client Quit] |
| 02:24:56 | | Deewiant quits [Remote host closed the connection] |
| 02:24:56 | | qwertyasdfuiopghjkl quits [Client Quit] |
| 02:24:59 | | dm4v joins |
| 02:25:02 | | driib5 (driib) joins |
| 02:25:48 | | sknebel (sknebel) joins |
| 02:29:29 | | Deewiant_ is now known as Deewiant |
| 02:32:10 | | driib59 (driib) joins |
| 02:32:23 | | driib5 quits [Read error: Connection reset by peer] |
| 02:32:23 | | driib59 is now known as driib5 |
| 02:35:28 | | wickedplayer494 joins |
| 03:29:59 | | nico_32 quits [Ping timeout: 265 seconds] |
| 03:58:16 | | nico_32 (nico) joins |
| 04:20:48 | | Discant joins |
| 04:29:33 | | La_Gatta_Grigia is now known as Gray_cat |
| 04:33:52 | <Gray_cat> | Similar question to rocketdive's - how come 10 GB was downloaded and only 4 unloaded for the telegram project? 6 GB of stylesheets got stripped away and only the message content was sent up? |
| 04:37:04 | | Discant quits [Remote host closed the connection] |
| 04:37:25 | | Discant joins |
| 04:40:56 | | qwertyasdfuiopghjkl joins |
| 04:58:02 | | Discant quits [Ping timeout: 245 seconds] |
| 05:11:47 | <@OrIdow6> | Compression |
| 05:13:52 | | Gray_cat quits [Ping timeout: 245 seconds] |
| 05:14:27 | <@OrIdow6> | Always a ping timeout |
| 05:24:28 | <Jake> | Heh |
| 05:36:18 | | Discant joins |
| 06:21:43 | | tzt (tzt) joins |
| 06:38:36 | | wickedplayer494 is now authenticated as wickedplayer494 |
| 08:42:53 | | Discant quits [Remote host closed the connection] |
| 08:42:53 | | dm4v quits [Client Quit] |
| 08:42:54 | | qwertyasdfuiopghjkl quits [Client Quit] |
| 08:42:58 | | dm4v_ joins |
| 08:43:01 | | DiscantX joins |
| 08:43:28 | | dm4v_ is now known as dm4v |
| 08:53:03 | | BlueMaxima quits [Client Quit] |
| 09:27:10 | | DiscantX quits [Ping timeout: 265 seconds] |
| 09:32:11 | | qwertyasdfuiopghjkl joins |
| 09:37:47 | | DiscantX joins |
| 11:08:23 | | mohsaid joins |
| 11:08:49 | <mohsaid> | Hi |
| 11:09:32 | <@OrIdow6> | Hello mohsaid, what can we do for you? |
| 11:10:01 | <mohsaid> | I have a question. |
| 11:10:40 | <@rewby> | We may have answers if you ask your question. :) |
| 11:15:22 | <@rewby> | Announcement: I'm doing maintenance on my infrastructure momentarily. Both my IRC and several systems required for target management will be offline for a few hours. Targets should keep running but if anything stops functioning, I can't fix it until this maintenance is done. |
| 11:16:58 | <mohsaid> | My website (occlub.org) had been archived automatically on the wayback machine, and it says that the website had been archived originally by the (Archive Team). My question is, does that mean that the Archive Team had a copy of my website? |
| 11:18:04 | <@OrIdow6> | mohsaid: ArchiveTeam generally does not keep copies of the websites we archived as we do not have enough storage ourselves; rather we upload them to archive.org |
| 11:18:14 | <@rewby> | We had a copy of the site as it was visible to the public. Depending on how we did the archive, we may have not kept the copy after we uploaded it to the IA. |
| 11:18:49 | <@OrIdow6> | Also, we may have made and uploaded a copy of a single page, or of the whole site, or of a section |
| 11:19:05 | <@rewby> | Judging by the dataset being archiveteam_urls, it'll be single pages |
| 11:19:20 | <@OrIdow6> | That's what it looks like |
| 11:19:28 | <@OrIdow6> | And news.html isn't in the WBM at all |
| 11:19:32 | <@rewby> | Yeah |
| 11:19:34 | <@OrIdow6> | *.php |
| 11:19:56 | <@rewby> | So no, we don't have a copy anymore because #// moves so fast |
| 11:21:02 | <mohsaid> | Thank you for your assistance:) |
| 11:21:09 | <thuban> | why do you ask? |
| 11:22:05 | <mohsaid> | Because I'm curious how they got to my website. |
| 11:22:47 | <thuban> | the urls project (channel #//, collection archiveteam_urls) collects outlinks from a variety of sources |
| 11:22:58 | <@rewby> | ^ |
| 11:23:06 | <@rewby> | outlinks being, someone linked to it |
| 11:23:09 | <@rewby> | So maybe someone posted it on reddit |
| 11:23:15 | <@rewby> | Or we found it on social media somewhere |
| 11:23:35 | <@rewby> | Or it was found as part of another project |
| 11:24:05 | <mohsaid> | Yes, I posted it on my Facebook group. |
| 11:24:17 | <@OrIdow6> | We don't do Facebook AFAIK |
| 11:24:35 | <@OrIdow6> | Too hard for a variety of reasons |
| 11:26:10 | | rewby|backup (rewby) joins |
| 11:26:10 | | @ChanServ sets mode: +o rewby|backup |
| 11:28:48 | <mohsaid> | Also, I am interested in whether you use a crawler bot or something like this to crawl websites that have been posted on (channel #//)? |
| 11:29:03 | <@rewby> | We have a big distributed crawler, yeah |
| 11:29:17 | <@rewby> | If you're interested, we can tell one of our bots to crawl and archive your entire site. |
| 11:30:42 | <mohsaid> | No problem if you want to |
| 11:31:29 | <mohsaid> | And what is the name of the crawler? |
| 11:31:48 | <@OrIdow6> | The one for smaller-scale sites like this is ArchiveBot |
| 11:31:59 | <@OrIdow6> | Well, the one rew_by's talking about |
| 11:32:07 | <@rewby> | Yep |
| 11:32:44 | <mohsaid> | Is that crawl open source? |
| 11:33:01 | <thuban> | https://wiki.archiveteam.org/index.php?title=ArchiveBot |
| 11:33:11 | <thuban> | yep! https://github.com/ArchiveTeam/ArchiveBot |
| 11:34:08 | <mohsaid> | Thank you everyone for the help :) |
| 11:34:19 | <thuban> | you're welcome! |
| 11:34:44 | <@rewby> | Always happy to help! |
| 11:34:53 | <mohsaid> | That crawl will help me a lot. |
| 11:35:14 | | @rewby quits [Quit: WeeChat 3.5] |
| 11:35:22 | | mohsaid quits [Remote host closed the connection] |
| 11:40:07 | | DiscantX quits [Ping timeout: 245 seconds] |
| 11:59:21 | | @rewby|backup quits [Ping timeout: 246 seconds] |
| 12:11:26 | | rewby|backup (rewby) joins |
| 12:11:26 | | @ChanServ sets mode: +o rewby|backup |
| 12:32:10 | | rocketdive (rocketdive) joins |
| 12:50:01 | <datechnoman> | Could someone possibly share the docker creation command/script they are using to run the docker containers fully out of RAM using tmpfs? Looking to bypass I/O issues on disks if possible. |
| 13:20:36 | <Sluggs> | im using this on a few machines with local hdd |
| 13:20:40 | <Sluggs> | docker run -d --name telegram --label=com.centurylinklabs.watchtower.enable=true -v '/dev/shm/telegram':'/grab/data':'rw' --restart=unless-stopped atdr.meo.ws/archiveteam/telegram-grab --concurrent 4 Sluggs |
| 13:31:17 | <@JAA> | datechnoman: hackint/#down-the-tube 2021-11-30 18:27:48 UTC < ThreeHM> Hmm, good idea to use tmpfs for reducing disk load. Turns out docker has an option for that: "docker run --mount type=tmpfs,tmpfs-size=2G,destination=/grab/data ..." |
| 13:32:34 | | dm4v quits [Client Quit] |
| 13:33:00 | | dm4v joins |
| 13:33:08 | | rocketdive quits [Client Quit] |
| 13:34:17 | | Arcorann quits [Ping timeout: 245 seconds] |
| 13:40:51 | | @rewby|backup quits [Ping timeout: 246 seconds] |
| 13:56:24 | | mohsaid joins |
| 13:56:43 | | mohsaid quits [Remote host closed the connection] |
| 14:11:45 | | sec^nd quits [Remote host closed the connection] |
| 14:12:15 | | sec^nd (second) joins |
| 14:15:29 | | qwertyasdfuiopghjkl quits [Client Quit] |
| 14:53:32 | | dm4v quits [Client Quit] |
| 14:53:36 | | dm4v joins |
| 15:01:06 | | rtro joins |
| 15:01:20 | | rtro quits [Remote host closed the connection] |
| 15:10:25 | | HackMii quits [Remote host closed the connection] |
| 15:13:32 | | HackMii (hacktheplanet) joins |
| 15:20:57 | | HackMii quits [Ping timeout: 245 seconds] |
| 15:22:27 | | HackMii (hacktheplanet) joins |
| 15:35:22 | | Gray_cat joins |
| 15:50:38 | | rewby (rewby) joins |
| 15:50:38 | | @ChanServ sets mode: +o rewby |
| 15:58:53 | | rocketdive (rocketdive) joins |
| 16:06:30 | | LeGoupil joins |
| 16:48:21 | <h2ibot> | Jakiki6 edited Talk:Main Page (+169, /* Mirroring to IPFS */ new section): https://wiki.archiveteam.org/?diff=48686&oldid=48337 |
| 16:48:22 | <h2ibot> | Entartet edited List of websites excluded from the Wayback Machine (+25, Added petitcolas.net.): https://wiki.archiveteam.org/?diff=48687&oldid=48685 |
| 16:49:21 | <h2ibot> | 7GLCS6S edited YouTube (+159): https://wiki.archiveteam.org/?diff=48688&oldid=48451 |
| 16:51:50 | | rocketdive quits [Ping timeout: 265 seconds] |
| 17:36:25 | | sec^nd quits [Remote host closed the connection] |
| 17:37:26 | | sec^nd (second) joins |
| 18:02:21 | | marto_ quits [Quit: The Lounge - https://thelounge.chat] |
| 18:35:14 | | rocketdive (rocketdive) joins |
| 18:56:54 | | tzt quits [Ping timeout: 246 seconds] |
| 19:04:42 | | michaelblob_ quits [Ping timeout: 245 seconds] |
| 20:23:32 | | SketchTheCow quits [Ping timeout: 265 seconds] |
| 20:58:37 | | Gray_cat quits [Remote host closed the connection] |
| 20:58:51 | | Gray_cat joins |
| 21:03:57 | | LeGoupil quits [Client Quit] |
| 21:04:32 | | rocketdive quits [Remote host closed the connection] |
| 22:01:06 | | onetruth joins |
| 22:05:56 | | Arcorann (Arcorann) joins |
| 22:19:03 | | Arcorann quits [Ping timeout: 265 seconds] |
| 22:20:40 | <datechnoman> | Thanks for that info all! |
| 22:21:01 | <datechnoman> | just what I was after |
| 22:27:17 | | Arcorann (Arcorann) joins |
| 22:40:28 | | Arcorann quits [Ping timeout: 276 seconds] |
| 22:40:57 | | Gray_cat quits [Ping timeout: 245 seconds] |
| 22:41:22 | | michaelblob (michaelblob) joins |
| 22:42:59 | | Arcorann (Arcorann) joins |
| 22:47:12 | | Shjosan quits [Ping timeout: 245 seconds] |
| 22:47:40 | | Shjosan (Shjosan) joins |
| 23:32:10 | | qwertyasdfuiopghjkl joins |
| 23:48:23 | | BlueMaxima joins |