Topic: e621.net popular post archives

Posted under General

uwuBanana

Member

Good news everyone!

I've backed up all of the popular posts on e621.net between 2007 and 2023!
Now I'm sharing them with you!


post #2294957

The archives contain all of the files from https://e621.net/popular between 2007-02-10 and 2023-12-31 at the time the archives were created. Popular items change frequently as older items accumulate upvotes. The archives may not represent complete 1:1 accuracy with what is currently shown on e621.net.

The individual archives are broken out by year, into months and days with the following folder structure:

e621_popular_<year>_raw/<month>/<day>/<posts>

The files are raw pulled directly from https://static1.e621.net/data/, no modifications or tags have been added to the files.

Note: The 2007 archive starts on Feb 10th when the first post (that wasn't deleted) was made and has days missing when nothing was posted.

You can download the torrents using a Bittorrent application like Transmission, qBittorrent, Deluge or rTorrent.

Totals

TOTAL SIZE: 2.1 TB
TOTAL FILES: 1,138,754
TOTAL JPG: 550,343
TOTAL PNG: 497,741
TOTAL GIF: 41,392
TOTAL SWF: 6,147
TOTAL WEBM: 43,131

2007

TOTAL SIZE: 2.1G
TOTAL FILES: 11206
JPG: 9487
PNG: 1118
GIF: 536
SWF: 65
WEBM: 0

magnet:?xt=urn:btih:e7962cd5ec9f095ecf5caa4f660b1469b4d0e91b&dn=e621_popular_2007_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2008

TOTAL SIZE: 2.0G
TOTAL FILES: 8267
JPG: 6923
PNG: 1043
GIF: 258
SWF: 43
WEBM: 0

magnet:?xt=urn:btih:db82fe4414fd1f6f4d6dc48af6527a3c3e70c8c0&dn=e621_popular_2008_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2009

TOTAL SIZE: 7.5G
TOTAL FILES: 23584
JPG: 19057
PNG: 3329
GIF: 710
SWF: 488
WEBM: 0

magnet:?xt=urn:btih:d94c24b05da6b74e7e067e725a29b42f6d922577&dn=e621_popular_2009_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2010

TOTAL SIZE: 17G
TOTAL FILES: 41764
JPG: 32645
PNG: 7070
GIF: 1130
SWF: 919
WEBM: 0

magnet:?xt=urn:btih:a8439ce9866f5a0ad28bada2a0e3b72efcc85cc0&dn=e621_popular_2010_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2011

TOTAL SIZE: 26G
TOTAL FILES: 57398
JPG: 39187
PNG: 16076
GIF: 1340
SWF: 795
WEBM: 0

magnet:?xt=urn:btih:ec22ea7be05d6c3b0082803bf5c9af92ea9f7c7e&dn=e621_popular_2011_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2012

TOTAL SIZE: 40G
TOTAL FILES: 69139
JPG: 44017
PNG: 23421
GIF: 1069
SWF: 632
WEBM: 0

magnet:?xt=urn:btih:d71fa82366782816f36f7076e6f9c572c0ade480&dn=e621_popular_2012_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2013

TOTAL SIZE: 59G
TOTAL FILES: 77820
JPG: 44462
PNG: 30982
GIF: 1802
SWF: 574
WEBM: 0

magnet:?xt=urn:btih:7ee670ce46b108e35e3c12a8da0dfbe076e1b914&dn=e621_popular_2013_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2014

TOTAL SIZE: 76G
TOTAL FILES: 78121
JPG: 38102
PNG: 36974
GIF: 2113
SWF: 712
WEBM: 220

magnet:?xt=urn:btih:02391d2af8f574c6c9b6e6566fab7852dfe561b3&dn=e621_popular_2014_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2015

TOTAL SIZE: 91G
TOTAL FILES: 79697
JPG: 36069
PNG: 39561
GIF: 2485
SWF: 597
WEBM: 985

magnet:?xt=urn:btih:3978b1b11942b63a4bbfdd4392488e8e10d190d6&dn=e621_popular_2015_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2016

TOTAL SIZE: 116G
TOTAL FILES: 81127
JPG: 33595
PNG: 42751
GIF: 2769
SWF: 554
WEBM: 1458

magnet:?xt=urn:btih:72e3a89e357c8e3eed0149c058e4c6a75f48586b&dn=e621_popular_2016_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2017

TOTAL SIZE: 134G
TOTAL FILES: 84362
JPG: 31501
PNG: 48170
GIF: 2645
SWF: 464
WEBM: 1582

magnet:?xt=urn:btih:815bd5e3c014834c6b8907f558f51a7638e8dc2e&dn=e621_popular_2017_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2018

TOTAL SIZE: 155G
TOTAL FILES: 85973
JPG: 31331
PNG: 48013
GIF: 3479
SWF: 219
WEBM: 2931

magnet:?xt=urn:btih:37e85642f5937f1287812ad9960eb2b23370dd6e&dn=e621_popular_2018_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2019

TOTAL SIZE: 180G
TOTAL FILES: 86686
JPG: 35053
PNG: 44076
GIF: 3409
SWF: 67
WEBM: 4081

magnet:?xt=urn:btih:81b0461acb0bab641635dbc1bab78222beca9282&dn=e621_popular_2019_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2020

TOTAL SIZE: 231G
TOTAL FILES: 87502
JPG: 37400
PNG: 41079
GIF: 3689
SWF: 18
WEBM: 5316

magnet:?xt=urn:btih:87cf7c17307ff42e97df8d3a4db5520f54281a2f&dn=e621_popular_2020_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2021

TOTAL SIZE: 277G
TOTAL FILES: 87893
JPG: 38886
PNG: 37987
GIF: 4310
SWF: 0
WEBM: 6710

magnet:?xt=urn:btih:dbbe1be965dc34134b79eae2ecb3f32a252d0de1&dn=e621_popular_2021_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2022

TOTAL SIZE: 323G
TOTAL FILES: 88972
JPG: 39033
PNG: 35585
GIF: 5100
SWF: 0
WEBM: 9254

magnet:?xt=urn:btih:8a548a293b8841228bd3136523a36263c0e3f7cc&dn=e621_popular_2022_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
2023

TOTAL SIZE: 376G
TOTAL FILES: 89243
JPG: 33595
PNG: 40506
GIF: 4548
SWF: 0
WEBM: 10594

magnet:?xt=urn:btih:1e7991529d41bcadd8f5a8d8191ac27297509c8c&dn=e621_popular_2023_raw&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce

Character Archives

mlp megapack

TOTAL SIZE: 564G
TOTAL FILES: 239,534
JPG: 72,865
PNG: 154,740
GIF: 5,680
WEBM: 5,292
SWF: 957

magnet:?xt=urn:btih:5d6866903f46d843c43a99467a633ee850401884&dn=mlp_megapack_e621_v2023&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
zootopia megapack

TOTAL SIZE: 73G
TOTAL FILES: 52,507
JPG: 25,507
PNG: 25,459
GIF: 678
WEBM: 829
SWF: 34

magnet:?xt=urn:btih:ea3345ac67a61ff8537610bc5471084155cb63f9&dn=zootopia_megapack_e621_v2023&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
judy_hopps

TOTAL SIZE: 51G
TOTAL FILES: 33,412
JPG: 16,884
PNG: 15,383
GIF: 463
WEBM: 659
SWF: 23

magnet:?xt=urn:btih:9e1910caf6e8fe0e9b6eb62340c383b209b03c9a&dn=judy_hopps_e621_v2023&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
nick_wilde

TOTAL SIZE: 35G
TOTAL FILES: 26,633
JPG: 14,440
PNG: 11,586
GIF: 341
WEBM: 247
SWF: 19

magnet:?xt=urn:btih:89f33027e26732a16e810658c3eff22cb18521ac&dn=nick_wilde_e621_v2023&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
loona_(helluva_boss)

TOTAL SIZE: 41G
TOTAL FILES: 15,771
JPG: 7,332
PNG: 7,638
GIF: 291
WEBM: 510
SWF: 0

magnet:?xt=urn:btih:c4ff48364298475db29cb37f5c556dd53bc556d0&dn=loona_e621_v2023&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce
rouge_the_bat

TOTAL SIZE: 40G
TOTAL FILES: 20,608
JPG: 9,368
PNG: 10,172
GIF: 493
WEBM: 500
SWF: 75

magnet:?xt=urn:btih:0d3785cdc680ba8c3fe04977c225499eb71ec8cd&dn=rouge_the_bat_e621_v2023&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce


I've also created a perl script to embed e621.net tags into image EXIF metadata so you can search images directly in windows file explorer search:

https://e621.net/forum_topics/37801

Updated

mrox

Member

Interesting.

Any chance of posting just the metadata of the posts? Meaning either their ids or the list of files? Or are the popular posts just the top scoring 90 posts of each day (and thus we can calculate it from the daily stats dump)?

uwuBanana

Member

mrox said:
Interesting.

Any chance of posting just the metadata of the posts? Meaning either their ids or the list of files? Or are the popular posts just the top scoring 90 posts of each day (and thus we can calculate it from the daily stats dump)?

Each section now contains a file list metadata link for the archive. :)
Metadata not needed anymore now that the popular archives are raw directories.

Updated

uwuBanana

Member

kora_viridian said:
For critters in the USA: If you're on Scumcast Comcast or Xfinity (same company), you most likely have a data cap of somewhere between 1,024 GB and 1,200 GB a month; the exact amount depends on where you live. This includes everything you do online from your home Internet connection - web browsing, email, Youtube, Netflix, Hulu, Steam, Twitch, torrents, whatever.

If you did nothing else on your home Internet all month, and downloaded all of the 2017 through 2022 torrents linked here, you'd end up going over the cap.

I think you can hit the cap once, without charge, and after that it costs $10 per 50 GB. If you've ever hit the cap before, that means it would cost somewhere around $110 to $150 to download all of these torrents within one month.

Other Internet providers, including AT&T, Cox, and Mediacom, also have data caps on at least some of their services. Research your provider to make sure. If there is a data cap, there's usually a way to see how much data you've used on the provider's website somewhere - like where you log in to pay your bill.

You can usually get unlimited addons for $25-$50 extra depending on your ISP. But yeah, definitely watch your limit if you have one.

I suggest getting a seedbox if you want to get more into torrenting. I use whatbox.ca and really like it. I have a 100Gbps network and 100TB upload limit lol.

mrox

Member

Dang, each torrent is a single zip file. I have a full rip of e621 and was going to help you seed without having to download anything, but chances are I won't be able to recreate identical zip files. Thanks for the file lists.

uwuBanana

Member

mrox said:
Dang, each torrent is a single zip file. I have a full rip of e621 and was going to help you seed without having to download anything, but chances are I won't be able to recreate identical zip files. Thanks for the file lists.

This might be my next project. Do you structure your rip identical to static1.e621.net? Where abcdef.jpg is at ./data/ab/cd/abcdef.jpg? Would probably take me a couple weeks to do a full rip up to beginning of 2023.

mrox

Member

I structured it by "year/week/<postId>-<filename>" and a mirror folder structure for the json (not really needed now that we have metadata dumps). If I were to redo it I'd do it by day instead of week since there's now 15k files per week and a lot of file managers don't handle that well. If you structure it with hash based folders it's a lot harder to view new content. Using a time based structure you can start at one end and view everything sequentially. My script hits e621 daily which provides enough lag to not worry about illegal content. I download at a rate of 1 post per 6 seconds.

Originally I was going to make a tagging bot but that project has moved to the bottom of my list of things to do. It's amazing how much free time it feels like you have when you're in school and all that disappears when you're a working adult. The hardest part of doing computer vision projects is getting good source material and the tags here are pretty good for that.

alphamule

Privileged

mrox said:
I structured it by "year/week/<postId>-<filename>" and a mirror folder structure for the json (not really needed now that we have metadata dumps). If I were to redo it I'd do it by day instead of week since there's now 15k files per week and a lot of file managers don't handle that well. If you structure it with hash based folders it's a lot harder to view new content. Using a time based structure you can start at one end and view everything sequentially. My script hits e621 daily which provides enough lag to not worry about illegal content. I download at a rate of 1 post per 6 seconds.

Originally I was going to make a tagging bot but that project has moved to the bottom of my list of things to do. It's amazing how much free time it feels like you have when you're in school and all that disappears when you're a working adult. The hardest part of doing computer vision projects is getting good source material and the tags here are pretty good for that.

Wouldn't you normally structure it like this? Date and time/post_id, hash, filesize? Say, 202303230340_0123456789abcdef0123456789abcdef_1000000? You can obviously use an index to convert post ID to date and time, but same for the hashes and sizes. PostID_Date&Time_MD5Hash_FilesizeInBytes would naturally sort large numbers of posts quite nicely, and be manageable. Added bonus is that if organized this way, it's a lot easier to mirror torrents in the future )! One feature I miss of E-hentai here is the ability to show 'strong' tags. I think you used to be able to see actual tag votes that you could sort by. E621 is binary. It either is tagged, or not.

Thing is, I think I know of people that might already have all the older content. I left a link to this topic for someone on IRC who may know. Data hoarders might already have these torrents. What would be clever is to just count up the number of posts in a torrent, and group them by months or weeks for really old posts, then gradually speed it up and go to daily. Heaven help us when it has to go to hourly archives! (LOL)

:EDIT: OK, got a reply and they said they only have E-H archives. Oh wells. I wonder if I can pay for a HDD shipped, because of this horrible 5Mb/s bandwidth, LOL.

Updated

uwuBanana

Member

mrox said:
Originally I was going to make a tagging bot but that project has moved to the bottom of my list of things to do. It's amazing how much free time it feels like you have when you're in school and all that disappears when you're a working adult. The hardest part of doing computer vision projects is getting good source material and the tags here are pretty good for that.

I just wrote a small bash script to tag images for anyone who's interested: https://e621.net/forum_topics/37801

Drakkenfyre

Member

One thing that changes those calculations: The size of the files are not the only consideration. The amount greatly matters, as well.

Assuming the person is using Windows, and they most likely would be in that situation, then you're going to have a bad time with throughput. Windows chokes on very large amounts of files, regardless of their size. I've seen it dragged to its knees by hundreds of thousands of files at 1KB or LESS each. So you're either going to have to copy them in relatively small batches or wait for a week while it chokes and slows to a crawl as it gets them transferred.

AlexYorim

Member

Would the now-deleted infamous cheese grater image still be included in the 2008 archives?

uwuBanana

Member

alexyorim said:
Would the now-deleted infamous cheese grater image still be included in the 2008 archives?

These archives were created within the past month, so if it was deleted before then it won't be in the archive.

mrox

Member

alphamule said:
Wouldn't you normally structure it like this? Date and time/post_id, hash, filesize? Say, 202303230340_0123456789abcdef0123456789abcdef_1000000?

e621 uses the hash as the filenames so when I mentioned file name that means hash. I see no reason to include file size in the name since the actual file easily tells you that. The thing about your folder structure is you need to ensure those folders don't get excessively large. 10k is a good limit. Folders that large tend to stall the system when you open them up and it tries to generate thumbnails for everything. If you only use a command line it's fine, but if you use a GUI you really want to stay under 10k entries in a folder.

Windows is slow when dealing with tons of little files. However there are alternative file transfer tools you can install on Windows to replace its default copy/move functions. If you're routinely dealing with lots of tiny files I'd recommend looking into using one.

I don't remember the company, but someone is selling a square, silicone cheese grater. You can finally experience that image for yourself without the need for a trip to the emergency room.

alphamule

Privileged

mrox said:
e621 uses the hash as the filenames so when I mentioned file name that means hash. I see no reason to include file size in the name since the actual file easily tells you that. The thing about your folder structure is you need to ensure those folders don't get excessively large. 10k is a good limit. Folders that large tend to stall the system when you open them up and it tries to generate thumbnails for everything. If you only use a command line it's fine, but if you use a GUI you really want to stay under 10k entries in a folder.

Windows is slow when dealing with tons of little files. However there are alternative file transfer tools you can install on Windows to replace its default copy/move functions. If you're routinely dealing with lots of tiny files I'd recommend looking into using one.

I don't remember the company, but someone is selling a square, silicone cheese grater. You can finally experience that image for yourself without the need for a trip to the emergency room.

Right... But the filesize was for the indexing. I guess it's redundant for the actual files but hypothetically, MD5s could match but have different filesizes. <--- Highly unlikely, so not worth bothering? ;) If you've seen programs like H@H/Hath(Hentai@Home), they group files into ranges like /01/0102030405060708090a0b0c0d0e0f and limit allocations of ranges (i.e. You only get 12 or something) based on size and speed of node. It might make sense to use a different division than /256 or to group by year?

Windows file operations are totally broken and everyone knows this? Haha, slow software is slow. There's things like filename sorting that can be almost instant, or incredibly slow when you scale to 10000<n<100000 number of files. 100000 1-KB files are going to be slow to copy even on a SSD (but not as bad as HDD!), so I keep large numbers of such files archived. However, this is not too practical when someone does something crazy like makes a 2TB RAR file. XD

mrox

Member

alphamule said:
MD5s could match but have different filesizes. <--- Highly unlikely, so not worth bothering? ;)

The basics of hashing on a large site like this is to spread the content out as evenly as possible so no part of the system (assuming a multi-server system with load balancing) is handling more load than any other. So you're correct in binning files by their hash's first few characters is good since that evenly spreads them out. If you don't know how many files you're going to get in any given category, that's the best way to do things. I didn't need to do that since I only have one 'server'. The only thing I need to worry about is having too many files per folder, so I did need something more advanced than everything in the same folder. Splitting by Year and then by Day works well enough. Originally I used to view every image on this site but that's no longer feasible. When I was doing that, browsing the weekly folders in thumbnail view was more efficient than visiting the site. Binning things by week/day made it easy to skim over the content only once. If I binned by hashes the new files would be scattered all over the place and I'd be constantly reviewing files I'd already seen. That's good for web server, but not for individual users. I didn't include the size because I don't believe e621 has any hash collisions due to how it formats its content urls. Though not why I did it and I hadn't considered the issue until now, including the post id in the file name resolves any collisions on my side of things.

Hash collisions are highly unlikely, but a site with a type of porn a bunch of people hate is more likely to be targeted by such files. I hope something checks for that. I assume the site just says the image is already here and blocks the upload then expects the user to post about it if the collision is accidental. I've never uploaded content so I really can't say.

uwuBanana

Member

Updated all torrent's from zip archives to raw directories. Due to the number of files in later archives your torrent client may lag for a minute if you look at the torrent contents. The benefit is you no longer have to extract the files and use twice the amount of disk space. I also audited all past archives and found missing days in Feb 2022 and Nov 2022, these have been fixed.

alphamule

Privileged

uwubanana said:
Updated all torrent's from zip archives to raw directories. Due to the number of files in later archives your torrent client may lag for a minute if you look at the torrent contents. The benefit is you no longer have to extract the files and use twice the amount of disk space. I also audited all past archives and found missing days in Feb 2022 and Nov 2022, these have been fixed.

A workaround for this would have been segmenting by smaller ranges of post IDs?

uwubanana said:
๐Ÿ‘€

Heh

  • 1