datahoarder

6758 readers

1 users here now

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

founded 4 years ago

MODERATORS

archivist@lemmy.ml

I easly got the reddit r/place data into a 4.3GIB sqlite database, where can I post it? (lemmy.world)

submitted 1 year ago by HelloHotel@lemmy.world to c/datahoarder@lemmy.ml

1 comments fedilink hide all child comments

cross-posted from: https://lemmy.world/post/2499498 (because I'm new to posting and have a lot to learn)

As I said, I made a lossy reformat of the database and a lossless one for 6.0 Gib (6,477,905,920). compared to ~26GIB from Reddit, where fields are almost intentionally anti-compressed to take up more room.

If there is somewhere I can host it, let me know.

also, I couldn't figure this out, do sqlite databses store any information on the creator or editor of a document?

why it's lossy

It's missing a large table of base64 urandom technically required to recreate the document fully

you are viewing a single comment's thread
view the rest of the comments

[–] JhonnyTheJeccer@lemmy.world 2 points 1 year ago* (last edited 1 year ago)

archive.org, original is probably saved there as well

edit: use lossless on archive.org though, data integrity is important