morgandawn | Yahoo Groups Shutting Down

(Updated Oct 25, 2019)

Starting Oct 28, 2019 no new files (photos, documents, etc) will be allowed to be uploaded. Starting Dec 14, 2019, Yahoo Groups will be limited to emails only - functions like digest will be eliminated and all files and photos will be deleted. Admins will have limited tools and all groups will be invite only. And archives of existing messages will not longer be accessible.

What To Do?

I have a step by step guide here. The short version

1. Admins - back up your Groups and decide whether and where to move
2. Members - back up your Groups - don't leave this to the admins.
3. Everyone - consider documenting Yahoo Groups on Fanlore, help spread the word

The OTW has made an announcement. Their Open Doors preservation program is open to providing storage of Yahoo Groups backups that are assembled by moderators and non-moderators alike. Details here.

Fans are gathering on a Discord Channel to chat and ask for and give help: https://discord.gg/ek2xFyJ (updated invite)

Please follow the Yahoo Group Rescue Tumblr for updates

Flat | Top-Level Comments Only

The free trial version of the software will only export 1000 messages as HTML, total. What it produces is are basic but fairly nice-looking HTML files with 50 messages per page; there's a clickable contents list at the top and the messages underneath. The files are generated with the names HtmlDigest1.html, HtmlDigest2.html, etc. (I can't remember if there was an option to alter the names before the exporter ran.)

You can also export all of the messages as one big text file by choosing the "pipe delimited html" option; that works without any limits in the free trial version. If you change the filename extension to .html instead of .txt afterwards, you can open it in a browser like Chrome or Firefox or whatever. It's a bit ugly, but easily human-readable. (Note: I'm speaking only from my own experience of doing it with the ~2500 messages from my one group.)

I've also been told you can change the extension of the big old txt file to .mbox and import it into Thunderbird. Have not tested it.

I meant "can you do export to HTML with SQLiteStudio?" The message I commented on was you viewing the messages in SQLiteStudio so I asked about exporting in conjunction with that. SQLiteStudio says it can be done on the home page, but I haven't tried even installing it yet. I'm just backing up as much as I can right now and will worry about exporting after that. I don't have the $$ to pay for PGOffline so I was looking for an alternate way to deal with that.

EDIT: Replied to the wrong person, sorry!

Edited 2019-10-20 03:30 (UTC)

Oh, whoops! Yeah, in my previous reply I thought you were asking about PG Offline.

I don't know about exporting messages to HTML with SQLiteStudio; I have not tried. The only thing I've done so far is discover that I can essentially grab the messages one-by-one by hand in HTML format (by opening them up one-by-one in the database and copy-pasting the text).

I should mention that I really don't know anything about SQLiteStudio, or SQL in general.

Okay, following understanding your question properly I went back and played around a little with SQLiteStudio and the answer turns out to be YES, you can export in HTML. I have now managed to produce a giant, reasonably tidy HTML file with every single message from my mailing group's history.

Here's how I did it:

I went to Tools->Export.

When it asks "What do you want to export?" I selected "A single table." Hit next.

Then I selected the correct database (the group I wanted to export, the .db3 file for which needed to have been previously opened in SQLiteStudio), and selected the table "group_message" from the drop-down box.

I kept all of the default ticky-boxes ticked under "options" in this window, and hit "next".

That brought me to the "Export File and Options" window.

Export format: HTML

Output: file (select your desired location to save it)

Export format options: I ticked all the boxes, including "Don't escape HTML characters" (which was not ticked by default).

Maximum number of characters per cell: change it to something ridiculously high so that long fic posts won't get cut off. I set it to 10000000.

Output format: Format document (new lines, indentation)

Click finish.

This resulted, as I said, in one giant and very readable giant HTML document with every single message ever sent to the group. (It's actually in a grid, with the date and subject line in cells next to the message contents.) The one with my group's 2500 messages is 14,781KB in size.

Whether there's a way to select only certain messages to output in the file is something I do not yet know. (But of course you could always open up the HTML file in an editor and start chopping bits out.)

Er, sorry for the spamming, but I'm learning as I go! I wanted to mention that I just discovered that the table produced in the way that I just described won't include the information about who sent each message in an obvious way. However the info is recoverable; there's a column called "person," and the number in the cell will identify the sender of the message (with the numbers being matched with names on a separate table called "person").

No problem! I'm sure I'll come back here and poke at this when I get to exporting and all.

*headdesk* I just realized… it would've been smarter for me to create a new db3 for each group. I've got multiple groups saved into the same db3 file. Is it still possible to separate those out or will it smush all of those into a single export? (I will totally separate them from now on!)

And I do know a bit of SQL now since I taught myself (with copious amounts of help from kind souls on the OpenOffice forum) how to create a database this summer. I'm still not super experienced in creating queries and whatnot, but those tables can be easily matched up that way. You do a SELECT and grab the name column from the person table along with the data from the table of the messages, and you have to add a line that goes WHERE "person"."personID" = "messages"."personID" essentially (I don't know what the actual table info is there so I just made up names so it's clear what's going on). But I did all my SQL queries with a LibreOffice Base files, so this might be a bit different, we'll see.

Is it still possible to separate those out or will it smush all of those into a single export?

Since I've only downloaded the one group, I can't really say. When I was doing the export it looked as though, if I had more than one database, I could choose to select only one of them. What I don't know is whether the program would generate (read? differentiate?) multiple databases from one .db3 file if you'd downloaded multiple groups.

I just realized the very simple solution... copy the database as many times as there are groups, rename each one to the group name desired in it, and then go in and delete the ones that will be kept in other groups. Can't believe it didn't occur to me till now!

See my reply to morgandawn below clarifying what I was asking. (I commented on the wrong comment.)

Yahoo Groups Shutting Down - Dec 14, 2019 (UPDATED)

no subject

no subject

no subject

no subject

no subject

no subject

no subject

no subject

no subject

no subject

no subject