Yahoo Groups Shutting Down - Dec 14, 2019 (UPDATED)

[morgandawn]

(Updated Oct 25, 2019)

Starting Oct 28, 2019 no new files (photos, documents, etc) will be allowed to be uploaded. Starting Dec 14, 2019, Yahoo Groups will be limited to emails only - functions like digest will be eliminated and all files and photos will be deleted. Admins will have limited tools and all groups will be invite only. And archives of existing messages will not longer be accessible.

What To Do?

I have a step by step guide here. The short version

1. Admins - back up your Groups and decide whether and where to move
2. Members - back up your Groups - don't leave this to the admins.
3. Everyone - consider documenting Yahoo Groups on Fanlore, help spread the word

The OTW has made an announcement. Their Open Doors preservation program is open to  providing storage of Yahoo Groups backups that are assembled by moderators and non-moderators alike. Details here.

Fans are gathering on a Discord Channel to chat and ask for and give help:  https://discord.gg/ek2xFyJ (updated invite)

Please follow the Yahoo Group Rescue Tumblr for updates

 

Comments

[shadowscast]

I downloaded SQLiteStudio from: https://sqlitestudio.pl/index.rvt?act=download

and successfully used it to open the .db3 file that PG Offline had created out of my downloaded Yahoo group. The interface was pretty confusing, but I was able to see the list of messages and open them.

[morgandawn]

My trial version of SQLLite expired so I cannot test. What do the messages look like?

[shadowscast]

SQLiteStudio is free and open source, according to its "about" thingy.

As an example, if I click on the contents of a message I sent on 2001-07-14 19:20:21 (message #251 in the listing; I can see the message #, the subject, and the contents of the message), I get a text box with:

Hi out there. Me again.



So, now I'm working on that fic I mentioned. My very

first. And I've got what I would consider the first

part done. Now I'm wondering about this custom I hear

of called beta reading...



I've never written a fic before in any fandom, but

I've read enough stuff to have a vague idea of what

beta readers do. I guess that (depending on the

reader/writer relationship) they'll do the good ol'

grammar, spelling, and consistency checks, and

possibly constructive criticism about plot,

characterization, technique, or whatever - depending

on how involved they are.



So... should I have a beta reader? Could I have one?

Is anyone interested?



To give anyone interested an idea what they're getting

in for:

It's a Mac/Vic story, very angsty, h/c, with Mac doing

the hurtin' and Vic the comforting. It's, uh, about

6000 words now and still pretty g-rated, but I'm

getting there. :)



My greatest need from a beta, I think, would be to

make sure I'm not bizarrely contradicting canon (since

I still haven't seen all the episodes - though I have

seen the pilot now, thanks so much Carla!!). Other

helpful suggestions are also welcome, and moral

support would be nice. :)



Bye for now,



Shadowscast



_______________________________________________________

Do You Yahoo!?

Get your free [Bad username or site: yahoo @ ca] address at http://mail.yahoo.ca

(Actually it includes html formatting, which I can't show you verbatim because Dreamwidth is going to render it.)

I might not be describing it very well; I only understand maybe 25% of what I'm doing here, though I'm certainly in the process of trying to educate myself!

[morgandawn]

Doh! SQLSource!! *runs off to look

[shadowscast]

Since I don't really understand what I'm doing here, I might not be telling you all the important things, but if you ask me any more questions about it I'll do my best to answer!

[shadowscast]

Sort of relatedly but not really importantly—I think I just found the message where I approved your membership to the Yahoo RatBoat mailing list (the very mailing list I am currently archiving), on November 13, 2013! (Unless there's another fannish Morgan Dawn out there.) Small world!

[doranwen]

Have you been able to export the messages to HTML, as the website says you can? I haven't installed it yet myself, just been trying to back up all the groups I'm a member of (and one of them had over 50k messages so that took some hours), plus any more I can become a member of in time. :) I figure once the backing up is over, I can figure out what to do with all the stuff I've backed up…

[morgandawn]

Export to HTML using PGOffline? Yes, but I have a paid subscription.

[shadowscast]

The free trial version of the software will only export 1000 messages as HTML, total. What it produces is are basic but fairly nice-looking HTML files with 50 messages per page; there's a clickable contents list at the top and the messages underneath. The files are generated with the names HtmlDigest1.html, HtmlDigest2.html, etc. (I can't remember if there was an option to alter the names before the exporter ran.)

You can also export all of the messages as one big text file by choosing the "pipe delimited html" option; that works without any limits in the free trial version. If you change the filename extension to .html instead of .txt afterwards, you can open it in a browser like Chrome or Firefox or whatever. It's a bit ugly, but easily human-readable. (Note: I'm speaking only from my own experience of doing it with the ~2500 messages from my one group.)

[morgandawn]

I've also been told you can change the extension of the big old txt file to .mbox and import it into Thunderbird. Have not tested it.

[doranwen]

I meant "can you do export to HTML with SQLiteStudio?" The message I commented on was you viewing the messages in SQLiteStudio so I asked about exporting in conjunction with that. SQLiteStudio says it can be done on the home page, but I haven't tried even installing it yet. I'm just backing up as much as I can right now and will worry about exporting after that. I don't have the $$ to pay for PGOffline so I was looking for an alternate way to deal with that.

EDIT: Replied to the wrong person, sorry!

[shadowscast]

Oh, whoops! Yeah, in my previous reply I thought you were asking about PG Offline.

I don't know about exporting messages to HTML with SQLiteStudio; I have not tried. The only thing I've done so far is discover that I can essentially grab the messages one-by-one by hand in HTML format (by opening them up one-by-one in the database and copy-pasting the text).

I should mention that I really don't know anything about SQLiteStudio, or SQL in general.

[shadowscast]

Okay, following understanding your question properly I went back and played around a little with SQLiteStudio and the answer turns out to be YES, you can export in HTML. I have now managed to produce a giant, reasonably tidy HTML file with every single message from my mailing group's history.

[shadowscast]

Here's how I did it:

I went to Tools->Export.

When it asks "What do you want to export?" I selected "A single table." Hit next.

Then I selected the correct database (the group I wanted to export, the .db3 file for which needed to have been previously opened in SQLiteStudio), and selected the table "group_message" from the drop-down box.

I kept all of the default ticky-boxes ticked under "options" in this window, and hit "next".

That brought me to the "Export File and Options" window.

Export format: HTML

Output: file (select your desired location to save it)

Export format options: I ticked all the boxes, including "Don't escape HTML characters" (which was not ticked by default).

Maximum number of characters per cell: change it to something ridiculously high so that long fic posts won't get cut off. I set it to 10000000.

Output format: Format document (new lines, indentation)

Click finish.

This resulted, as I said, in one giant and very readable giant HTML document with every single message ever sent to the group. (It's actually in a grid, with the date and subject line in cells next to the message contents.) The one with my group's 2500 messages is 14,781KB in size.

Whether there's a way to select only certain messages to output in the file is something I do not yet know. (But of course you could always open up the HTML file in an editor and start chopping bits out.)

[shadowscast]

Er, sorry for the spamming, but I'm learning as I go! I wanted to mention that I just discovered that the table produced in the way that I just described won't include the information about who sent each message in an obvious way. However the info is recoverable; there's a column called "person," and the number in the cell will identify the sender of the message (with the numbers being matched with names on a separate table called "person").

[doranwen]

No problem! I'm sure I'll come back here and poke at this when I get to exporting and all.

*headdesk* I just realized… it would've been smarter for me to create a new db3 for each group. I've got multiple groups saved into the same db3 file. Is it still possible to separate those out or will it smush all of those into a single export? (I will totally separate them from now on!)

And I do know a bit of SQL now since I taught myself (with copious amounts of help from kind souls on the OpenOffice forum) how to create a database this summer. I'm still not super experienced in creating queries and whatnot, but those tables can be easily matched up that way. You do a SELECT and grab the name column from the person table along with the data from the table of the messages, and you have to add a line that goes WHERE "person"."personID" = "messages"."personID" essentially (I don't know what the actual table info is there so I just made up names so it's clear what's going on). But I did all my SQL queries with a LibreOffice Base files, so this might be a bit different, we'll see.

[shadowscast]

Is it still possible to separate those out or will it smush all of those into a single export?

Since I've only downloaded the one group, I can't really say.  When I was doing the export it looked as though, if I had more than one database, I could choose to select only one of them.  What I don't know is whether the program would generate (read? differentiate?) multiple databases from one .db3 file if you'd downloaded multiple groups.

[doranwen]

I just realized the very simple solution... copy the database as many times as there are groups, rename each one to the group name desired in it, and then go in and delete the ones that will be kept in other groups. Can't believe it didn't occur to me till now!

[doranwen]

See my reply to morgandawn below clarifying what I was asking. (I commented on the wrong comment.)

[morgandawn]

I have SQLiteStudio - I can navigate to the .db3 file and "Add a Database" but nothing opens. I may not understand MySQL enough to operate it. Keep in mind that my db3 contains many groups - not just one

[shadowscast]

Okay, I'm not sure how helpful I can be because I don't understand mySQL at all, and I don't even remember exactly what I did to get my database to open; I just poked around a bit and it magically worked.

Would it be helpful possibly if I sent you a screenshot of what mine looks like with the database open? Is there a way for me to do that? (Email, maybe?)

[morgandawn]

yes email is fine morgandawn@gmail.com