Beware Mail Data Loss in Catalina

Originally published at: https://tidbits.com/2019/10/11/beware-mail-data-loss-in-catalina/

Here’s yet another reason to hold off on upgrading to macOS 10.15 Catalina—reports of data loss in Mail after updating its data store from Mojave to Catalina and when moving messages between mailboxes.

Using Mail with Gmail, IMAP always behaves a bit strangely; and Mail under Catalina does add a few more quirks. The main one I’m seeing is that a mail item moved from one mailbox to another copies rather than moving, leaving the original to be manually deleted. Annoying but not fatal— I’m not losing any mail bodies, I’m glad to say.

It’s worse than that, because you should be able to specifically target the Data volume to fix whatever problem led you to fsck in the first place, and the Mac-Enterprise list indicates that doesn’t work either. (And in theory, the read-only volume should have no such problems, so it’s there or something else entirely.)

I recommend Mail Steward for archiving emails before a major OS update. It stores emails in a MySQL database that cant be touched by the OS installation. I have emails going back over 15 years.
https://mailsteward.com/

A post was merged into an existing topic: macOS 10.15 Catalina Ships, Upgrade with Caution

No data loss here, but a different problem: out of application memory crashes when Catalina was upgrading its Mail from my Mojave installation. Running 16 GB RAM, that shouldn’t happen but with Catalina it did. Reason: I have nearly 20 years of old emails stored in mailboxes “On My Mac.” This is the first upgrade when I’ve run into the problem. I did find a work-around that I’d be glad to share if anyone wants to know, but I’m also looking for a solution that would keep some of those emails outside the Mail program without turning them into textfiles while having them ready to bring back into Mail in Catalina and future Mac OS as well.

PS: Mail Steward could be the longer-term solution I’m looking for, of course. I’ll check it out.

Wait… is this the opposite of Sherlocked when a OS upgrade makes a 3rd party app more necessary?

This app has been stewarded by Apple.

Thanks Apple.

Catalina has also introduced the issue where 3rd party programs (such as HoudahSpot or BusyContacts cannot search Apple Mail. (I have registered my view on https://www.apple.com/feedback/) For this reason I am researching 3rd party mail programs such as Mailmate or Postbox. Any opinions or comments on what 3rd party mail apps are worth looking at… Thanks

1 Like

I swear by InfoClick. Use it multiple times every day.

1 Like

I have to admit, I’ve never had a problem searching for mail and my email, stored in mail boxes on “on my mac” goes back decades.

What problems occur that require a 3rd party search engine for mail?

David


Al Varnell

    October 16

garethmcclay:
Any opinions or comments on what 3rd party mail apps are worth looking at…

I swear by InfoClick. Use it multiple times every day.

David, I agree, Mail search is very good. But I like HoudahSpot as it allows me to create a search then save it to the Finder (like a smart mailbox). I have lots of these, which I can then search for. I don’t think I can do this with Smart Mailboxes in Apple Mail (also when you have 100s of smart mailboxes it gets a bit messy!)

Thanks Al for InfoClick I’ll check this out as it appears to build its own index (so independent of Catalina’s restriction). I could not tell if it allows me to save a search to the Finder & then run the search by launching from the Finder (I’ll download the trial & test this…)

DEVONthink Pro will archive individual emails, entire mailboxes, or multiple mailboxes with a single menu command. They remain in EML format, as originally organized, with all metadata including MailTags. You can update the archive whenever you wish and DTP will not import duplicate UUIDs. Anything indexed in DTP is also indexed in Spotlight, unless you opt out. Of course, DTP will also file your other documents and perform all sorts of tricks. 15% discount for TIDbits members.

1 Like

Infoclick won’t work with Catalina Mail, since as noted elsewhere here Spotlight searching access has been disabled by Apple. That’s a problem for other non-Apple programs like Houdah Spot as well. Really stupid; I don’t see the point of that “feature.”

Mail in Catalina has been awful for me. Tons of random re-downloads. And it lost and continues to lose all local “On My Mac” folders, even after I re-imported them.

So I’m looking for a replacement; tired of Apple’s buggy junk. Looking at old dependable Thunderbird right now.

I’m having no issues whatsoever with InfoClick in Catalina. I don’t believe it has ever used the Spotlight database, rather it builds it’s own which is far faster with multiple means of search. It doesn’t appear to have anything to do with Catalina Mail. It’s a separate app, not a Mail extension of any kind.

-Al-

I’ve seen several reports ‘round the net that Catalina Mail has some issues that sometimes delete mail in the Inbox. Googling tells me that it’s mostly for those that use gmail although not in so many words.

Is there any reliable info regarding the issue, what’s affected and the like or are we mostly waiting for Catalina.2 to be issued and hope that fixes it? I’ve held off so far on upgrading.

I do have a gmail account but it’s not primary…heck, it’s not even tertiary. My main mail accounts are my original account at his.com, iCloud, and at FastMail.

Thanks.

I’m waiting for Apple to mention something in release notes or Michael Tsai to say more.

Hello,

When I updated to Catalina, I started having problems with Apple Mail on my MacBook Pro.

I’m now retired from the University of Illinois, but still use their email service. They utilize an Exchange server, and I started getting error messages for some of my incoming emails. The dialog error message box was:

The message “[xxx]” could not be moved to the mailbox “Exchange”
The specified object was not found in the store., The process failed to get the correct properties.

The error needed to be cleared before any additional emails could be downloaded from the Exchange server, and sometimes there were quite a few of them. None of the messages showed up anywhere after clicking “OK”, either in Mail, or if I opened my email in Outlook on Safari. Fortunately, they were all messages I didn’t care about, and I think they all were targeted for deletion by my Mail filters. (I have at least a couple hundred filters.)

After a back and forth with IT at the University, they pointed me to a possible solution at this website:

https://appletoolbox.com/mail-not-working-in-macos-catalina-how-to-fix/

Yesterday I went through the process of removing and rebuilding the Library files related to Mail as per the first fix described on that website. Quite a slow process for me, probably because my local Apple Mail folders go back to 1997. After some reboots and repeated rebuilds of various mailboxes, things seem to now be working ok.

Too soon for me to know if things are permanently fixed, but so far, so good. I should note, however, that all my filters were turned off in the process (but they still were there) and I’m gradually reinstituting them as the myriad of spam emails now flood in. I’m also taking the opportunity to unsubscribe from most of the mail lists that I had previously just automatically deleted through my filters.

Interesting article, thanks! But the comments following it are extremely frightening!

On my MacBook running Catalina, an IMAP account in Mail has become very problematic. Messages no longer indicate they’ve been read after I open and read them. If I mark a message as Read, it switches back to Unread immediately. If I delete a message, it vanishes for an instant, then pops back. If I mark it as Junk, pretty much the same thing.

I’ve run utilities, deleted the account from the computer and recreated it. No change.

The account is through GoDaddy and accounts from other services don’t exhibit the problem. But when I run Mail on other computers with older OS’s, it works as it should. So I’m inclined to think the issue is in Mail and Catalina.

If I turn off wifi, all of those issues disappear but as soon as wifi is on again, deleted messages re-appear and so on. But is that a failure of Mail to properly interface with GoDaddy’s servers or is it an otherwise unreported issue with GoDaddy?