Yahoo-Backed POP Connections Cause TidBITS Formatting Error

Originally published at: Yahoo-Backed POP Connections Cause TidBITS Formatting Error - TidBITS

After much sleuthing, Adam Engst uncovers why some TidBITS readers experience a situation where an article in a TidBITS issue would be formatted as a column of text a single character wide. The culprit? An ancient email retrieval protocol as implemented by Yahoo Mail.

2 Likes

No company is more appropriately named than “Yahoo.”

But my friend who is my ISP and I still use POP, we both like the concept of “my email is on my machine.”

ISPs that mess with content deserve to be shot. It might be acceptable if they were collectively competent, but that’s a huge “if”.

1 Like

I maintained my POP accounts for that reason… wanted everything on my device. But eventually it became too much to edit the same emails on multiple devices. I’d suggest that, if that is NOT a problem, finding a ‘non-Yahoo’ provider is critical. If Adam can’t contact them with a serious support issue, they shouldn’t be providing anyone a critical service!

POP has been around for how many decades? And a major provider like Yahoo can’t get it to work. Shameful.

You can still do that with IMAP, if you like. Just configure a script/filter on your mail client to copy or move everything to a local mailbox (e.g. a folder under the “On My Mac” mailbox, if you’re using Apple Mail).

Now your message is stored locally and not on the server. And with the added bonus that you can always copy/move specific messages back to the server if you have a need (e.g. to sync to another computer).

1 Like

That’s just demented,

POP says that the POP server needs to fold lines so that no response is more than 512 characters long (including trailing CRLF). Every response must end with CRLF, and it signals the end of the mail with a .CRLF (a line containing only “.”).
To stop inadvertent signalling of EOF, if any line (as sent by the server!) would start with a “.”, then the server adds an extra “.” at the start of the line.
The *client", if it sees any line beginning with a “.” that is not the EOF indication (a line containing only “.”) just removes it. (Note that it doesn’t just convert a leading “…” to “.”, it strips any leading “.”. A POP server could in fact start every line with an extra “.” and it would work, although it would technically not be adhering to the standard).

The Yahoo POP server is broken. Or else something upstream of it is broken.

That would be less important if a number of ISPs worldwide had not got out of the ISP business and outsourced their business to Yahoo.

You should be able to reach a Yahoo technical human by checking out the steps at Whois yahoo.com

3 Likes

I still have a couple of old “Yahoo” accounts which are really from the older ATT days but it’s my understanding that these accounts are maintained by a division of Verizon now. So even though you go into your ATT account to make changes such as passwords or add a sub accounts, they don’t maintain those as they did previously. I have very few issues with my POP accounts so the TidBits one doesn’t bother me since I can use another email account like gmail if need be.

Thanks! But wow, that’s convoluted—you have to request a link to a webmail form, and the webmail form itself failed to actually work.

They’re probably back to the new Yahoo, now that Verizon sold it again.

2 Likes

Thanks! But wow, that’s convoluted—you have to request a link to a webmail form, and the webmail form itself failed to actually work.

While I should be surprised, I am merely disappointed.

RFC822 (the defining rfc for email) actually requires that Postmaster@yahoo.com exists:

This standard specifies a single, reserved mailbox address (local-part) which is to be valid at each site.
Mail sent to that address is to be routed to a person responsible for the site’s mail system or to a person with responsibility for general site operation. The name of the reserved local-part address is:

                       Postmaster

so that “Postmaster@domain” is required to be valid.

Of course, I’m not holding out much hope that Yahoo! actually adheres to this part of the standard.

The Postmaster address probably does exist.

Whether that mailbox is read by anybody responsible is another question altogether.

@billgruber, who helped me track down this problem, also shared some instructions for Frontier Communications users who want to switch to IMAP. That’s harder than it seems because Apple Mail auto-configures Frontier addresses to use POP. Here’s what Bill suggests:

Let’s say you want to set up your frontier email account, adam@frontiernet.net with a password of blah123. When you set up a new account in Internet Accounts on the desktop you must choose “Add other account”. Then you will be prompted for the email address you’d like to set up. Don’t give the real address because once Mail sees Frontiernet, it will auto-configure as POP on Yahoo’s servers. Instead, give something else for your email, like adam@footiernet.net.

The setup will think for a bit, determine there’s no auto-config data for footiernet.net and ask you to enter details manually. Enter all the details including the correct blah123 password but keep typing footiernet.net. The incoming server should be imap.mail.yahoo.net and the outgoing server should be smtp.frontiernet.net (though I did once use smtp.yahoo.com, I think).

Once you put in all the correct info (keeping the incorrect email address) it still will fail, of course. Then you change the email address to the correct one and you should have a working IMAP account.

The idea is the same on iOS/iPadOS other than somewhat different prompts, but it does work on both.

There probably are some aspects of this process that may seem superstitious. For example, you likely really don’t have to enter your correct password the first time around. It might even be a security concern to do so. I just found having less to change at the end works better.

1 Like

Wow, fantastic detective work!!

And what a royal PITA!

I can’t believe that Yahoo got this basic protocol parsing issue wrong.

Signaling like this shows up elsewhere too. You can talk raw SMTP like this:

# telnet smtp.google.com 25
HELO
…
MAIL FROM<dave@k.com>
…
RCPT TO <ace@tidbits.com>
…
DATA
type stuff here
more stuff here
.

That last dot ends the transmission. And the protocol knows not to include that as part of the message body.

That’s a fairly embarrassing bug :sweat_smile: Change their name to Yikes!?

A similar issue, perhaps the same one? You might just want to skip down to the TL;DR below.

I wonder… before the Before Time, I used Verizon’s own mail via POP, and never had issues.

A few years before the Before Time, Verizon bought Yahoo! and eventually stuck is email customers with AOL email, which features zero customer support with cash app front. Since I was familiar with it, I chose to stay with POP. All of a sudden, URL links in HTML-rich emails would often (but not anything like uniformly) lead to Safari heartburn when clicked… because a period was missing in the string that got communicated to Safari. It happened just often enough to be a minor nuisance, and just infrequently enough that I could never summon up the gumption to investigate. And of course I was using POP, because years ago Steve Dorner had admitted how worthless he thought IMAP was. And because I don’t want my email on anyone’s sever after I’ve downloaded it. (I also hate push email but that’s another issue.)

And yes, occasionally, I’d get formatted emails parts of which displayed as one character per line.

When Verizon sold AOL, I figured the handwriting had at least begun to appear on the wall for any train of accountability to the customer, so I solicited opinions for a good alternative that didn’t involve the company whose name used to begin with “G.” You know, the folks who first made customers and their data the product. The best reviews were for fastmail, so I decided to go with them, despite the fact that it meant paying a nominal annual fee, the first time I’d ever had to pay for email service. I didn’t switch over immediately, just kept the fastmail account for a couple of contacts and a rainy day.

It started to rain last year, when AOL really got obnoxious, and decided to implement (purportedly) better security by having all its verizon.net email users literally destroy their accounts, and reenter the configuration info in their clients, along the new security config. Fair enough, but it indicated yet another bit of “the heck with the customer” attitude on AOL’s part. Why not provide an automatic, self-configuring file, as fastmail does?

At that point, it became obvious that the thing to do was simply to switch to fastmail, so I did. It was pretty easy to get my regular and some not so regular, correspondents to use my new address, though I didn’t recognize how persistent numerous semi-legitimate ones (charity and political donation seekers) persisted in using my old address, even after I’d either changed my profile settings at their sites, or unsubscribed (hah!) from emails to the old address.

TL;DR: Since I switched to fastmail’s IMAP service, I have experienced exactly zero instances of the mysterious, disappearing full stop in a URL link from an HTML-formatted email. So here’s to IMAP, or maybe just a decent email service provider.

This was indeed great sleuthing! Thanks for the reporting. It’s a minor thing, but small inexplicable failures like this can make a person crazy.

And wow it’s hard to believe that Yahoo’s POP implementation is to blame. I remember writing custom POP handlers and MIME parsers back in the 90’s. One would expect this to be a solved problem by now!

I dropped my Yahoo account years ago, which aside from switching to IMAP is probably the only “solution” here. I expect that even if you could report this issue to a real human who believes you and understands the situation, Yahoo as a company would not care enough to fix this.

2 Likes

This is POP-related, though not quite the same subject.

I still use a swbell.net eddress that’s 20 years old. Originally it was accessed via POP using Eudora. But after SWBell merged into AT&T, it was eventually handled by Yahoo under subcontract to AT&T. In August 2014, the POP access suddenly stopped working–no error message from Eudora, but every attempt at access just quit quietly. Since then, I’ve used the Web access thru att.com to yahoo.com, but I dislike not being able to archive my mail on my own machine. This thread makes me wonder whether there’s a way to regain POP access to Yahoo-based email. Suggestions, please?

Alternatively, is there any other way to download years worth of emails from that Yahoo-based account? The Web interface certainly doesn’t seem to offer one.

You should be able to if it’s similar to other ATT addresses that go way back such as yours and att.net, sbcglobal.net etc. The POP info can be found if you Google for that information but the main settings in your email program have to be:

incoming mail server: inbound.att.net

outgoing mail server: smtp.att.yahoo.com

When creating a new account, you may have to do what others have mentioned in this thread and other places: you have to trick the initial setup by putting in the correct email address but the wrong password which will eventually take you to the advanced settings where you can enter the information from above.

Whatever mail is on the server now will download once you set up your POP account assuming it was deleted at some point.

Now, if your password does not work when setting it up you may have to go into your yahoo.com page and find the section where you create a secure mail key. If your Eudora program could not support Open Authentication, that could be why it stopped working a few years ago. Yahoo/ATT sent numerous emails about that issue at the time but even if your email program supports it like Apple Mail, you might still need that new secure password since there is some glitch in their system that can cause that to happen. I’ve always used POP for my old ATT accounts with no issues, only some password ones when I changed them on their website. Then I had to make a secure mail key for Apple Mail even though there should not have been an issue.

See the following regarding the secure mail key if needed:

1 Like

Thanks! Now, recommendations for a good Mac-based email program? I don’t want to use Mail, because that already handles another eddress for me, and I want to avoid any possibility of confusion. I want something that will run under Mojave, which is my main workhorse at the moment.

I have five different addresses I use for various reasons and Apple Mail does fine with all of them. Four are POP and one is IMAP so you can mix the accounts. I’m sure others here can recommend other programs but Apple Mail works fine for me.