It's even worse than you think, because several of the things you said in there don't actually make sense. It sounds like you possibly didn't manage to get the message encrypted at all, just signed.

And how you exchange public keys matters a great deal -- if you just send them over email, you haven't actually achieved any meaningful security.

So yes. The entire process is a usability nightmare.