From a compatibility standpoint, I'd say one have to be pretty sure
noone is using that stuff to lose it. The only way to be that sure is that it de-facto hasn't worked for quite some time.
I suspect that's true for the Ssleay module, but I was under the impression the others work, more or less (can't really say anything about the Pipe module though - never looked at it). As for the Perl glue, I vaguely recall that it's disabled by default mostly because of FUD; there was a perl bug at some point that tended to take the pike process down with it.
So removing them introduce a risk that some people out there get upgrade problems. What's the benefit that outweigh that risk? Less maintenance? Have they required any noteworthy maintenance the last couple of years?