The worst part is the unknown. The pain of being alone, the loneliness, is familiar. You've dealt with that. You understand it. But loving someone, risking everything, is unknown. There's no way to know how bad it's going to be. You barely survive the pain of being alone, so how can you deal with anything worse? So you don't bother to try.