What is his deal? I took away his virginity...?

Having not been in a committed relationship before he is obviously misinterpreting infatuation for love. He probably feels that since you and he had sex you are ready to make a commitment to him. Although he is 22 he apparently is very emotionally immature. You need to let him down easy and encourage him to find someone more age appropriate for his experiences. Unless you are willing to play the roll of a surrogate mother of sorts, this relationship will never work. He is acting more like a person might act in junior high than someone who is 22. You are not doing him any favors by thinking of staying with him. He has a great deal of emotionally growing he needs to do before he will truly be able to be with a woman and have a real relationship. Based on the conversations he has with his family I rather suspect they are very aware he is emotionally immature and really watch out for him. You need to move on to someone else.