Wedding Help!

I am thinking of having a smaller wedding at my parents house or maybe in the backyard. I was given a suggestion to invite the immediate family memebers to the smaller wedding then invite everyone to the reception. This is somewhat ackward and uncomfortable because my immediate family is much bigger than my FH. It will only be him, his brother and his mother. On my side, I have 4 sisters and 2 brothers plus all there children. I will have approximately 35 immediate family members on my side and he will have only about 5.
Your thoughts on this? I am up for other ideas and suggestions.
Please help.