How much citrus can go into compost piles?

Dear Garden Guy, we have a bumper crop of lemons and limes this year. We compost all of our kitchen waste, but my husband thinks all of the citrus peel and whole fruits will not be good for the compost