My ethics professor liked to say that there were fundamentally two criticisms of utilitarianism. The first was that it demanded too much, it has a high standard for everyone and there aren't any extra-virtuous actions (i.e. things that are good to do but not required). The second was that it has too low of standards because nothing is absolutely forbidden.