In nature, mice are largely herbivores, consuming any kind of fruit or grain from plants. However, mice adapt well to urban areas and are known for eating almost all types of food scraps. In captivity, mice are commonly fed commercial pelleted mouse diet. These diets are nutritionally complete, but they still need a large variety of vegetables.
Despite popular belief, most mice do not have a special appetite for cheese. They will only eat cheese for lack of better options.
Read more, here.