Mushrooms are usually a sign of high moisture levels. Try watering a little less and bottom watering so keep the top of the soil less moist. You can pull the mushrooms out if you'd like but they shouldn't hurt your plants and will go away as the soil dries.