Check out your garden centers for herb plants for a flavorful addition to your meals. There are plenty of herbs that can be grown indoors successfully through winter on a sunny windowsill. Here are my Top 5 Herbs to Grow Indoors All Winter: