Reddit mentions of Uncommon Fruits for Every Garden

If you have a place where you can grow a few things in the house or outside covered in colder weather, you have more options. Some are tropical. I would say make a list of your favorites. One example of something you could likely grow if you found the right bulbs is saffron. It's often used in Indian cuisine and comes from a variety of crocus. You can grow your own pepper. You can also grow flavorings for old-fashioned candies, herbal teas or tisanes, root beer ... anything you can think of if you look hard enough. Even if you can't grow the exact plant, there are often alternative plants you can grow and get a very similar flavor. Nasturtium flower buds can be made into "poor man's capers". You can grow more than just food. If you are into crafting, you can also make your own plant-based dyes and paints from plants, eggs, and other things.

For a book that lists other plants you may not think of, as well as ways to attract and help wildlife try Gaia's Garden. I think you may also enjoy Uncommon Fruits for Every Garden.

Honeyberries! These are on my short list of fruits to try growing next year... And Akebia fruit, it looks like a purple alien-spider egg sack that's about to hatch and it grows in many climates.
Also hardy kiwi, white (pine) strawberries, and black raspberries. You can find them at some better stocked grocery stores but they are such a treat and very prolific (well, the kiwi and the raspberry, the pine berries not so much).
Check out Uncommon Fruits for Every Garden, it's a comprehensive guide to unusual fruits that can grow in most North American gardens.