Reddit mentions of Fish on a First-Name Basis: How Fish Is Caught, Bought, Cleaned, Cooked, and Eaten

Alton Brown's I'm Just Here for the Food is a great primer on the science of cooking. I read it in culinary school, and it was a great distillation of the main concepts (which cuts are of meat are good for braising, searing, roasting, etc. and how to properly perform each technique). If you end up enjoying Alton Brown's style, I would also recommend Fish on a First Name Basis for fish cookery. Lastly, Cook's Illustrated is a wonderful resource on food and cooking. The yearly online membership is only approx $25, and you get access to all previously published recipes and equipment reviews.

In terms of equipment, the knife I personally use is the Victorinox 10-inch chef knife. Japanese steel is great and all, but for the same price you could get this knife, a good electric knife sharpener, and a honing steel and still have some left over. The best knife is a sharp knife after all. I would also highly recommend a T-fal non-stick pan for a solid multi-purpose first pan.

Finally, for an herb garden, I generally try to aim for either expensive or infrequently used herbs for indoor gardening. The reasoning behind growing expensive herbs is pretty straightforward. I primarily grow infrequently used herbs to avoid wasting what I wouldn't use up when cooking (as you mentioned is oft a problem). In my region, basil, sage, thyme, tarragon, and oregano would all be good candidates to grow. Parsley, cilantro, and bay leaf tend to be cheaper at the market in my area, so I usually just purchase those.