Reddit mentions of Why Trust Science? (University Center for Human Values)

https://www.amazon.com/Reliable-Knowledge-Exploration-Grounds-original/dp/0521406706/

https://www.amazon.com/Trust-Science-University-Center-Values/dp/069117900X/

https://www.amazon.com/Golem-Second-Should-Science-Classics/dp/1107604656/

https://www.amazon.com/Science-Salvation-Modern-Myth-Meaning/dp/0415107733/

https://www.amazon.com/Art-Science-Boris-Castel/dp/1551113872/

https://www.amazon.com/Scientific-Literacy-Method-Illini-Books/dp/0252064364/

https://www.amazon.com/Representing-Intervening-Introductory-Philosophy-Natural/dp/0521282462/

As to your question - the next layer would be: what is the difference between a scientific theory and an ad hoc fitting superstition?

Maybe one answer has to do with range. A good theory will fit a wide range of phenomena. "ad hoc" usually refers to a narrow range of phenomena.

Perhaps a fair guess would be that it is fairly safe to extrapolate a theory hmmm 20% beyond the range that it has been tested. If you tested a fit out to 10 miles, you can fairly walk another 2 miles before checking your life insurance policy. If the fit has been tested for 1000 miles, you can feel good for another 200 miles. So if you need to walk say 20 more miles to reach those ripe peaches, better to work with the 1000 mile fit.