Improvisation Made Simple For The Church Pianist
Improvisation Made Simple For The Church Pianist is not an expensive book, and seems as though it would be a good introduction to hymn playing (judging by the description). It is listed as the first volume, with subsequent volumes to follow, but not yet published.
I do not own this book, but will surely one day purchase it. On the bright side... Shipping charges are included in the price!