So I asked and people have been suggesting all sorts of different ways to handle my collection.

A very good friend outlined a method by creating a new folder structure on my drive and then creating symbolic links to point to the files.

Over on rpgnet  there were some very creative solutions from; a reference management package like Mendeley, LibraryThing, Goodreads, using ISBNs from Zotero and creating a recipe using Calibre to scrape the data I need.

I currently use Collectorz Book Collector program to handle my needs and now I think I’ve managed to wrangle it to do what I want, I should be able to look after the vast majority of my eBooks.  I also managed to read the manual for the new version of the program and it will scan folders and add books to the database but you still need to update all the data manually to cover genre, author and the other really useful fields that would enable me to quickly scan my collection or allow one of my players to see what books I have.

The other useful thing with Collectorz is the fact that there are apps available for it on both iOs and Android as well as being able to access your stored collection via their website.