I'd recommend you set the book collection to be the target collection (right click it). Then you just use the B key rather than dragging extra items.
I had no idea you could do that: I thought B always added to the Quick Collection.
Thanks, John. It's a sad day when you don't learn something new.