You should be able to lift the entire label with a hobby knife blade, although a soak in tepid-to-warm water might be needed to soften the remaining glue.
The best glue to use is Pritt-Stick or similar (it's dry so you won't get blobs of glue coming from under the label when you press it down, and it dries clear).