Older versions of VICE had several problems with labels. However, even those versions were still tremendously useful, and all known problems are gone in current versions. So, here is a list of the problems known to me as of version 0.16.1:
ll" command does not work. Worse, it seems that internal
memory gets corrupted when using this command, so VICE will crash after use.
Use the "pb" command to load the label file in this case.
Note: All these problems are fixed in current (>= 1.0) VICE versions. If you're really using such an old version, you should think about an upgrade.