Welcome,
Correct, for offline speech recognition you always have to define a vocabulary. If you want to do large vocabulary dictation tasks of any possible word in a language, that is necessary to do with a server-based product. Both OpenEars and RapidEars are frameworks for recognizing speech without requiring a network connection or the use of a server so they make use of a predefined vocabulary.