Generate Rejecto LM from Text File

[tyeh]

Is it possible to have an interface generateRejectingLanguageModelFromTextFile, similar to generateLanguageModelFromTextFile?
Thanks

-Thomas

[Halle Winkler]

Welcome,

I can consider adding it to Rejecto, but the code to handle it in your app is pretty brief if you want to do it right now:

NSError *error = nil;
NSString *textFileString = [NSString stringWithContentsOfFile:pathToMyTextFile encoding:NSUTF8StringEncoding error:&error];

if(error) {
  NSLog(@"Error reading in text file: %@", error);
}

NSArray *corpusArray = [textFileString componentsSeparatedByCharactersInSet:[NSCharacterSet newlineCharacterSet]]; 

That corpusArray can be used as your word array with Rejecto. LanguageModelGenerator’s version adds a bit more error checking and text normalization on the assumption that all kinds of weird input might go in, but that’s the basis of it.

[tyeh]

Thanks for the suggestion. Looks easy enough never mind about adding the new interface then.
-Thomas

[Author]

Posts