If the vocabulary size is small, and the binary occurrence of given words are strong features in differentiating between document classes, simply using dummy variables to indicate the presence of given words could be a viable and less computationally intensive approach to text classification.