bc617a Add test for tokenization function

Authored and Committed by Patrick Uiterwijk 8 years ago
    Add test for tokenization function
    
    Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
    
        
file modified
+19 -0