javalang.tokenizer.tokenize method does not generate the javalang.tokenizer.Character type #145
Description
for example when calling the method
javalang.tokenizer.tokenize("'\"'")
the expected result would be of type literal javalang.tokenizer.Character with value '"', but the tokenizer identified it as String with value ''"''.
I don't know if it's a bug or if I'm calling the method the wrong way.
