26 lines
397 B
Plaintext
26 lines
397 B
Plaintext
(* TEST: [-tok] *)
|
|
This is a test
|
|
9combined 7okens
|
|
12345
|
|
893247892
|
|
combined'DueToUnknownChar _validtoken __validtoken1 _valid_token2 validToken3_
|
|
true false
|
|
null while !wrong if when
|
|
else type function
|
|
return external as
|
|
string _NOte_that_was_not_reserved
|
|
([)]{}:;,->"\
|
|
+-*/%
|
|
<=
|
|
:=
|
|
"This is not a valid
|
|
String"
|
|
"This is a valid String"
|
|
!|
|
|
..
|
|
(* this is a comment *)
|
|
(*Not a comment
|
|
$^&
|
|
>
|
|
|