added comment functionality for lexer, expanded tests, and updated to identify empty strings

This commit is contained in:
Partho Bhattacharya
2025-02-10 23:41:37 -05:00
parent f4a86f0de7
commit 3757434417
2 changed files with 19 additions and 5 deletions

View File

@ -1,9 +1,15 @@
"this is a string" 721398 'g' '/n'
12893 "this is not a string
"this is a string" 721398 'g' '/n' (* should print 3 tokens before this *)
'
'
12893 "this is not a string (*one valid token before this*)
(* spacey comment here
over multiple lines
will it work? *)
"
'''
'\'
false
(**)
'''
nullfalse
"nulltrue
@ -21,6 +27,7 @@ true
'n'
'\'
'fdsf'
(*/jnewjno2893u86^ Lots of random characters /n /t '") *)
'
'
' '