Skip to content

Commit

Permalink
#42 fixed
Browse files Browse the repository at this point in the history
  • Loading branch information
mittelholcz committed Sep 23, 2021
1 parent 591bd88 commit 19830cf
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 1 deletion.
2 changes: 1 addition & 1 deletion src/quex_modules/preproc.qx
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ token {
}

define {
IGNORABLE [\X200D]
IGNORABLE [\X200D\XFEFF]
}

mode PROGRAM {
Expand Down
4 changes: 4 additions & 0 deletions test/test_default_preproc_invalid.txt
Original file line number Diff line number Diff line change
Expand Up @@ -41,3 +41,7 @@ OUT: Mlóg
Ignorálás (ZERO WIDTH JOINER, U+200D)
IN : >>‍<
OUT: >><

Ignorálás (zero width no-break space , U+FEFF)
IN : >><
OUT: >><

0 comments on commit 19830cf

Please sign in to comment.