如何在 JavaCC 中处理文本块内的标记？

发布于 2024-10-06 17:49:53 字数 1007 浏览 3 评论 0原文

我有一个 DSL 的简单方面，我可以在其中定义一个键和一个值：

<前><代码>mykey=\ 这是我的$REF{有用} 多行细绳我以反斜杠终止但我支持转义 \\ 字符我希望处理这个字符串的值部分在本例中为 3 个块。 \

在这个例子中我想要的三个标记（对于值部分）是

ValueLiteral == This is my
ValueReference == $REF{useful}
ValueLiteral == multiline 等等......

我为值定义了一个规则，如下所示：

void multiLineValue(): {} {
  < BACKSLASH >< EOL >
  (
    valuePartLiteralMulti() |
    valuePartRef()
  )*
  < BACKSLASH >
}

这里是我对多行字符串类型的 TOKEN 定义：

TOKEN :
{
     < MULTILINE_STRING:(  ( (~["\\"])
    | ("\\"
        ( ["\\", "'", "\"", "$", "n", "r", "t", "b", "f"]
        | ["u", "U"]["+"]["0"-"9","a"-"f","A"-"F"]["0"-"9","a"-"f","A"-"F"]["0"-"9","a"-"f","A"-"F"]["0"-"9","a"-"f","A"-"F"]
        )
      ) ))+>
}

我的问题是我的多行字符串标记类型也消耗 '$REF{' 字符的字符序列。

我想修改这个多行字符串，以便它在遇到未转义的“$REF{”时停止消耗字符（但将继续读取“\$REF{”序列）。

任何帮助将不胜感激。

原文

I have a simple aspect of a DSL where I can define a key and a value as such:

mykey=\
   This is my $REF{useful}
   multiline
   string
   where I terminate with a backslash
   but I support escaped \\ characters
   and I wish to handle the value part of this string
   as 3 blocks in this example.
\

The three tokens (for the value part) I would like in this example are

ValueLiteral == This is my
ValueReference == $REF{useful}
ValueLiteral == multiline etc....

I defined a rule for the value as such:

void multiLineValue(): {} {
  < BACKSLASH >< EOL >
  (
    valuePartLiteralMulti() |
    valuePartRef()
  )*
  < BACKSLASH >
}

Here is my TOKEN definition for the multiline string type:

TOKEN :
{
     < MULTILINE_STRING:(  ( (~["\\"])
    | ("\\"
        ( ["\\", "'", "\"", "$", "n", "r", "t", "b", "f"]
        | ["u", "U"]["+"]["0"-"9","a"-"f","A"-"F"]["0"-"9","a"-"f","A"-"F"]["0"-"9","a"-"f","A"-"F"]["0"-"9","a"-"f","A"-"F"]
        )
      ) ))+>
}

My problem is that my multi line string token type also consumes the character sequence of the '$REF{' characters.

I would like to modify this multi-line string so that it will stop consuming characters when it encounters an unescaped "$REF{" (but will continue reading past a "\$REF{" sequence).

Any assistance would be much appreciated.

分享到QQ

分享到微博