何时使用术语“定界符”？ “终结者”，和“分隔符”
“定界符”、“终止符”和“分隔符”等词的使用背后的语义是什么？例如，我相信每个标记之后会出现一个终止符，并且每个标记之间会出现一个分隔符。分隔符与其中任何一个相同，还是它们只是分隔符的形式？
SO 具有所有三个标签，但它们不是彼此的同义词。这是因为它们确实不同吗？
What are the semantics behind usage of the words "delimiter," "terminator," and "separator"? For example, I believe that a terminator would occur after each token and a separator between each token. Is a delimiter the same as either of these, or are they simply forms of a delimiter?
SO has all three as tags, yet they are not synonyms of each other. Is this because they are all truly different?
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（10）
定界符表示某事物的界限，从哪里开始，从哪里结束。例如：
有两个分隔符，两者恰好都是双引号字符。分隔符表明什么是事物的一部分，什么不是。
分隔符区分序列中的两个事物：
分隔符的作用是划分两个不同的实体，以便可以区分它们。 （请注意，我说“两个”是因为在计算机科学中我们通常谈论处理线性字符序列）。
终止符表示序列的结束。在 CSV 中，您可以将换行符视为终止一行上的记录，或者将一条记录与下一条记录分开。
令牌边界通常由语法类的更改来表示：
可能会被标记为
word(foo)、lparen、rparen- 没有标记之间没有任何显式分隔符，但标记生成器可以识别字母和标点字符之间语法类的变化。这些类别并不完全不同。例如：
可以（取决于您的语法）是三个项目的列表；中括号界定列表，右中括号终止列表并标记
blue标记的结束。至于 SO 使用这些术语作为标签，它们只是：指示问题主题的标签。标签没有一个统一的受控词汇表；任何有足够业力的人都可以添加新标签。术语之间存在足够多的差异，以至于您永远不可能在所涵盖的所有主题中拥有单一的受控标签词汇表。
A delimiter denotes the limits of something, where it starts and where it ends. For example:
has two delimiters, both of which happen to be the double-quote character. The delimiters indicate what's part of the thing, and what is not.
A separator distinguishes two things in a sequence:
The role of a separator is to demarcate two distinct entities so that they can be distinguished. (Note that I say "two" because in computer science we're generally talking about processing a linear sequence of characters).
A terminator indicates the end of a sequence. In a CSV, you could think of the newline as terminating the record on one line, or as separating one record from the next.
Token boundaries are often denoted by a change in syntax classes:
would likely be tokenised as
word(foo),lparen,rparen- there aren't any explicit delimiters between the tokens, but a tokenizer would recognise the change in grammar classes between alpha and punctuation characters.The categories aren't completely distinct. For example:
could (depending on your syntax) be a list of three items; the brackets delimit the list and the right-bracket terminates the list and marks the end of the
bluetoken.As for SO's use of those terms as tags, they're just that: tags to indicate the topic of a question. There isn't a single unified controlled vocabulary for tags; anyone with enough karma can add a new tag. Enough differences in terminology exist that you could never have a single controlled tag vocabulary across all of the topics that SO covers.
从技术上讲，分隔符位于事物之间，也许是为了告诉您一个字段在哪里结束而另一个字段在哪里开始，例如在逗号分隔值 (CSV) 文件中。
终止符出现在某物的末尾，终止行/输入/任何内容。
分隔符可以是分隔符或任何其他分隔事物的东西。例如，考虑英语中单词之间的空格。
您可能会认为换行符是行终止符、行分隔符或分隔两行的字符。因此，Unicode 规范中有一些不同的换行符。
Technically a delimiter goes between things, perhaps in order to tell you where one field ends and another begins, such as in a comma-separated-value (CSV) file.
A terminator goes at the end of something, terminating the line/input/whatever.
A separator can be a delimiter or anything else that separates things. Consider the spaces between words in the English language for example.
You could argue that a newline character is a line terminator, a delimiter of lines or something that separates two lines. For this reason there are a few different newline-type characters in the Unicode specification.
分隔符是一两个显示某事物开始和结束的标记。它们是需要的，因为我们不知道那个“东西”会持续多久。我们可以有： 1. 一个单个分隔符，或 2. 一对对分隔符
[a, b, c, d, e] 每个逗号 (,) 都是一个单个分隔符。左右括号 ([,]) 是成对分隔符。"hello"，两个引号 (") 是对分隔符分隔符 是 a 的同义词“分隔符”，但根据我的经验，它通常指字段分隔符 字段分隔符充当一个字段与其后面的字段之间的分隔符，这就是为什么它可以被视为“分隔”。他们。
␜␜ ␜)，尽管名称明确具有“分隔符”，但都是 < em>分隔符和分隔符终止符标记一组事物的结束，再次需要它，因为我们不知道它有多长。
abdefa\0，这里的空字符\0是一个终止符，它告诉我们字符串已经结束foo\n。 code>，这里的换行符\n是一个终止符，告诉我们该行已经结束。术语、分隔符、分隔符起源于存储的经典思想，从概念上讲，由文件、记录和fields，（一个文件有很多条记录，一条记录有很多字段）。在这种情况下，单个分隔符和成对分隔符可能称为记录分隔符和字段分隔符。由于文件记录字段分类法的历史意义，该术语具有更广泛的用途（请参阅维基百科页面 分隔符）。
下面是两个文件，每个文件包含三个记录，每个记录有四个字段：
这里，
、和\n正如我们所知是单个分隔符，但它们也可以称为记录分隔符和分别是字段分隔符。对于复杂的嵌套结构，终止符也可以是定界符/分隔符（它们不是互斥的定义）。在前面的示例中，文件内部的
===标记可以被视为终止符（它是文件的结尾）。但是当我们查看许多文件时，===的作用就像一个分隔符/分隔符。考虑 UNIX 文件中的行
换行符既是终止符（它们告诉我们字符串在哪里结束），又是分隔符（它们告诉我们每行的开始和结束位置）。来自维基百科：
<块引用>
查看换行符的两种方法都是自洽的，换行符要么分隔行，要么终止行。
换行符
实际上，当您谈论一项单独的项目时，您只需要说“终止符”（只需一个字符串
1234\0，只需一行abcd\n，等）——并且不清楚这种情况下的终止符是否也可以是更复杂的父结构中的分隔符。A delimiter is one or two markers that show the start and end of something. They're needed because we don't know how long that 'something' will be. We can have either: 1. a single delimiter, or 2. a pair of pair-delimiters
[a, b, c, d, e]each comma (,) is a single delimiter. The left and right brackets, ([,]) are pair-delimiters."hello", the two quote symbols (") are pair-delimitersA seperator is a synonym of a "delimiter", but from my experience it usually refers to field delimiters. A field delimiter acts as a divider between one field and the one following it, which is why is can be though of as "separating" them.
<file1>␜<file2>␜<file3>, the file separator character (␜), despite explicitly the name having "separator", is both a delimiter and a separatorA terminator marks the end of a group of things, again needed because we don't know how long it is.
abdefa\0, here the null character\0is a terminator that tells us the string has ended.foo\n, here the newline character\nis a terminator that tells us the line has ended.The terms, delimiter, separator originate from the classical idea of storage, conceptually, being comprised of files, records, and fields, (a file has many records, a record has many fields). In this context, a single delimiter and pair-delimiters might be called record delimiters and field delimiters. Because of the historical significance of files-records-field taxonomy, this terms have a more widespread usage (see Wikipedia page for Delimiter).
Below are two files, each with three records with each record having four fields:
Here,
,and\nas we know are single delimiters, but they might also be called a record delimiters and field delimiters respectively.For complex nested structures, a terminator can also be a delimiter/separator (they're not mutually exclusive definitions). From the previous example, the
===marker from inside a file could be considered a terminator (it's the end of the file). But when we look at many files, the===acts like a delimiter/separator.Consider lines in a UNIX file
The newlines are both terminators (they tell us where the string ends) and are delimiters (they tell us where each line begins and ends). From Wikipedia:
Really you'll only need to say "terminator" when you're talking at one individual item, (just one string
1234\0, just one lineabcd\n, etc.) -- and it'll be unclear whether the terminator in this context could also be a delimiter in a more complex parent structure.此回复是在 CSV 上下文中进行的，因为提供的所有答案都集中于英语。
分隔符是给定CSV规范中提到的描述内容边界的所有元素，分隔符是字段分隔符的通用名称，终止符是记录分隔符的通用名称。
分隔符是 CSV 格式规范的一部分，它定义边界并且不一定是可打印字符。
终止符、分隔符和字段限定符是分隔符，但不是指定 CSV 格式所必需的，例如 10 列字段分隔符和 30 列记录分隔符表示每 30 列是一条记录，每 10 列是一个字段（通常用空格填充）。换句话说，没有分隔符的 CSV 格式具有恒定的字段和记录长度，例如：
终止符是标记单个 CSV 记录结束的分隔符，通常用换行符 (
LF)、a回车符 (CR) 或两者的组合（例如CRLF），例如：分隔符是标记 CSV 字段之间分隔的分隔符，通常用逗号表示（或一个分号），它被引入来存储动态长度值，例如 CSV 格式的两个逗号分隔的记录，在
1和0之后带有CRLF终止符：字段限定符是通常成对使用而不是转义序列的分隔符。它是字段值中不允许的可打印字符（除非给定的 CSV 格式规范提供了转义序列）并标记字段的开头和结尾，引入它来存储包含分隔符的值，例如此 CSV 有 2 个分隔符每个包含 3 个字段但第 3 个字段值的记录可以包含一个分号，否则该分号充当字段分隔符：
转义序列是一个字符（或一组字符），它将转义序列后面的任何内容标记为不重要，因此作为一部分领域的值（例如反斜杠可能指定紧随其后的分隔符作为值的一部分）。此序列可以转义一个或多个字符，例如 CSV 将
\作为 1 个字符转义序列：This response is in context of CSV because all of the provided answers focus on English language instead.
Delimiters are all elements mentioned in the given CSV specification that describe the boundaries of stuff, separator is a common name for field delimiters, terminator is a common name for record delimiters.
Delimiter is a part of CSV format specification, it defines boundaries and doesn't have to be a printable character.
Terminators, separators and field qualifiers are delimiters but are not necessary to specify a CSV format, e.g. 10 columns field delimiter and 30 columns record delimiter mean each 30 columns are one record and each 10 columns are one field (usually padded with white space). In other words CSV format without separators has a constant field and record length, e.g.:
Terminator is a delimiter that marks the end of a single CSV record and is usually represented either by Line Feed (
LF), a Carriage Return (CR) or a combination of both (e.g.CRLF), e.g.:Separator is a delimiter that marks the division between CSV fields and is most often represented by a comma (or a semicolon), it has been introduced to store dynamic length values, e.g. two comma separated records in CSV format with
CRLFterminator after1and0:Field qualifier is a delimiter usually used in pairs instead of escape sequence. It is a printable character that isn't allowed in the field value (unless given CSV format specification provides the escape sequence) and marks the beginning and the end of a field, it was introduced to store values containing separators, e.g. this CSV has 2 records with 3 fields each but 3rd field value can contain a semicolon that otherwise acts as a fields separator:
Escape sequence is a character (or a set of characters) that marks anything that follows the escape sequence as non-significant and therefore as a part of the field value (e.g. backslash might specify the immediately following separator as a part of the value). This sequence can escape one or multiple characters, e.g. CSV with
\as a 1 character escape sequence:有趣的问题和答案。总而言之，1）分隔符标记某事物的“界限”，即开始和/或结束； 2）终止符只是“结束定界符”的特殊术语； 3) 分隔符需要其两侧都有项目（与分隔符不同）。
我能想到的起始分隔符的最佳示例是编程语言中的起始注释标记（“#”、“//”等）。
我能想到的终止符（结束定界符）的最好例子是 Unix 中的换行符。这是一个用词不当——它总是终止一行（可能是空行），但并不总是开始一个新行，即当它是文件中的最后一个字符时。也许一个更好的常见例子是句子的简单句号。
我能想到的分隔符的最佳示例是简单的逗号。请注意，英文中的逗号永远不会在其前后没有文字的情况下出现。
有趣的是，这些都不一定限于单字符。事实上，Unix 中的 awk（或者可能只是 gawk？）允许 FS（字段分隔符）为任何正则表达式。
此外，尽管在 wc 命令中“任何非零数量的空白”被视为“单词分隔符”，但在正则表达式中也存在零宽度“单词边界”说明符（例如 \b）。有趣的是思考这样的零宽度项目/边界是否也可以被视为“分隔符”。我倾向于认为不会（太过牵强）。
Interesting question and answers. To summarize, 1) delimiter marks the "limits" of something, i.e. beginning and/or end; 2) terminator is just a special term for "end delimiter"; 3) separator entails there are items on both sides of it (unlike delimiter).
Best example I can think of for a start delimiter is the start-comment markers in programming languages ("#", "//", etc.).
Best example I can think of for a terminator (end delimiter) is the newline character in Unix. It's a misnomer -- it always terminates a (possibly empty) line but doesn't always start a new line, i.e. when it is the last character in a file. Maybe a better common example is the simple period for sentences.
Best example I can think of for a separator is the simple comma. Note that comma never appears in English without text both before and after it.
Interesting to note that none of these is necessarily limited to single-character. In fact awk (or maybe only gawk?) in Unix allows FS (field separator) to be any regexp.
Also, although "any non-zero amount of whitespace" is considered a "word delimiter" in e.g. the wc command, there are also zero-width "word boundary" specifiers in regexps (e.g. \b). Interesting to ponder whether such zero-width items/boundaries could be considered "delimiters" as well. I tend to think not (too much of a stretch).
分隔符
分隔符有多种含义：作为句子中使用的空格（边界）。
分隔符就像边界，它存在于国家/地区之间。
从这个意义上说，必须有两个国家才有边界。
单词之间通常存在空格，但末尾不存在空格。空格界定单词，但不
终止句子（单词的集合）。句子：这是一个短句。
有四个空格，它们充当单词分隔符。没有结束空间。
事实上，还有两个通常未命名的附加分隔符：句子的开头和结尾。就像正则表达式中使用
^和$来标记文本字符串的开头和结尾。而且，在人类语言中，标点符号（点、逗号、分号、冒号等）也可用作单词分隔符（除了空格之外）
用于引号（边界）。
像这样的句子：
“这是一个短句子。”
由双引号 (
“”) 分隔（开始和结束）。从这个意义上说，它就像“平衡分隔符”（维基百科中的平衡括号）。< /p>有些人可能会认为前沿和边界本质上是相同的，并且在某些条件下它们实际上是正确的。
分隔符
与分隔符（边界）的第一个含义（上面）完全相同。
因此，在许多计算机用途中，
分隔符是分隔符的同义词。终结符
标定单个“字段”的结束。
就像 Unix 文本文件中的换行符一样。每行都以换行符 (
\n) 结束。在正确的 Unix 文本文件中，所有行都会终止（甚至是最后一行）。
在人类语言中，相似的段落以换行符结束。
或者，更严格，如 NUL (
\0) 是 终止符C 字符串：因此，终止符也是分隔符，但必须也出现在末尾。
标签
Stackoverflow 仅具有分隔符和分隔符的标签
delimiterA分隔符是一个或多个字符的序列，用于指定纯文本或其他数据流中单独的、独立的区域之间的边界。
分隔符分隔字符串各部分的字符。
终止符标签仅适用于 shell 终端模拟器：
terminatorTerminator 是一个 GPL 终端模拟器。
而且，是的，定界符和分隔符很多时候是等效的
除了圆括号、大括号、方括号和类似的平衡分隔符。
Delimiter
There are a couple of senses for
delimiter:As the space used in sentences (frontier).
A delimiter is like a frontier, it exists between countries.
In that sense, there must be two countries to have a frontier.
An space usually exists between words, but not at the end. The space delimits words but does not
terminatesentences (collection of words). The sentence:This is a short sentence.
Has four spaces, they act as word delimiters. There is no ending space.
In fact, there are two additional delimiters usually not named: The start and end of the sentence. Like the
^and$used in regular expressions to mark the start and end of an string of text.And, in human language, there are punctuation marks (dot, comma, semicolon, colon, etc.) that serve also as word delimiters (additionally to spaces)
As used in quotes (boundary).
A sentence like:
“This is a short sentence.”
Is
delimited(start and end) by the double quotes (“”). In this sense it is like "balanced delimiters" (Balanced Brackets in Wikipedia).Some may argue the
frontierand boundary are essentially the same, and, under some conditions they actually are correct.Separator
Is exactly the same as the first sense (above) of a delimiter (a frontier).
So, a
separatoris a synonym of delimiter in many computer uses.Terminator
Demarcate the end of an individual "field".
Like the newlines in a Unix text file. Each line is terminated by a NewLine (
\n).In a proper Unix text file all lines are terminated (even the last one).
Like paragraphs are terminated by a newline in human language.
Or, more strictly, as the NUL (
\0) is the terminator of a C string:So, a terminator character is also a delimiter but must also appear at the end.
Tags
Stackoverflow has tags only for delimiters and separators
delimiterA delimiter is a sequence of one or more characters used to specify the boundary between separate, independent regions in plain text or other data streams.
separatorA character that separates parts of a string.
The terminator tag only apply to a shell terminal emulator:
terminatorTerminator is a GPL terminal emulator.
And, yes, delimiter and separator are many times equivalent
except for the parenthesis, braces, square brackets and similar balanced delimiters.
添加到此处的答案中，我使用了术语记数器。
注释是特定文档中使用的所有符号和标记。例如，“TODO List”文档必须是行分隔的字符串列表。
符号是用于表示特定含义的标记。例如，“字符串用引号引起来”是一种表示法。
分隔符是用于表示符号的字符或字符集。例如，字符引号是字符串的分隔符。
终止符是结束分隔符，前缀是起始分隔符。对于“TODO List”文档，引号可以用作前缀和终止分隔符。
分隔符是分隔两个事物的分隔符。例如，“新行”是每个“TODO 列表”项目的分隔符。在这个例子中，“new line”也是一个终止符；可以使用新行来终止每行。分隔符同时也是终止符是典型的情况，但不能保证始终如此。
分隔符也可以是“位置的”。位置分隔的示例是列分隔的大型机平面文件。
Adding to the answer here already, I use the term notator.
Annotation is all notation and markup used in a particular document. For example, a "TODO List" document must be a line separated list of strings.
Notation is markup used to denote specific meaning. For example, "string are in quotes" is a notation.
A delimiter is the character or set of characters used to denote a notation. For example, the character quote is the delimiter for strings.
A terminator is ending delimiter and prefix is the starting delimiter. For the "TODO List" document, quote may be used as the prefix and terminating delimiter.
A seperator is a delimiter that separates two things. For example, "new line" is the separator for each "TODO List" item. In this example, "new line" is also a terminator; a new line may be used to terminate each line. A separator also being a terminator is typical, but not guaranteed to always be the case.
Delimiters can also be "positional". A positionally delimited example is a column delimited mainframe flat file.
当您以空开始时，终止符是分隔符。 A;B;C;实际上是A;B;C;空。
Terminators are separators when you start with empty. A;B;C; is actually A;B;C;empty.
"word 1", "word 2" \NULL
"word 1", "word 2" \NULL
就像英语一样，有技术上正确的答案和普遍使用的答案，并且它可能与所寻求的术语定义的编程用法相关。
业界长期以来使用短语“逗号分隔”文件来表示：
FirstRowFirstValue、FirstRowSecondValue、FirstRowThirdValue
SecondRowFirstValue,SecondRowSecondValue,SecondRowThirdValue
从技术上讲，这是一个逗号“分隔”列表。
从技术上讲，这是一个逗号“分隔”列表。
,第一行第一值,第一行第二值,第一行第三值,
,SecondRowFirstValue,SecondRowSecondValue,SecondRowThirdValue，
或：
,FirstRowFirstValue,,FirstRowSecondValue,,FirstRowThirdValue,
,SecondRowFirstValue,,SecondRowSecondValue,,SecondRowThirdValue，
但没有人这样做。曾经。
行业标准是使用“TEXT QUALIFIER”作为“DELIMITER”的技术定义，其中 (") 是“TEXT QUALIFIER”，(,) 称为“DELIMITER”。FirstRowFirstValue
,"First Row Second Value",第一行第三值
第二行第一值、第二行第二值、第二行第三值
Just like the English language, there is the technically correct answer, and the generally used answer, and it is probably relevant to isolate to the programming usage of the term definitions being sought.
The industry has long used the phrase 'Comma Delimited' file to mean:
FirstRowFirstValue,FirstRowSecondValue,FirstRowThirdValue
SecondRowFirstValue,SecondRowSecondValue,SecondRowThirdValue
TECHNICALLY, this is a Comma 'SEPARATED' list.
TECHNICALLY, THIS is a Comma 'DELIMITED' list.
,FirstRowFirstValue,FirstRowSecondValue,FirstRowThirdValue,
,SecondRowFirstValue,SecondRowSecondValue,SecondRowThirdValue,
or this:
,FirstRowFirstValue,,FirstRowSecondValue,,FirstRowThirdValue,
,SecondRowFirstValue,,SecondRowSecondValue,,SecondRowThirdValue,
and nobody does that. Ever.
And the industry standard is to use 'TEXT QUALIFIER' for the TECHNICAL definition of a 'DELIMITER' where (") is the 'TEXT QUALIFIER' and (,) is called the 'DELIMITER'.
FirstRowFirstValue,"First Row Second Value",FirstRowThirdValue
SecondRowFirstValue,SecondRowSecondValue,SecondRowThirdValue