Geben Sie ein Wort oder eine Phrase in einer beliebigen Sprache ein 👆
Sprache:
Übersetzung und Analyse von Wörtern durch künstliche Intelligenz ChatGPT
Auf dieser Seite erhalten Sie eine detaillierte Analyse eines Wortes oder einer Phrase mithilfe der besten heute verfügbaren Technologie der künstlichen Intelligenz:
- wie das Wort verwendet wird
- Häufigkeit der Nutzung
- es wird häufiger in mündlicher oder schriftlicher Rede verwendet
- Wortübersetzungsoptionen
- Anwendungsbeispiele (mehrere Phrasen mit Übersetzung)
- Etymologie
Was (wer) ist tokenized - definition
COMPUTING PROCESS OF PARSING A SEQUENCE OF CHARACTERS INTO A SEQUENCE OF TOKENS
Lexical Analysis; Lexical analyzer; Token (parser); Lexer; Lexical token; Lexical analyser; Scanner (computing); Tokenize; Lexing; Tokenise; Tokenized; Tokenizing; Lexical parser; Tokenizer; Tokeniser; Tokenization (lexical analysis); Token splitting; Token scanner; Lexer generator; Lexer (computer science); Semicolon insertion; List of lexer generators; Lexical syntax; Lexeme (computer science); Automatic semicolon insertion; Lexers
Lexical analysis
In computer science, lexical analysis, lexing or tokenization is the process of converting a sequence of characters (such as in a computer program or web page) into a sequence of lexical tokens (strings with an assigned and thus identified meaning). A program that performs lexical analysis may be termed a lexer, tokenizer, or scanner, although scanner is also a term for the first stage of a lexer.
lexical analyser
<language> (Or "scanner") The initial input stage of a
language processor (e.g. a compiler), the part that performs
lexical analysis.
(1995-04-05)
tokenism
UNFAIR PRACTICE INVOLVING MINORITIES
Token wife; Token black guy; Token character; Token minority; Token negro; Token woman; Token gesture; Tokenist
If you refer to an action as tokenism, you disapprove of it because you think it is just done for effect, in order to show a particular intention or to impress a particular type of person.
Is his promotion evidence of the minorities' advance, or mere tokenism?
N-UNCOUNT [disapproval]
Wikipedia
Lexical analysis
In computer science, lexical analysis, lexing or tokenization is the process of converting a sequence of characters (such as in a computer program or web page) into a sequence of lexical tokens (strings with an assigned and thus identified meaning). A program that performs lexical analysis may be termed a lexer, tokenizer, or scanner, although scanner is also a term for the first stage of a lexer. A lexer is generally combined with a parser, which together analyze the syntax of programming languages, web pages, and so forth.
