List of usage examples for org.antlr.v4.runtime TokenSource interface-usage
From source file ai.grakn.graql.internal.parser.ChannelTokenSource.java
/**
* Implementation of {@link TokenSource} that wraps another {@link TokenSource}, only allowing tokens through if they
* match the expected channel.
* <p>
* This class is necessary when using the {@link UnbufferedTokenStream} to parse extremely large files, because
* that class does not filter out e.g. whitespace and comments.
From source file annis.ql.parser.ListTokenSource.java
/** * * @author Thomas Krause <krauseto@hu-berlin.de> */ public class ListTokenSource implements TokenSource { private final List<Token> token;
From source file org.corpus_tools.annis.ql.parser.ListTokenSource.java
/** * * @author Thomas Krause <krauseto@hu-berlin.de> */ public class ListTokenSource implements TokenSource { private final List<Token> token;
From source file org.eclipse.titan.designer.AST.ASN1.Block.java
/**
* Represents a block of tokens.
* <p>
* In ASN.1 most of the tokens inside blocks can not be analyzed directly in
* parse time. For this reason we are collecting them in such blocks, and when
* the semantics are, these blocks are processed.
From source file org.eclipse.titan.designer.parsers.asn1parser.BlockTokenSource.java
public class BlockTokenSource implements TokenSource { private List<Token> tokenList; int index; BlockTokenSource(List<Token> tokenList) { this.tokenList = tokenList;