class Prism::LexCompat::Token

When we produce tokens, we produce the same arrays that Ripper does. However, we add a couple of convenience methods onto them to make them a little easier to work with. We delegate all other methods to the array.

Public Instance Methods

event() click to toggle source

The type of the token.

# File prism/lex_compat.rb, line 213
def event
  self[1]
end

location() click to toggle source

The location of the token in the source.

# File prism/lex_compat.rb, line 208
def location
  self[0]
end

state() click to toggle source

The state of the lexer when this token was produced.

# File prism/lex_compat.rb, line 223
def state
  self[3]
end

value() click to toggle source

The slice of the source that this token represents.

# File prism/lex_compat.rb, line 218
def value
  self[2]
end