Note that JavaCC defines lots of public, classes, methods and fields that do not need to be public. These clutter the documentation. Sorry.
Note that because JavaCC defines a class named Token, org.apache.lucene.analysis.Token must always be fully qualified in sourced code in this package.