[build][core] regex for token value and token morphologies