Commit b7d3c264 authored by Hans-Peter Deifel's avatar Hans-Peter Deifel 🐢

Add micro-benchmarks for lexer

The lexer is one of the bottlenecks for parsing. With these
fine-grained benchmarks, we can make more educated guesses about what
to optimize.
parent e6ca3a62