JUnitBenchmarks will turn your JUnit4 tests into performance micro-benchmarks in a matter of a few simple annotations; it can also generate per-run and historical charts from the data it collects; see Carrot Search Labs for documentation and detailed tutorials.