SPARQL Query Benchmarker is an API and command line utility that can be used to run configurable automated benchmarks with detailed performance reporting on an arbitrary SPARQL endpoint.
This tool was developed while working for YarcData™ (a Cray Inc. company) and was open sourced in July 2012. I presented this tool at SemTech 2012 with slides available on SlideShare.
More recently the tool has undergone a significant rewrite to make it a flexible automated SPARQL testing framework and this work was presented at SemTech 2014 with slides available on SlideShare.
Downloads for the benchmarker may be obtained from the SourceForge project page.
Source Code for the benchmarker may be obtained from the SourceForge project page.