DKPro Lab - Welcome
DKPro Lab is a lightweight framework for parameter sweeping experiments. It allows to set up experiments consisting of multiple interdependent tasks in a declarative manner with minimal overhead. Parameters are injected into tasks using via annotated class fields. Data produced by a task for any particular parameter configuration is stored and re-used whenever possible to avoid the needless recalculation of results. Reports can be attached to each task to post-process the experimental results and present them in a convenient manner, e.g. as tables or charts.
The source code is provided under the Apache Software License (ASL) version 2.
The source code including examples is already available from the Git repository here. A binary release via Maven will be prepared soon. If you are interested in the project, please subscribe to the users group.
If you use DKPro Lab in scientific work, please cite
Eckart de Castilho, R. and Gurevych, I. (2011). A lightweight framework for reproducible parameter sweeping in information retrieval. In Proceedings of the 2011 workshop on Data infrastructurEs for supporting information retrieval evaluation, DESIRE ’11, pages 7–10, New York, NY, USA. ACM. (link)