DKPro BigData enables the easy execution of UIMA-based natural language processing pipelines on a hadoop cluster.

Features

• Large scale NLP processing using UIMA and hadoop
• Store your corpora on a Hadoop filesystem and access them from local or distributed pipelines
• Find patterns in your textual data using adaptable collocation extraction

Details

• Execute DKPro pipelines on a hadoop cluster with minimal adaption
• Read data stored on a HDFS Filesystem using DKPro Collection Readers
• Read/Write serialized CASes from HDFS

Contributors:

• Hans-Peter Zorn
• Johannes Simon
• Martin Riedl
• Richard Eckart de Castilho
• Steffen Remus

License

DKPro BigData is licensed under the Apache Software Licence (ASL) Version 2.0.

This project is a joint effort of UKP Lab and the Language Technology Group, Technical University of Darmstadt.