In this card, we provide a text preprocessing tool named "Pyplexity". This tool is available as a Python package through PyPi to preprocess text for different downstream tasks:
pip install pyplexity
You can also check the documentation here. We have also created a web demo.
Please cite our research:
Fernández-Pichel, M., Prada-Corral, M., Losada, D. E., Pichel, J. C., & Gamallo, P. (2023). An unsupervised perplexity-based method for boilerplate removal. Natural Language Engineering, 1-18.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.