Release v1.0 - Evaluation of Portuguese Language Models
We are excited to announce the release of v1.0 of our ongoing research on fine-tuning Transformer models for Portuguese natural language understanding tasks. All of our fine-tuned models have been integrated into an appropriate Hugging Face Space. You can now interact with our models in your browser by exploring our demos:
- Portuguese Offensive Language Detection
- Portuguese Question Answering
- Portuguese Semantic Similarity
- Portuguese Textual Entailment
- Portuguese Text Simplification
Our fine-tuning procedure has achieved results that are either slightly superior or at the same level as the previous state-of-the-art (if any). We performed hyperparameter optimization using quasi-random search based on Google's Deep Learning Playbook instructions.
The release also includes a detailed summary of the fine-tuning procedure, and a summary of the results achieved on each dataset.