Dataset Evaluation

This is the repo for dataset evaluation of the Impossible Distillation - LoRA Replication Project

Replication

Evaluate DIMPLE on semantic similarity and Tree Edit Distance

Extension

Evaluation self-generated dataset on the same benchmarks

For semantic similarity and syntatic diversity run the following code in your terminal

bash setup.sh
sbatch evaluate.sh
bash setup_simcse.sh
sbatch sematical_sim.sh
bash setup_java.sh
sbatch ted_score.sh