Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
patrick-tssn committed Jun 17, 2024
1 parent fc18a07 commit 8f35f69
Showing 1 changed file with 14 additions and 3 deletions.
17 changes: 14 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ For detailed instructions on installation and checkpoints, please consult the [I

### Usage

inference
debug inference pipeline
```bash
cd baselines
python ../model_testing_zoo.py --model_name Gemini-1.5-pro # ["VideoChatGPT", "Valley", "Video-LLaMA-2", "VideoChat2", "VideoLLaVA", "LLaMA-VID", "VideoLaVIT", "PLLaVA", "PLLaVA-13B", "PLLaVA-34B", "LLaVA-NeXT-Video", "LLaVA-NeXT-Video-34B", "Gemini-1.5-pro", "GPT4V", "LLaVA"])
Expand All @@ -127,7 +127,7 @@ python ../model_testing_zoo.py --model_name Gemini-1.5-pro # ["VideoChatGPT", "V
evaluate on VideoHallucer
```bash
cd baselines
python ../evaluations/evaluation.py --model_name Gemini-1.5-pro --eval_obj # [--eval_obj_rel, --eval_temporal, --eval_semantic, --eval_fact, --eva_nonfact]
python ../evaluations/evaluation.py --model_name Gemini-1.5-pro --eval_obj --eval_obj_rel, --eval_temporal, --eval_semantic, --eval_fact, --eva_nonfact
```


Expand Down Expand Up @@ -161,4 +161,15 @@ more detailed results see `baselines/results`


- We thank [vllm-safety-benchmark](https://github.com/UCSC-VLAA/vllm-safety-benchmark) for inspiring the framework of VideoHallucerKit.
- We thank Center for AI Safety for supporting our computing needs.
- We thank Center for AI Safety for supporting our computing needs.

## Citation

```bibtex
@article{videohallucer,
title={VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Models},
author={Wang, Yuxuan and Wang, Yueqian and Zhao, Dongyan and Xie, Cihang and Zheng, Zilong},
journal={github},
year={2024}
}
```

0 comments on commit 8f35f69

Please sign in to comment.