Awesome MLLM Uncertainty

⭐⭐⭐ If you find this repo useful, please star it!

Discussion

🏄🏄🏄 Welcome to join our MLLM uncertainty discussion group (the left QR code)! Or add my WeChat (the right QR code) to enter the group if the group QR code expires~

Awesome List

• DropoutDecoding From Uncertainty to Trust: Enhancing Reliability in Vision-Language Models with Uncertainty-Guided Dropout Decoding (9 Dec 2024)

• VL-Uncertainty VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation (18 Nov 2024)

• MUB Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios (5 Nov 2024)

• CrossPred-LVLM Can We Predict Performance of Large Models across Vision-Language Tasks? (14 Oct 2024)

• Reference-free Hallucination Detection for Large Vision-Language Models (11 Aug 2024, EMNLP 2024 Findings)

• Semantic Entropy Detecting Hallucinations in Large Language Models Using Semantic Entropy (19 Jun 2024, Nature)

• UAL Uncertainty Aware Learning for Language Model Alignment (7 Jun 2024, ACL 2024)

• HIO Alleviating Hallucinations in Large Vision-Language Models through Hallucination-Induced Optimization (24 May 2024, NeurIPS 2024)

• Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Models (5 May 2024, TrustNLP 2024))

• Consistency and Uncertainty Consistency and Uncertainty: Identifying Unreliable Responses From Black-Box Vision-Language Models for Selective Visual Question Answering (16 Apr 2024, CVPR 2024)

• UPD Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models (29 Mar 2024)

• ICD Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding (27 Mar 2024, ACL 2024 Findings)

• The First to Know The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models? (14 Mar 2024, ECCV 2024)

• VLM-Uncertainty-Bench Uncertainty-Aware Evaluation for Vision-Language Models (22 Feb 2024)

• LogicCheckGPT Logical Closed Loop: Uncovering Object Hallucinations in Large Vision-Language Models (18 Feb 2024, ACL 2024 Findings)

• UQ_ICL Uncertainty Quantification for In-Context Learning of Large Language Models (15 Feb 2024, NAACL 2024)

• LLM-Uncertainty-Bench Benchmarking LLMs via Uncertainty Quantification (23 Jan 2024, NeurIPS 2024 Datasets & Benchmarks)

• VCD Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding (28 Nov 2023, CVPR 2024 Highlight)

• MAP MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model (11 Oct 2022, CVPR 2023)

• Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs (22 Jun 2023, ICLR 2024)

• Semantic Uncertainty Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation (19 Feb 2023, ICLR 2023 Spotlight)