How to integrate SAM architecture into mmseg for finetuning?

[Hectormxy]

Could it be possible to integrate SAM, the interactive segmentation model, into the mmseg model zoo? If not, how can I customise the model configuration such that additional embeddings like point prompts are encoded into the mask decoder?