Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Model] CAN Model Support #731

Open
zhangjunlongtech opened this issue Aug 6, 2024 · 1 comment
Open

[Model] CAN Model Support #731

zhangjunlongtech opened this issue Aug 6, 2024 · 1 comment
Assignees

Comments

@zhangjunlongtech
Copy link
Contributor

  1. Background
    MindOCR does not currently support handwritten mathematical formula recognition. I hope to solve this problem by contributing a CAN model.

  2. Model Introduction
    HMER(Handwritten Mathematical Expression Recognition) mostly uses the encoder-decoder mechanism. However, when identifying long or complex formulas, it cannot guarantee the accuracy of the region of interest of the Attention module. CAN(Counting-Aware Network) utilizes Multi-Scale Counting Module to improve the accuracy of formula recognition, by introducing counting vectors that can provide global information and spatial position codes that can provide position information.

  3. Reference Papers
    When Counting Meets HMER: Counting-Aware Network for Handwritten Mathematical Expression Recognition Bohan Li, Ye Yuan, Dingkang Liang, Xiao Liu, Zhilong Ji, Jinfeng Bai, Wenyu Liu, Xiang Bai ECCV, 2022

  4. Expectations
    I'd like to get the community's comments, suggestions, and related reference documents or PRs.

@kk928290341
Copy link
Collaborator

Contributions are welcome, and they are greatly appreciated! You can refer to the CONTRIBUTING documentation, and please provide the test report and README when submitting the PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants