Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code and Checkpoints for i2v Model? #3

Open
dangeng opened this issue Oct 21, 2024 · 11 comments
Open

Code and Checkpoints for i2v Model? #3

dangeng opened this issue Oct 21, 2024 · 11 comments

Comments

@dangeng
Copy link

dangeng commented Oct 21, 2024

Hello, thank you so much for releasing the code and checkpoints, and for the great work! I was just wondering if the first frame conditioned model will also be released in the future, and if there's a timeline for that.

(Also btw, I found that I had to upgrade the transformers package to 4.44.2 in order to get the code to run, because I was running into this bug)

@Doubiiu
Copy link

Doubiiu commented Oct 21, 2024

Same kind request for the i2v model! Thanks for open-sourcing this wonderful work!

@Leojc
Copy link
Collaborator

Leojc commented Oct 22, 2024

Thank you for your interest. Considering our current commercial plans and our progress under paper review, we aim to release the full version of Tora (including i2v and first&last frame generation) in about a month. The exact release date is yet to be determined.

@Leojc
Copy link
Collaborator

Leojc commented Oct 22, 2024

(Also btw, I found that I had to upgrade the transformers package to 4.44.2 in order to get the code to run, because I was running into this bug)

We will add this to the README. Thanks for bug reporting.

@hywang2002
Copy link

Thank you for your interest. Considering our current commercial plans and our progress under paper review, we aim to release the full version of Tora (including i2v and first&last frame generation) in about a month. The exact release date is yet to be determined.

Hi, thank you for your wonderful work. Has a specific release date been determined?

@zhenghao977
Copy link
Collaborator

@hywang2002 The I2V version of Tora provides a paid API call method through our Alibaba Cloud products. We have not yet obtained permission to open-source this model. However, we are working to advance this content as soon as possible. If we are unable to do so, we will provide a simplified version of the I2V weights for everyone to use by the end of January at the latest.

@Xushuolin
Copy link

Very nice work. Can't the training data video be longer than 6 seconds?

@Doubiiu
Copy link

Doubiiu commented Dec 30, 2024

@hywang2002 The I2V version of Tora provides a paid API call method through our Alibaba Cloud products. We have not yet obtained permission to open-source this model. However, we are working to advance this content as soon as possible. If we are unable to do so, we will provide a simplified version of the I2V weights for everyone to use by the end of January at the latest.

Hi is there any link to that API call (instruction / introduction) for our comparison? Thanks!

@zhenghao977
Copy link
Collaborator

tora Here is the I2V's platform

@Doubiiu
Copy link

Doubiiu commented Jan 2, 2025

tora Here is the I2V's platform

Thanks. i know the platform, but I cannot find your work on that platform. Hope you can provide more details for that to ease our comparison.

@zhenghao977
Copy link
Collaborator

@Doubiiu After asking our product manager, it has been confirmed that if a user has not activated their account through Zhizuo platform, they will be automatically redirected to the activation page. On this page, the user needs to click on "Activate," complete the payment, and then scan the QR code.

@zhenghao977
Copy link
Collaborator

Of course, we will give another weight in these two weeks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants