Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

collect-mail doesn't display output #588

Open
micahflee opened this issue Mar 26, 2023 · 0 comments
Open

collect-mail doesn't display output #588

micahflee opened this issue Mar 26, 2023 · 0 comments
Labels
Milestone

Comments

@micahflee
Copy link
Contributor

When you run bigbang collect-mail and pass in a URL, it displays a list of archives in the terminal but that's it. It's not clear that it's actually downloading the articles into the archives folder, though it actually is. It looks like there are various logging.info() calls with output, but they don't get displayed in the terminal.

For example:

$ bigbang collect-mail --url https://www.ietf.org/mail-archive/text/tls-reg-review/
['2018-06.mail',
 '2018-07.mail',
 '2018-08.mail',
 '2018-11.mail',
 '2018-12.mail',
 '2019-01.mail',
 '2019-02.mail',
 '2019-03.mail',
 '2019-04.mail',
 '2019-05.mail',
 '2019-06.mail',
 '2019-07.mail',
 '2019-08.mail',
 '2019-09.mail',
 '2019-10.mail',
 '2019-12.mail',
 '2020-01.mail',
 '2020-02.mail',
 '2020-03.mail',
 '2020-04.mail',
 '2020-05.mail',
 '2020-06.mail',
 '2020-07.mail',
 '2020-08.mail',
 '2020-09.mail',
 '2020-10.mail',
 '2020-11.mail',
 '2020-12.mail',
 '2021-01.mail',
 '2021-02.mail',
 '2021-03.mail',
 '2021-04.mail',
 '2021-05.mail',
 '2021-06.mail',
 '2021-07.mail',
 '2021-08.mail',
 '2021-09.mail',
 '2021-10.mail',
 '2021-12.mail',
 '2022-01.mail',
 '2022-02.mail',
 '2022-03.mail']

This script immediately displays all of these .mail filenames, and then just sits there for over a minute. But in the background, it's actually scraping the mailing list. It would be helpful if the output was nicer, and if it showed progress while you were running the script.

@sbenthall sbenthall added this to the 0.6 milestone May 16, 2023
@sbenthall sbenthall added the CLI label May 16, 2023
@sbenthall sbenthall modified the milestones: 0.6, 0.7 Aug 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants