Usiel commented on issue #32480:
URL: https://github.com/apache/superset/issues/32480#issuecomment-2702733610
I encountered the problem again and realized my test (hourly celery task)
inadvertently only requested public channels. I can reliably reproduce the
issue when requesting private and public channels. The bot is member of just a
single private channel. Iterating the full list takes again around 5-7 minutes.
For further testing I ran the `get_channels_with_search(...)` code different
parameters. When private channels are requested the full iteration becomes
incredibly slow and needs to pause multiple times due to rate-limiting.
```
exclude_archived=False, types='None'
=> requests=<order of 10>, len(channels)=<order of 10k>
exclude_archived=True, types='None'
=> requests=<order of 10>, len(channels)=<order of 10k>
exclude_archived=False, types='public_channel,private_channel'
=> requests=<order of 100>, len(channels)=<order of 10k> + 1
exclude_archived=True, types='public_channel,private_channel'
=> requests=<order of 100>, len(channels)=<order of 10k> + 1
```
Imo, this is an issue, I just don't know whether this affects many other
Superset users :) I doubt Slack will optimize their API.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
