On Fri, Oct 16, 2026 at 08:32:48PM +0800, Tito Mari Francis Escaño wrote:
> Hello everyone,
> I also tried with venv, either way you use venv or not, Tiktoken will be
> the showstopper.
Show what the issue is.
I have no clue what "tiktoken" is, but I'm able to install it with pip
in a venv without issue. All you have to do is to set up the virtual
Python environment, ensure that the Rust compiler is installed and that
whatever directory $TMPDIR is ponting at (or /tmp) is not mounted with
"noexec":
% python3 -m venv venv
% ./venv/bin/pip install tiktoken
[...]
Installing collected packages: urllib3, regex, idna,
charset_normalizer, certifi, requests, tiktoken
Successfully installed certifi-2026.7.22 charset_normalizer-3.5.2
idna-3.20 regex-2026.9.29 requests-2.34.2 tiktoken-0.14.0 urllib3-2.8.0
% ls -l venv/lib/python3.13/site-packages
total 68
drwxr-xr-x 4 myself myself 512 Oct 16 14:41 certifi/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41
certifi-2026.7.22.dist-info/
drwxr-xr-x 4 myself myself 512 Oct 16 14:41 charset_normalizer/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41
charset_normalizer-3.5.2.dist-info/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41 idna/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41 idna-3.20.dist-info/
drwxr-xr-x 5 myself myself 512 Oct 16 14:41 pip/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41 pip-26.2.1.dist-info/
drwxr-xr-x 4 myself myself 512 Oct 16 14:41 regex/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41
regex-2026.9.29.dist-info/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41 requests/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41
requests-2.34.2.dist-info/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41 tiktoken/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41
tiktoken-0.14.0.dist-info/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41 tiktoken_ext/
drwxr-xr-x 6 myself myself 512 Oct 16 14:41 urllib3/
drwxr-xr-x 3 myself myself 512 Oct 16 14:41 urllib3-2.8.0.dist-info/
