[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-25 Thread Yevhen Alieksieiev via Apache TVM Discuss
Hi @apeskov! Yes, sure! I'll clean up my code so I can extract the patch out of it, but the change was rather simple: @contextlib.contextmanager def default_module_loader_mgr(remote_kwargs, build_result): remote = request_remote(**remote_kwargs) # if pre_load_function i

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-25 Thread Alexander via Apache TVM Discuss
Hi @L1onKing! As I see you already dealt with that problem. The issue described by you in [Tune the model in iOS](/t/tune-the-model-in-ios/10083) is a next level of progress with iOS tuning. But anyway the issue with transferring python objects between process on MacOS is still present in tv

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-25 Thread Yevhen Alieksieiev via Apache TVM Discuss
Hello @echuraev ! I have solved an issue, thank you very much! Now I'm working on tuning the iOS model and I'm having next error: Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 47,

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-24 Thread Egor Churaev via Apache TVM Discuss
Hello, @L1onKing! Did you solve your problem? I think, you could use `pathForResource`: https://developer.apple.com/documentation/foundation/nsbundle/1410989-pathforresource --- [Visit Topic](https://discuss.tvm.apache.org/t/compile-pytorch-model-for-ios/9995/14) to respond. You are rec

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-23 Thread Andrey Malyshev via Apache TVM Discuss
You need to run install_name_tool for your model library like ``` install_name_tool -id @rpath/model.dylib model.dylib ``` and then just point the name of the library without additional path in iOS app like ``` m_mod = tvm::runtime::Module::LoadFromFile("model.dylib"); ``` --- [Visit Top

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-21 Thread Yevhen Alieksieiev via Apache TVM Discuss
Since I have model library and runtime library in my hands now, I'm working on writing an inference code. Unfortunately, I'm having problems from the very beginning: > m_mod = > tvm::runtime::Module::LoadFromFile("/Applications/Algoface-Landmarks-Tracker.app/model.dylib"); The problem here i

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-17 Thread Yevhen Alieksieiev via Apache TVM Discuss
@masahi @echuraev @elvin-n Wow guys! Thank you so much for such an awesome support! I'll let you know in this thread if I have any issues --- [Visit Topic](https://discuss.tvm.apache.org/t/compile-pytorch-model-for-ios/9995/7) to respond. You are receiving this because you enabled mailin

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-17 Thread Andrey Malyshev via Apache TVM Discuss
One small comment in addition to previous Egor's message - there should be one more option for cmake command line added - `-DCMAKE_CXX_FLAGS="-fembed-bitcode-marker"` --- [Visit Topic](https://discuss.tvm.apache.org/t/compile-pytorch-model-for-ios/9995/6) to respond. You are receiving t

[Apache TVM Discuss] [Questions] Compile Pytorch model for iOS

2021-05-17 Thread echuraev via Apache TVM Discuss
Hello @L1onKing! My colleague is working now on upstreaming some patches for ios support and ios-rpc, so I'll ask him, and maybe he will be able to extend my answer with some additional details. First, lets start from your script for building the model. You should do `export_library` differe