This forum uses cookies
This forum makes use of cookies to store your login information if you are registered, and your last visit if you are not. Cookies are small text documents stored on your computer; the cookies set by this forum can only be used on this website and pose no security risk. Cookies on this forum also track the specific topics you have read and when you last read them. Please confirm whether you accept or reject these cookies being set.

A cookie will be stored in your browser regardless of choice to prevent you being asked this question again. You will be able to change your cookie settings at any time using the link in the footer.

torch_tensorrt and TensorRT 10.0 compatibility
#1
Hello Selur,

   I'm trying compiling a filter with torch_tensorrt but I found a compatibility problem regarding torch_tensorrt and TensorRT 10.0.
   Looking to NVIDIA migration guide

   The TensorRT 8.x function build_engine() is substitute by the function build_serialized_network()
   Also the TensorRT 8.x parameters INetworkDefinition.has_explicit_precision and  INetworkDefinition.has_implicit_batch_dimension() were removed.

   But all these parameters are used in the torch_tensorrt 2.4.0.dev installed in Hybrid.
   See for example:

  torch_tensorrt\fx\fx2trt.py, rows: 211, 213, 257

  This version is targeting TensorRT 8.x and not the installed version TensorRT 10.0

  I'm wondering if the current Hybrid environment need to be changed to get  torch_tensorrt working.

Dan
Reply
#2
I managed to don't use tensorrt.fx and now I'm able to compile (till now only fp32).

Dan
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)