Questions tagged [onnx]
ONNX is an open format to represent deep learning models and enable interoperability between different frameworks.
onnx
908
questions
1
vote
0
answers
25
views
Converting a PyTorch ONNX model to TensorRT engine - Jetson Orin Nano
I'm trying to convert a ViT-B/32 Vision Transformer model from the UNICOM repository on a Jetson Orin Nano. The model's Vision Transformer class and source code is here.
I use the following code to ...
0
votes
0
answers
20
views
How to convert onnx with onnx.data to openvino IR format
I am using mo to convert onnx to openvino IR format.But when encountering onnx and onnx.data, it reported error.
mo --input_model G:\convert_model\onnx-fp16\text_encoder\model.onnx --input_shape [1,77]...
-1
votes
0
answers
42
views
Getting console errors when trying to run model in browser using rust, wasm and wonnx
I'm attempting to embed some text as vectors in the browser using rust, webassembly and wonnx.
When I try and run my model in the demo, I get these errors in the console:
wonnx_embeddings_repro_bg.js:...
0
votes
0
answers
31
views
How convert yolox onnx to yolox dlc
Trying to convert ONNX to DLC training YOLOX model. When ONNX its working but converting dlc doesnt work
YOLOX trained model --> convert .ONNX --> ONNXRUNTIME --> decode --> Visualization ...
0
votes
0
answers
19
views
Fail to load external data file "onnx model"in onnx runtime in devexpress application?
I have put onnx model in my wwwroot/js folder but it is not being detected and I am getting this error.
error = Error: failed to load external data file: js/sevensegment.onnx
at gn (https://cdn....
0
votes
1
answer
34
views
Getting errors in `wgpu` crate when used as a dependency of `wonnx`
When I try and build my project, I get these errors in the wgpu crate, which is a dependency of the wonnx crate that I am using.
❯ $env:RUSTFLAGS="--cfg=web_sys_unstable_apis"; wasm-pack ...
1
vote
0
answers
26
views
Opencv module dnn inference with batch greater than 1
I want to perform inference using the dnn module of opencv. This is my code:
static cv::Mat inputBlob2;
static std::vector<cv::Mat> outputs2;
cv::dnn::blobFromImages(images, inputBlob2, 1.0 / ...
0
votes
0
answers
24
views
Export a teknium/OpenHermes-2.5-Mistral-7B model to ONNX
I am trying to export teknium/OpenHermes-2.5-Mistral-7B to ONNX,
This is my code:
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
import onnx
model_name = "teknium/...
1
vote
1
answer
21
views
NNModel (ONNX) Assertion Error in Barracuda
I am trying to use a ONNX model for inference in Unity using Barracuda, following this repo. When I try to call model inference, I get the following assertion error.
AssertionException: Assertion ...
-1
votes
0
answers
14
views
OpenVINO does not support the following ONNX operations: SequenceConstruct, ConcatFromSequence
MODEL_YOLOV8_PATH = 'yolov8x_person_face.onnx.prototxt'
WEIGHT_YOLOV8_PATH = 'yolov8x_person_face.onnx'
MODEL_MIVOLO_PATH = 'mivolo.onnx.prototxt'
WEIGHT_MIVOLO_PATH = 'mivolo.onnx'
...
0
votes
0
answers
11
views
Can the layer InstanceNormalization fuse with convolution?
Can the layer InstanceNormalization fuse with Convolution ?
scale = 1 and B = 0
enter image description here
InstanceNormalization
Carries out instance normalization as described in the paper https://...
1
vote
0
answers
17
views
Convert Quantization to Onnx
I am new and want to try converting models to Onnx format and I have the following issue. I have a model that has been quantized to 4-bit, and then I converted this model to Onnx. My quantized model ...
0
votes
0
answers
39
views
How to use ONNX Transformers model with Spring AI
I am trying to use ONNX export of model intfloat/multilingual-e5-large:
https://huggingface.co/intfloat/multilingual-e5-large/tree/main/onnx
I have successfully downloaded this model, using it ...
0
votes
0
answers
18
views
How to export a temporal forecasting transformer model as an onnx model?
I have a TFT model that is performing a timeseries forecasting using the get_stallion dataset. See the link below for reference:
https://pytorch-forecasting.readthedocs.io/en/stable/tutorials/stallion....
0
votes
0
answers
15
views
Android ONNXRuntime Multi Thread multi models
I am trying to run two different models on android device and I successfully made two different sessions and run two models.
But the problem is that they are running in serialized manner which is ...