TheoViel commited on
Commit
716591e
·
verified ·
1 Parent(s): bb95460

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +54 -2
README.md CHANGED
@@ -1,3 +1,5 @@
 
 
1
  ## Model Overview
2
 
3
  ### Description
@@ -14,6 +16,18 @@ The use of this model is governed by the [NVIDIA AI Foundation Models Community
14
 
15
  **You are responsible for ensuring that your use of NVIDIA provided models complies with all applicable laws.**
16
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ### Deployment Geography
18
 
19
  Global
@@ -27,7 +41,7 @@ The **NeMo Retriever Page Elements v3** model is designed for automating extrac
27
 
28
  ### Release Date
29
 
30
- 11/15/2025 via https://build.nvidia.com/nvidia/nemoretriever-page-elements-v3
31
 
32
  ### References
33
 
@@ -76,13 +90,49 @@ Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated sys
76
  ### Usage
77
 
78
 
79
- # [TODO]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
80
 
 
 
 
 
81
 
82
  ### Software Integration
83
 
 
84
  **Runtime Engine(s):**
85
  - **NeMo Retriever Page Elements v3** NIM
 
86
 
87
  **Supported Hardware Microarchitecture Compatibility [List in Alphabetic Order]:**
88
  - NVIDIA Ampere
@@ -130,10 +180,12 @@ The primary evaluation set is a cut of the Azure labels and digital corpora imag
130
  | header_footer | 53.895 | 75.670 |
131
 
132
 
 
133
  ## Inference:
134
 
135
  **Acceleartion Engine**: TensorRT <br>
136
  **Test hardware**: See [Support Matrix from NIM documentation](https://docs.nvidia.com/nim/ingestion/object-detection/latest/support-matrix.html#)
 
137
 
138
  ## Ethical Considerations
139
 
 
1
+ # Nemoretriever Page Element v3
2
+
3
  ## Model Overview
4
 
5
  ### Description
 
16
 
17
  **You are responsible for ensuring that your use of NVIDIA provided models complies with all applicable laws.**
18
 
19
+ ### Team
20
+
21
+ - Theo Viel
22
+ - Bo Liu
23
+ - Darragh Hanley
24
+ <!---
25
+ - ???
26
+ --->
27
+ - Even Oldridge
28
+
29
+ Correspondence to Theo Viel (tviel@nvidia.com) and Bo Liu (boli@nvidia.com)
30
+
31
  ### Deployment Geography
32
 
33
  Global
 
41
 
42
  ### Release Date
43
 
44
+ 11/15/2025 via https://huggingface.co/nvidia/nemoretriever-page-elements-v3
45
 
46
  ### References
47
 
 
90
  ### Usage
91
 
92
 
93
+ The model requires torch.
94
+
95
+ ```
96
+ import torch
97
+ import numpy as np
98
+ import matplotlib.pyplot as plt
99
+ from PIL import Image
100
+
101
+ from model import define_model
102
+ from utils import plot_sample, postprocess_preds_page_element, reformat_for_plotting
103
+
104
+ # Load image
105
+ path = "./example.png"
106
+ img = Image.open(path).convert("RGB")
107
+ img = np.array(img)
108
+
109
+ # Load model
110
+ model = define_model("page_element_v3")
111
+
112
+ # Inference
113
+ with torch.inference_mode():
114
+ x = model.preprocess(img)
115
+ preds = model(x, img.shape)[0]
116
+
117
+ print(preds)
118
+
119
+ # Post-processing
120
+ labels, bboxes, scores = postprocess_preds_page_element(preds, model.thresholds_per_class, model.labels)
121
+
122
+ # Plot
123
+ boxes_plot, confs = reformat_for_plotting(labels, bboxes, scores, img.shape, model.num_classes)
124
 
125
+ plt.figure(figsize=(15, 10))
126
+ plot_sample(img, boxes_plot, confs, labels=model.labels)
127
+ plt.show()
128
+ ```
129
 
130
  ### Software Integration
131
 
132
+ <!---
133
  **Runtime Engine(s):**
134
  - **NeMo Retriever Page Elements v3** NIM
135
+ --->
136
 
137
  **Supported Hardware Microarchitecture Compatibility [List in Alphabetic Order]:**
138
  - NVIDIA Ampere
 
180
  | header_footer | 53.895 | 75.670 |
181
 
182
 
183
+ <!---
184
  ## Inference:
185
 
186
  **Acceleartion Engine**: TensorRT <br>
187
  **Test hardware**: See [Support Matrix from NIM documentation](https://docs.nvidia.com/nim/ingestion/object-detection/latest/support-matrix.html#)
188
+ --->
189
 
190
  ## Ethical Considerations
191