update token viz sample

labmlai · Oct 19, 2024 · 7b8c4f5 · 7b8c4f5
1 parent 635320e
commit 7b8c4f5
Showing 1 changed file with 4 additions and 2 deletions.
diff --git a/README.md b/README.md
@@ -158,8 +158,10 @@ This tool is used to visualize some metric related to tokens. This supports mult
 
 ```python
 import inspectus
-
-inspectus.tokens(['hello', 'world'], np.random.rand(2))
+inspectus.tokens(["Hello", " World", "!"], {
+    'loss': [-7.375, -8.312, -7.5625],
+    'entropy': [3.323, 1.0666, 0.432]
+}, token_info=["info 1", "info 2", "info 3"])
 ```
 
 Check out the notebook here: [GPT2 example](https://github.com/labmlai/inspectus/blob/main/notebooks/token_viz.ipynb)