Basic langsmith-nodejs Rust bindings #1293

obi1kenobi · 2024-12-05T18:27:25Z

Rust-based client bindings for submitting data to LangSmith.

Current state: MVP, aiming to get minimal end-to-end validation of the approach. Only implements createRun at the moment. updateRun does not have a corresponding Rust implementation.

Don't mind the failing tests at the moment — it's because there aren't any test files, so the test runner is exiting non-zero. If we have a good way to make an integration test for this, we can easily add it to the test suite. In one of the earlier commits, I tested the bindings with a simple fibonacci() function to make sure the Node.js -> Rust calling works, and all the tests passed.

Testing this code

To build the native code bindings:

cd rust/crates/langsmith-nodejs
yarn install --dev
yarn run build:debug

# To work around an undefined type bug in the generated definitions.
git restore index.d.ts

This should produce a file with a name like langsmith-nodejs.linux-x64-gnu.node (on libc x64 Linux), or langsmith-nodejs.darwin-arm64.node (on macOS arm64). That file is the native Rust code, compiled for your platform.

Then, go to js/ and run yarn install to install the native library (as a path dependency).

To have the JS code use the Rust bindings to submit data, run it with the LANGCHAIN_USE_RUST_CLIENT environment variable set to any value.

obi1kenobi · 2024-12-09T20:52:36Z

js/package.json

@@ -103,6 +103,7 @@
  "dependencies": {
    "@types/uuid": "^10.0.0",
    "commander": "^10.0.1",
+    "langsmith-nodejs": "file:../rust/crates/langsmith-nodejs",


Before merging, we'll need to replace this path dependency with a dependency on a real, published JS library.

js/src/client.ts

obi1kenobi · 2024-12-09T20:54:56Z

js/src/client.ts

+      const response = await this.caller.call(
+        _getFetchImplementation(),
+        `${this.apiUrl}/runs`,
+        {
+          method: "POST",
+          headers,
+          body: stringifyForTracing(mergedRunCreateParam),
+          signal: AbortSignal.timeout(this.timeout_ms),
+          ...this.fetchOptions,
+        }
+      );
+      await raiseForStatus(response, "create run", true);


This is the old code as-is, just moved into the else branch.

obi1kenobi · 2024-12-09T20:56:14Z

js/src/client.ts

@@ -3769,7 +3844,7 @@ export class Client implements LangSmithTracingClientInterface {
    if (options?.isPublic && !settings.tenant_handle) {
      throw new Error(
        `Cannot create a public prompt without first\n
-        creating a LangChain Hub handle. 
+        creating a LangChain Hub handle.


Sorry about this noise — my editor is stripping trailing whitespace on save by default. If this is a concern, I can undo it.

obi1kenobi · 2024-12-09T20:56:18Z

js/src/client.ts

+   * Clone a public dataset to your own langsmith tenant.
+   * This operation is idempotent. If you already have a dataset with the given name,


Sorry about this noise — my editor is stripping trailing whitespace on save by default. If this is a concern, I can undo it.

obi1kenobi · 2024-12-09T21:28:40Z

rust/crates/langsmith-tracing-client/src/client/run.rs

@@ -2,7 +2,7 @@ use serde::{Deserialize, Serialize};
 use serde_json::Value;

 // Map attachment ref to tuple of filename, optional bytes
-#[derive(Debug)]
+#[derive(Debug, Serialize, Deserialize)]


I made all of these Serialize, Deserialize to make it easier to create them from JS.

This is a temporary hack to get something working quickly. We can figure out a more appropriate long-term solution once we have an end-to-end working implementation.

…h-sdk into pg/nodejs-bindings

jacoblee93 · 2024-12-13T01:09:18Z

js/src/client.ts

@@ -1,5 +1,7 @@
 import * as uuid from "uuid";

+import * as bindings from "langsmith-nodejs";


Any compatibility issues here?

Will this install in environments that don't have Rust?

We can do some refactoring around entrypoints to make sure this works if so

jacoblee93 · 2024-12-13T01:19:25Z

js/src/client.ts

@@ -521,6 +526,27 @@ export class Client implements LangSmithTracingClientInterface {
      config.blockOnRootRunFinalization ?? this.blockOnRootRunFinalization;
    this.batchSizeBytesLimit = config.batchSizeBytesLimit;
    this.fetchOptions = config.fetchOptions || {};
+
+    // TODO: Do we care about syncing up the env var names between the JS and Python bindings?


Yes we want to do LANGSMITH_USE

jacoblee93 · 2024-12-13T01:20:56Z

js/src/client.ts

+      if (this._rustClient) {
+        const mergedRunCreateParam = mergeRuntimeEnvIntoRunCreate(runCreate);
+
+        // We need to massage the data shape into what Rust expects and will accept,


Is there any way we can remove this shim in the JS client?

Can we add something to the Rust binding that converts JS data shapes to their Rust counterparts in a more general way?

jacoblee93 · 2024-12-13T01:22:45Z

js/src/client.ts

+          console.error(e);
+        }
+        return;
+      } else if (this.autoBatchTracing) {


The assumption is that anyone using the new bindings will have this enabled right?

jacoblee93

Thanks @obi1kenobi!

Main question on is if we can generalize serialization from JS to Rust and move it into the binding to avoid overhead on other methods

obi1kenobi added 2 commits December 5, 2024 17:38

Initial project stub for Node.js bindings.

1099199

Add per-platform project builds, a loader stub, and metadata.

2b9f1f7

obi1kenobi force-pushed the pg/nodejs-bindings branch 5 times, most recently from 12f8b84 to dab5a29 Compare December 5, 2024 19:13

Add workflow for building and testing Rust Node.js bindings.

d2c7714

obi1kenobi force-pushed the pg/nodejs-bindings branch 3 times, most recently from f125b51 to ee51176 Compare December 5, 2024 20:20

Set up jest for testing and make small end-to-end test.

ba76254

obi1kenobi force-pushed the pg/nodejs-bindings branch from ee51176 to ba76254 Compare December 5, 2024 20:29

obi1kenobi marked this pull request as ready for review December 5, 2024 20:51

obi1kenobi changed the title ~~langsmith-nodejs Rust bindings~~ Basic project stub for langsmith-nodejs Rust bindings Dec 5, 2024

obi1kenobi requested a review from agola11 December 5, 2024 21:00

obi1kenobi and others added 5 commits December 5, 2024 21:00

Reformat Rust files.

9712650

Install specified Rust version and harden shell commands.

0fe1f30

Add Rust-Node.js glue code and allow JS client to call into it.

1fe6b84

Delete rust/crates/langsmith-nodejs/integration.test.ts

cd3468f

Apply latest suggested project structure from napi new.

52a72ad

obi1kenobi commented Dec 9, 2024

View reviewed changes

obi1kenobi and others added 3 commits December 9, 2024 16:29

Update js/src/client.ts

41032b1

Merge branch 'pg/nodejs-bindings' of github.com:langchain-ai/langsmit…

8a6a71e

…h-sdk into pg/nodejs-bindings

Reformat Rust files.

72abe77

obi1kenobi changed the title ~~Basic project stub for langsmith-nodejs Rust bindings~~ Basic langsmith-nodejs Rust bindings Dec 9, 2024

Only use the Rust bindings if the trace_id and dotted_order are set.

93dccc2

jacoblee93 reviewed Dec 13, 2024

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Basic langsmith-nodejs Rust bindings #1293

Basic langsmith-nodejs Rust bindings #1293

obi1kenobi commented Dec 5, 2024 •

edited

Loading

obi1kenobi Dec 9, 2024

obi1kenobi Dec 9, 2024

obi1kenobi Dec 9, 2024

obi1kenobi Dec 9, 2024

obi1kenobi Dec 9, 2024

jacoblee93 Dec 13, 2024

jacoblee93 Dec 13, 2024

jacoblee93 Dec 13, 2024 •

edited

Loading

jacoblee93 Dec 13, 2024

jacoblee93 left a comment

		* Clone a public dataset to your own langsmith tenant.
		* This operation is idempotent. If you already have a dataset with the given name,

		@@ -1,5 +1,7 @@
		import * as uuid from "uuid";

		import * as bindings from "langsmith-nodejs";

Basic langsmith-nodejs Rust bindings #1293

Are you sure you want to change the base?

Basic langsmith-nodejs Rust bindings #1293

Conversation

obi1kenobi commented Dec 5, 2024 • edited Loading

Testing this code

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

jacoblee93 Dec 13, 2024 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

jacoblee93 left a comment

Choose a reason for hiding this comment

obi1kenobi commented Dec 5, 2024 •

edited

Loading

jacoblee93 Dec 13, 2024 •

edited

Loading