Add CodeNode

[proteusvacuum]

Description

Runs arbitrary python within the pipeline.
It essentially is running a function:

def main(input):
    {The Code Goes Here}

The return value of the function is used as the output.

The main reason I encapsulated it inside of a separate function is that you can then:

• define other functions e.g.

def foo(bar):
    return bar + 1

return foo(3)

• clearly see what is being returned with a return statement

I still need to add: a code widget (is there a preference? I was thinking of using ace as I think that is what is used in HQ)

For now, this doesn't access "shared state" that we had also spoken about, but I wanted to get this out there for discussion first.

User Impact

Demo

Screencast.from.2024-12-13.15-03-02.mp4

Docs

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 98.92473% with 1 line in your changes missing coverage. Please review.

✅ All tests successful. No failed tests found.

Files with missing lines	Patch %	Lines
apps/pipelines/tests/utils.py	75.00%	1 Missing ⚠️

Additional details and impacted files

📢 Thoughts on this report? Let us know!

[snopoke]

This is great.

In terms of an editor I've been wanting to get going with https://codemirror.net/

[proteusvacuum]

Screencast.from.2024-12-13.22-42-34.mp4

[proteusvacuum]

Currently the python is extremely restricted. As we overwrite __builtins__ we need to redefine things like _inplacevar_ in a safe way, like this:

https://github.com/zopefoundation/AccessControl/blob/f9ae58816f0712eb6ea97459b4ccafbf4662d9db/src/AccessControl/ZopeGuards.py#L625

There are other potentially safe functions that we could add, e.g:
https://github.com/ndurner/amz_bedrock_chat/blob/830e496bcc0e6fa8e8b6e361c5419dd53d5d72e6/code_exec.py#L41-L99

This can happen in a followup, I think the basic functionality is enough to get going with.

[proteusvacuum]

I'm wondering if we should instead raise an exception in this case, as it was probably not intentional to not return a string.

[SmittieC]

I think it makes sense to raise. How easy would it be to detect this when the user saves the pipeline?

[proteusvacuum]

Made a few updates after @bderenzi gave some feedback on slack.

Now the main function is exposed to the user, and there is a bit more information provided for syntax errors, etc.

Screencast.from.2024-12-14.21-26-28.mp4

[SmittieC]

(not for this PR) It would be nice to have some way of telling/showing the user which builtin modules and imports are available. Maybe we can utilize codemirror's autocomplete

[SmittieC]

Nice!