Rivet: Break Free from Chat: AI-Powered Interactivity on Websites - Low Code Prototyping with Anvil

Explore the new era of web interaction in this tutorial, where AI elevates user engagement beyond the chatbox. Discover simple steps to make your website more interactive and responsive to user needs with minimal coding effort.
Links:
Info: All the instructions and links are in the project file in the #main graph
Download the project file: github.com/ai-...
Install rivet-chat-api + Chatbot-UI: github.com/ai-...
Get Rivet: rivet.ironclad...
LinkedIn: / tim-k%c3%b6hler-ai-mad...

[@giacomociarlini4557]

Incredible work!

[@teatray75]

Wonderful job Tim!!

[@texzes]

Thank you so much for your videos; they've been an incredible find, and I eagerly await each new release. After attempting it on my own, I've encountered a challenge I hope you can help with. How do you handle parallel function calling in Chat? I've managed to run multiple functions within a single request, but the output `All message` from the Chat Node only returns the result of the first function. As a result, GPT is unable to find the other `tool_call_id`s, leading to an error in the loop. Could you please advise on this issue?

[@AIMadeApproachable]

That is a topic I purposely left out. Not because it is not solvable, but because I did not want to make the prototype more complex. Currently the option "Enable Parallel Function Calling" is set to "off" in the chat node, but I also saw it happening once and assume that this on/off-switch in Rivet is not working as intended.
If you want to enable it, the rivet project needs to be extended roughly like this:
- Check function calling result (parallel or single call)
- Bring the function calls into a common format (best is probably to format single function calls in some format as parallel function call)
- Activate splitting on the match node and the following nodes, so that each will be executed for each entry in the array (= each function)
- Then either send the function call results seperately into the 2nd chat node or merge them all before (although out of my head I also do not know how they need to be formatted for it to work)

[@texzes]

@@AIMadeApproachable The `tool` features of the Chat Node are quite challenging to grasp. I attempted the method you suggested, and here's what I found:
- When the 'parallel function calling' option is activated, the Chat Node does indeed initiate multiple functions at the same time as per the request. These can be seen under the 'Function Calls' output port of the Chat Node. However, in the 'All Messages' output port, only the message from the first function called by the assistant appears.
- This indicates that the first function needs to be processed separately by providing a response to the function call.
- The rest function listed in the 'Function Calls' port array must be processed individually. Afterward, their outputs should be appended to 'All Messages' (this includes the function request, function response, summarization, etc.).
I apologize if my explanation of the algorithm comes across as unclear. My understanding of it is still evolving as I continue experimenting with it myself.

[@AIMadeApproachable]

Well you can send multiple function call results back in one message (tested that today)... but Rivet does not handle it correctly at the moment. I created an issue and hope they will fix it:
github.com/Ironclad/rivet/issues/381

[@cb4623]

Can you stream the products back into chat ui?

[@cb4623]

Nice.