Currently, all we see is flow -> model. Should be flow -> generate -> model.
Generate has the main logic, tool calling loop, middleware, output conformance, etc - which is important to nest under a common span. The inputs/outputs are also slightly different than what the model would have.
Currently, all we see is
flow -> model. Should beflow -> generate -> model.Generate has the main logic, tool calling loop, middleware, output conformance, etc - which is important to nest under a common span. The inputs/outputs are also slightly different than what the model would have.