Validation and reroll system

[lalalune]

We need to have a system of validation with reroll or "is this right?" checking. A lot of prompt reponses get thrown away because the output isn't valid for one reason or another.

Heuristics
-> if the edit does any of the following
-> has last more than 50% of code in one roll

validation / reroll step

5. Add reasoning to code edit again
6. add "type" to generated code -- is it a complete script, snippet or replacement?
7. Add summary to code gen
8. if fails validation or type is not complete, combine, collect errors and ask to write into a complete file

if
-> fails validation
-> fails to run etc
--> just reroll it up to 3x

if
-> passes validation
-> passes

-- edit again
-> if no error

is it better or worse, any recommendations for next step?