Sounds like constrained sampling can be game changer if cleverly applied. At the very least it should make code generation guaranteed to be syntactically correct. They can probably easily generate tree sitter grammars for themselves for almost any language where they have enough training material. Next level would be to guarantee type correctness. Maybe they have a bit of this in place for code already since code generation is quite robust as it is.
Exactly what I was looking for! Thank you!
Great video!
Sounds like constrained sampling can be game changer if cleverly applied. At the very least it should make code generation guaranteed to be syntactically correct. They can probably easily generate tree sitter grammars for themselves for almost any language where they have enough training material. Next level would be to guarantee type correctness. Maybe they have a bit of this in place for code already since code generation is quite robust as it is.