Structured Generation with LLMs
Structured decoding
-
Structured outputs can hurt the performance of LLMs – Dylan Castillo
-
GitHub - guidance-ai/llguidance: Super-fast Structured Outputs
-
GitHub - mlc-ai/xgrammar: Efficient, Flexible and Portable Structured Generation