Hacks
- YAML instead of JSON for complicated outputs, easier for model to not have to escape characters
-
<xml>blocks</xml>have LLM output parts in xml blocks- reasoning steps
- plan steps
- final answer
- repeat prompt
- put question before prompt content and after
- LLM ⇒ text response ⇒ structured format