-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Open
Description
Hi PocketFlow team,
PocketFlow’s “100-line LLM framework” design is extremely attractive for people who want to see the whole pipeline at once.:contentReference[oaicite:9]{index=9}
I maintain WFGY, a small MIT-licensed framework focused on RAG failure-mode diagnostics.
Its core is a 16-problem checklist that has been:
- referenced by Harvard MIMS Lab – ToolUniverse,
- cited in the QCRI Multimodal RAG Survey,
- and integrated into Rankify (University of Innsbruck) as a debugging reference.
ProblemMap (single README):
https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md
Proposal
PocketFlow already has example RAG pipelines. I’d like to propose:
-
One additional example
rag_with_wfgy_debug.py(or similar) showing:- the usual 100-line RAG pipeline,
- plus an optional “debug mode” function that, when enabled, calls the WFGY checklist on bad outputs and prints the problem ID + explanation.
-
Tiny doc addition
- A short paragraph in the examples section:
- explaining that users can toggle this mode to quickly see if their issues are, e.g., retrieval drift (No.1), embedding mismatch (No.5), long-chain reasoning drift (No.3), infra / bootstrap issues, etc.
- A short paragraph in the examples section:
-
All under MIT / optional
- No new dependency; just a small helper function and some prompt text.
If this aligns with the philosophy of keeping PocketFlow small and transparent, I’m happy to:
- draft the example script,
- keep everything minimal and easy to maintain,
- iterate based on your feedback.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels