Discussions

• 1 You must be logged in to vote

  🙌

  promptdiff — static analysis and quality scoring for LLM system prompts

  HadiFrt20 started Mar 26, 2026 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to access cache read and write tokens from CompletionUsage?

  DeepthiSudharsan asked Mar 16, 2026 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  Structured Outputs with Prompt Caching

  poccio asked Mar 13, 2025 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙌

  6 AI agents for SaaS revenue intelligence — entity resolution + structured metrics

  shailesht003 started Feb 25, 2026 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙏

  Support for Ollama's Thinking/Reasoning Models with think=True Parameter

  yuv-c asked Oct 6, 2025 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Gemini context caching

  jobryan205 started Jul 17, 2025 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  💡

  Streaming reasoning

  johnwlockwood started Jul 16, 2025 in Ideas

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is there any way to get token usage count after calling the streaming api of open ai to get response

  amitsharma101 asked Aug 9, 2025 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is there a way to use JSON Schema instead of Pydantic models?

  santiagobasulto asked Oct 12, 2025 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  💬

  Instructor support for bedrock batch API

  KamranMK started Sep 16, 2025 in General

  

  

  1
• 2 You must be logged in to vote

  🙏

  Different retry logic for Validation error vs Rate limits

  samgregson asked Mar 26, 2025 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  How to stream with: type: Literal["Person"] = "Person" ??

  tamis-laan asked Jan 30, 2026 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💡

  Use JSON Patch instead of entire objects for retries

  nickshirobokov started Jun 12, 2025 in Ideas

  

  

  3
• 2 You must be logged in to vote

  💬

  Take on Agentic Workflow with instructor

  97k started Jun 5, 2024 in General

  

  

  

  

  18
• 1 You must be logged in to vote

  🙏

  Using Azure GPT 5.2 or 5.1

  deg asked Dec 14, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  What's the best way to get answers to questions or report bugs?

  kinano asked Oct 27, 2025 in Q&A · Closed · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  litellm batch_completion

  kingennio asked Apr 8, 2024 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙌

  Diagram representation of the instructor codebase

  ivanmilevtues started Jun 28, 2025 in Show and tell · Closed

  

  

  1
• 2 You must be logged in to vote

  🙏

  How can I use instructor with multiple functions - in a more agentic system where the LLM chooses the function to call?

  zby asked Dec 22, 2023 in Q&A · Answered

  

  

  

  

  12
• 1 You must be logged in to vote

  💬

  Responses API: is chaining responses possible?

  pablospe started Jul 13, 2025 in General

  

  

  0
• 2 You must be logged in to vote

  💬

  How should Instructor support the responses API?

  ivanleomk started Mar 25, 2025 in General

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  Issues with GenAI API and SafetySettings

  ar2em1s asked Jul 6, 2025 in Q&A · Closed · Answered

  

  

  3
• 3 You must be logged in to vote

  🙏

  How can we access the prompt given to the LLM?

  Chasearmer asked Jan 17, 2024 in Q&A · Answered

  

  

  

  

  12
• 1 You must be logged in to vote

  💬

  Exploring the possibility to force 'tool_choice': "auto" in an attempt to create a "progressive disclosure pattern".

  Mr-Ruben started May 22, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  Safety valve for Structured Output ?

  Mr-Ruben started Oct 22, 2024 in General

  

  

  2