Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tachio can receive feedback, reflect on it, and then propose changes to its prompts (all through the magic of pg_cron) #72

Open
4 tasks
n0fray opened this issue Mar 10, 2024 · 1 comment

Comments

@n0fray
Copy link
Collaborator

n0fray commented Mar 10, 2024

Tachio listens for feedback on their briefings, saves the feedback into the database, then generates a reflection on the feedback and proposes improvements to the prompt based on the reflection. If the user accepts the proposal, then Tachio can implement update to the proposed version of the prompt by simply writing to the database.

  • Processing of feedback into reflections and reflections into improvement proposals
  • The LLM generates reflections and proposals based on the feedback received.
  • The user reviews the proposals and makes a decision (accept, adjust, reject).
  • If a proposal is accepted (or adjusted), then the new prompt is used for future briefings.
@n0fray n0fray added this to the v1 milestone Mar 10, 2024
@n0fray
Copy link
Collaborator Author

n0fray commented Mar 10, 2024

We want to keep track of all our past briefings (of all briefing types) and we want to collect feedback from the our users about each instance of a briefing. Identifying feedback can be another reflection layer (just like identifying todos).

We will use a recurring job that reviews all the feedback, reflects on the feedback (and the briefing that the feedback is about and the prompt that generated that briefing)m, and then generates proposal for how to adjust the prompts in the future (including an explanation for why this proposed change will address the specific feedback that was received).

Tachio regularly reviews new feedback that was received about its briefings and generates self-improvement proposals for how it can improve its briefing-generating prompts, including an explanation of why this proposal is responsive to the feedback it received.

@rajivsinclair rajivsinclair changed the title Tachio can receive feedback and reflect on it, and propose changes to its prompts Tachio can receive feedback, reflect on it, and then propose changes to its prompts Mar 10, 2024
@rajivsinclair rajivsinclair changed the title Tachio can receive feedback, reflect on it, and then propose changes to its prompts Tachio can receive feedback, reflect on it, and then propose changes to its prompts (all through the magic of pg_cron) Mar 12, 2024
@ejfox ejfox removed this from the v1 milestone Mar 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants