Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Add Option to Download Logs in the UI and API #587

Open
NewtTheWolf opened this issue Nov 12, 2024 · 1 comment
Open

Feature Request: Add Option to Download Logs in the UI and API #587

NewtTheWolf opened this issue Nov 12, 2024 · 1 comment

Comments

@NewtTheWolf
Copy link
Contributor

Summary

I would like to request a feature to enable downloading logs directly from the Latitude UI (/reports) with an associated API endpoint that retrieves the logs. This would streamline reporting and allow for detailed analytics operations.

Use Case

The ability to download logs serves multiple purposes:

  1. Reporting: Automate the generation of detailed reports based on log data.
  2. Analytics: Facilitate external data analysis on prompts, user interactions, and performance metrics over time.

Proposed Functionality

  1. UI Enhancement:
    • Add a "Download Logs" option within the logs or reports section of the UI.
    • Allow users to specify filters (e.g., date range, specific prompt name, or other custom rules) to limit the logs included in the download.
  2. API Endpoint:
    • Create a dedicated API endpoint that provides log data based on specified filters.
    • Include support for parameters such as:
      • Date range
      • Specific prompt(s) or document path
      • Rule-based filtering (e.g., logs containing specific keywords or meeting specific evaluation scores).

Potential Filters

  • Date Range: Download logs within a specified date range.
  • Prompt or Document Path: Filter logs by particular prompts/documents.
  • Custom Rules: Filter logs that meet specific criteria, such as containing specific keywords, having certain evaluation scores, or generated by specific user actions.

Benefits

This feature would allow teams to easily extract logs for offline analysis, compliance reporting, and process improvements, making Latitude even more robust for business and analytics needs.

Thank you for considering this feature request!

@geclos geclos added enhancement New feature or request p2 Medium priority issues labels Nov 12, 2024
@geclos
Copy link
Collaborator

geclos commented Nov 12, 2024

should be very ez to implement a get endpoint in gateway

@cesr cesr removed enhancement New feature or request p2 Medium priority issues labels Nov 12, 2024
@cesr cesr moved this from Inbox to Backlog in Latitude LLM Roadmap Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Development

No branches or pull requests

3 participants