v0.15.1

[laipz8200]

🚀 What’s New in v0.15.1? 🚀

Here's a peek into what the new 0.15.1 release brings to the table:

🎉 New Features

• Sonnet 3.5 Document Support in OpenRouter: Leverage the new document feature via OpenRouter by @infinitnet in Add 'document' feature to Sonnet 3.5 through OpenRouter #12444. This is going to enhance your document management capabilities.
• ElasticSearch for Japanese: Support for Japanese language ElasticSearch queries has been added, thanks to @fujita-h in Feat elasticsearch japanese #12194.
• Milvus Full Text Search: Expanded Milvus support to include full-text search capability by @kgpp34 in FEAT: support milvus to full text search #11430.
• New API Endpoint: We've added a GET upload file API endpoint for the dataset service by @euxx in feat: add GET upload file API endpoint to dataset service api #11899.
• Opik Tracking Tool Integration: Introducing integration with the Opik Tracking tool for advanced monitoring by @Lothiraldan in Add new integration with Opik Tracking tool #11501.
• Knowledge API ToC: Added a table of contents to the Knowledge API documentation to improve navigation by @euxx in feat: add table of contents to Knowledge API doc #12688.

🛠️ Enhancements

• Bedrock Retrieve Tool: Update includes hybrid search type and additional support by @ybalbert001 in Fix #12448 - update bedrock retrieve tool, support hybrid search type and re… #12446.
• Workflow Interaction: Now, you can actually see the running status of workflows courtesy of @crazywoola in feat: show workflow running status #12531.
• Knowledge Admin Role Removal: Cleaned up roles by removing the unnecessary knowledge admin role, courtesy of @JohnJyong in remove knowledge admin role #12450.

🐛 Bug Fixes

• URL Variables: Fixed a critical bug where URLs containing variables were not functioning properly by @hjlarry in fix: url with variable not work #12452.
• Remote URL Fallback: Added a fallback to remote_url to eliminate errors when url isn't provided thanks to @fujita-h in fix: allow fallback to remote_url when url is not provided #12455.
• Docker-Compose Sync: Resolved reverse sync inconsistencies for docker-compose-template.yaml by @fujita-h in fix: Reverse sync docker-compose-template.yaml #12509.
• Milvus Same Chunk Deadlock: Fixed an issue causing deadlocks when inserting the same chunk by @huangzhuo1949 in fix: same chunk insert deadlock #12502.
• Costs Calculation: Fixed sum costs returning incorrect values on the overview page by @douxc in fix: sum costs return error value on overview page #12534.
• Workflow Node Processing: Corrected the answer node stream processing in conditional branches by @Kevin9703 in fix(workflow): fix answer node stream processing in conditional branches #12510.

These numerous bug fixes and enhancements make v0.15.1 more robust, efficient, and flexible. Keep those feedback channels open; we always want to hear how these changes help or hinder your workflows!

---

Upgrade Guide

Docker compose deployments

Warning

The files in the docker-legacy directory will soon stop being maintained and will be removed from the repository. If you are still using them, please switch to the new version as soon as possible.

1. Back up your customized docker-compose YAML file (optional)

   cd docker
   cp docker-compose.yaml docker-compose.yaml.$(date +%s).bak

2. Get the latest code from the main branch

   git checkout main
   git pull origin main

3. Stop the service，Command, please execute in the docker directory

   docker compose down

4. Back up data

   tar -cvf volumes-$(date +%s).tgz volumes

5. Upgrade services

   docker compose up -d

Source Code deployments

1. Stop API server, Worker and Web frontend Server.

2. Get the latest code from the release branch:

   git checkout 0.15.1

3. Update Python dependencies:

   cd api
   poetry install

4. Then, let's run the migration script:

   poetry run flask db upgrade

5. Finally, run API server, Worker and Web frontend Server again.

---

What's Changed

• Fix [bedrock knowledge base] Can't use hybrid search and rerank model #12448 - update bedrock retrieve tool, support hybrid search type and re… by @ybalbert001 in Fix #12448 - update bedrock retrieve tool, support hybrid search type and re… #12446
• Add 'document' feature to Sonnet 3.5 through OpenRouter by @infinitnet in Add 'document' feature to Sonnet 3.5 through OpenRouter #12444
• remove knowledge admin role by @JohnJyong in remove knowledge admin role #12450
• fix: url with variable not work by @hjlarry in fix: url with variable not work #12452
• fix: allow fallback to remote_url when url is not provided by @fujita-h in fix: allow fallback to remote_url when url is not provided #12455
• add tidb on qdrant redis lock by @JohnJyong in add tidb on qdrant redis lock #12462
• Revert "fix:deepseek tool call not working correctly" by @crazywoola in Revert "fix:deepseek tool call not working correctly" #12463
• fix: adjust opacity for model selector based on readonly state by @WTW0313 in fix: adjust opacity for model selector based on readonly state #12472
• Feat elasticsearch japanese by @fujita-h in Feat elasticsearch japanese #12194
• fix: fix the incorrect plaintext file key when saving by @acelyc111 in fix: fix the incorrect plaintext file key when saving #10429
• fix: tiktoken cannot be loaded without internet by @laipz8200 in fix: tiktoken cannot be loaded without internet #12478
• feat: support single run doc extractor node by @hjlarry in feat: support single run doc extractor node #11318
• FEAT: support milvus to full text search by @kgpp34 in FEAT: support milvus to full text search #11430
• fix create_by_text raise 500 error when create an empty dataset #12453 Error: inconsistent dimensions in the vector table, When changing the embedding model of the empty knowledge base and uploading documents. #12482 by @JohnJyong in fix #12453 #12482 #12495
• chore: improve app doc by @hjlarry in chore: improve app doc #12490
• feat: add ci job to test template for docker compose by @kurokobo in feat: add ci job to test template for docker compose #12514
• fix: Reverse sync docker-compose-template.yaml by @fujita-h in fix: Reverse sync docker-compose-template.yaml #12509
• fix: add last_refresh_time to track the validity of is_other_tab_refreshing by @douxc in fix: add last_refresh_time to track the validity of is_other_tab_refreshing #12517
• Fix: Add a INFO-level log when fallback to gpt2tokenizer by @halogen22 in Fix: Add a INFO-level log when fallback to gpt2tokenizer #12508
• feat: add GET upload file API endpoint to dataset service api by @euxx in feat: add GET upload file API endpoint to dataset service api #11899
• fix: same chunk insert deadlock by @huangzhuo1949 in fix: same chunk insert deadlock #12502
• fix: Parsing OpenAPI spec for external tools (Error on parsing OpeanAPI spec #12518) by @lotsik in fix: Parsing OpenAPI spec for external tools (#12518) #12530
• feat: show workflow running status by @crazywoola in feat: show workflow running status #12531
• fix: sum costs return error value on overview page by @douxc in fix: sum costs return error value on overview page #12534
• fix: Add datasets list access control and fix datasets config display issue by @WTW0313 in fix: Add datasets list access control and fix datasets config display issue #12533
• Feat/add knowledge include all filter by @JohnJyong in Feat/add knowledge include all filter #12537
• chore: translate i18n files by @github-actions in chore: translate i18n files #12543
• improve the readability of the function generate_api_key by @gakkiyomi in improve the readability of the function generate_api_key #12552
• Feat/new saas billing by @JohnJyong in Feat/new saas billing #12591
• Fix pandas indexing method for knowledge base imports (Knowledge Base Document Q&A Format Batch Add Segment Failure #12637) by @CN-P5 in Fix pandas indexing method for knowledge base imports (#12637) #12638
• chore: Adjust translations to align with Taiwanese Mandarin conventions by @chuehnone in chore: Adjust translations to align with Taiwanese Mandarin conventions #12633
• fix: ruff check for True if ... else by @yihong0618 in fix: ruff check for True if ... else #12576
• fix: ruff with statements by @yihong0618 in fix: ruff with statements #12578
• fix(workflow): fix answer node stream processing in conditional branches by @Kevin9703 in fix(workflow): fix answer node stream processing in conditional branches #12510
• Revert "Feat/new saas billing" by @JohnJyong in Revert "Feat/new saas billing" #12673
• fix: Update variable handling in VariableAssignerNode and clean up app_dsl_service by @laipz8200 in fix: Update variable handling in VariableAssignerNode and clean up app_dsl_service #12672
• fix: add type hints for App model and improve error handling in audio services by @laipz8200 in fix: add type hints for App model and improve error handling in audio services #12677
• Add new integration with Opik Tracking tool by @Lothiraldan in Add new integration with Opik Tracking tool #11501
• api tool support multiple env url by @mboo2005 in api tool support multiple env url #12249
• [fix] support feature restore by @warren830 in [fix] support feature restore #12563
• feat: add table of contents to Knowledge API doc by @euxx in feat: add table of contents to Knowledge API doc #12688
• chore: bump version to 0.15.1 by @laipz8200 in chore: bump version to 0.15.1 #12690

New Contributors

• @kgpp34 made their first contribution in FEAT: support milvus to full text search #11430
• @halogen22 made their first contribution in Fix: Add a INFO-level log when fallback to gpt2tokenizer #12508
• @lotsik made their first contribution in fix: Parsing OpenAPI spec for external tools (#12518) #12530
• @gakkiyomi made their first contribution in improve the readability of the function generate_api_key #12552
• @CN-P5 made their first contribution in Fix pandas indexing method for knowledge base imports (#12637) #12638
• @chuehnone made their first contribution in chore: Adjust translations to align with Taiwanese Mandarin conventions #12633
• @Lothiraldan made their first contribution in Add new integration with Opik Tracking tool #11501
• @mboo2005 made their first contribution in api tool support multiple env url #12249

Full Changelog: 0.15.0...0.15.1

---

This discussion was created from the release v0.15.1.