You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add tool caching and status monitoring features to documentation
- Expanded `features.md` to include a detailed section on the new tool caching and status monitoring system, highlighting its key features and benefits.
- Updated `web-ui-guide.md` with comprehensive instructions on managing tool caches and monitoring tool status, including UI interactions and default settings.
- Added a new image for the tool status panel to enhance visual documentation.
Copy file name to clipboardExpand all lines: docs/features.md
+29Lines changed: 29 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -245,4 +245,33 @@ The tool configuration panel is accessible from the settings menu and provides a
245
245
- Toggle controls for built-in tools that don't require API keys
246
246
247
247
This user-friendly approach to tool configuration significantly improves the accessibility of advanced features, allowing non-technical users to fully utilize the AI's capabilities without developer assistance.
The DeepSeek Wrapper includes an advanced tool caching and status monitoring system that enhances performance and provides comprehensive visibility into the tool ecosystem.
254
+
255
+
Key features of the tool caching system:
256
+
-**Intelligent caching**: Automatically caches tool results based on input parameters
257
+
-**Configurable TTL**: Time-to-live settings define how long cached results remain valid
258
+
-**Cache statistics**: Detailed hit/miss metrics for performance monitoring
259
+
-**Automatic cleanup**: Expired cache entries are automatically removed
260
+
-**Manual control**: Clear individual or all tool caches directly from the UI
261
+
262
+
The status monitoring system provides:
263
+
-**Real-time tool status**: See which tools are ready, in error state, or not configured
264
+
-**API key validation**: Automatic checking of API key validity
265
+
-**Usage monitoring**: Track when tools were last used
266
+
-**Cache visibility**: View cache size and performance metrics for each tool
267
+
-**Visual indicators**: Color-coded status badges show tool health at a glance
268
+
269
+
This comprehensive monitoring and caching system improves both performance and reliability:
270
+
-**Reduced API costs**: Fewer redundant API calls to external services
271
+
-**Faster responses**: Cached results return instantly without external API calls
272
+
-**Rate limit protection**: Minimizes chances of hitting API rate limits
273
+
-**Better debugging**: Clear visibility into tool status helps troubleshoot issues
274
+
-**Enhanced reliability**: Retries and error handling improve overall stability
275
+
276
+
The entire system is accessible through an intuitive UI panel, allowing non-technical users to monitor and manage tool performance without developer assistance.
Copy file name to clipboardExpand all lines: docs/web-ui-guide.md
+47Lines changed: 47 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -189,6 +189,53 @@ Once tools are configured, you can use them in your conversations by asking ques
189
189
190
190
The AI will automatically use the appropriate tool when needed to answer your questions.
191
191
192
+
#### Tool Status and Caching
193
+
194
+
The DeepSeek Wrapper includes a comprehensive tool status monitoring system and caching mechanism. These features enhance performance and provide better visibility into the tool system:
195
+
196
+
1.**Tool Status Panel**: The Tools tab includes a status panel showing:
197
+
- Ready, error, and unconfigured tool counts
198
+
- Detailed status for each registered tool
199
+
- API key validation status
200
+
- Last usage information
201
+
202
+
2.**Caching System**: Tools use an intelligent caching system to improve performance:
203
+
- Reduces redundant API calls for identical requests
204
+
- Configurable cache time-to-live (TTL) settings
205
+
- Cache hit/miss statistics for performance monitoring
206
+
- Automatic cleanup of expired cache entries
207
+
208
+

209
+
210
+
The caching system provides several benefits:
211
+
- Faster response times for repeated queries
212
+
- Reduced API usage and associated costs
213
+
- Less network traffic and lower latency
214
+
- Protection against rate limiting on external APIs
215
+
216
+
##### Managing Tool Caches
217
+
218
+
You can manage the tool caching system directly from the UI:
219
+
220
+
1.**View Cache Statistics**: See cache size, hit ratios, and history for each tool
221
+
2.**Clear Individual Caches**: Each tool has a dedicated cache clear button
222
+
3.**Clear All Caches**: Use the "Clear Tool Caches" button to reset all caches at once
223
+
4.**Refresh Tool Status**: Update the status display to see the latest information
224
+
225
+
> **Note**: Clearing the cache doesn't impact tool functionality but may result in slightly slower responses until the cache is rebuilt with new requests.
226
+
227
+
##### Cache Settings
228
+
229
+
The caching system uses these default settings:
230
+
231
+
| Setting | Default Value | Description |
232
+
|---------|---------------|-------------|
233
+
| Cache Enabled | Yes | Whether caching is active for each tool |
234
+
| Time-to-Live (TTL) | 300 seconds | How long cached results remain valid |
235
+
| Cache Key | Request parameters | What determines a cache hit/miss |
236
+
237
+
These settings provide an optimal balance between performance and freshness of information for most use cases.
238
+
192
239
### Conversation Management
193
240
194
241
-**Starting a new conversation**: Click the "New Chat" button
0 commit comments