v2.6
December 6, 2024
Playground and SDK updates
This update introduces exciting new features, performance enhancements, and crucial fixes to ensure better usability and functionality.
Highlights
- Multimodal Agents: Agents now natively support image and audio with video coming soon.
- Agentic Workflows are now generally available: Build deterministic multi-agent pipelines using Workflows.
- Agent can share state between tool calls: New session_state variable allows Agents to maintain and share state across function calls.
- Agents in teams can respond directly to the user: now responses of team members do not need to go through the team leader.
- Context Injection: Agents can be provided context that is resolved in real-time during execution.
- Human-in-the-loop: Tool calls can now be confirmed (or approved) before being executed.
- Advanced chunking: Support for Semantic and Agentic chunking (and more).
New Features
- Show Reasoning in the Playground: Provides users with insights into the agent's thought process and decision-making, offering a behind-the-scenes look at how the agent operates within the Playground.
- Show Tool Call in the Playground: Display tool call results and metrics on hover within the Playground.
- Sessions Page Enhancements: Added context, reasoning, and tools integration to the Sessions page.
- Delete Custom Endpoint for Playground: Introduced the ability to delete endpoints directly within the Playground.
- Show References in the Playground: You can now view the sources used for RAG.
- Chunking Strategies in RAG: Introduced five levels of chunking strategies in RAG: Semantic Chunking, Fixed Chunking, Agentic Chunking, Document Chunking, and Recursive Chunking.
- Unified Reranker for Vector Databases: Implemented a unified reranking feature across various vector databases, including LanceDB, with support for CohereReranker.
- Milvus Vector Database Integration: Added support for Milvus as a vector database option.
- Support for Multi-Modalities: Added support for processing audio, video, and image data to enhance agent capabilities.
- Context Injection: Improved context handling to enhance agent responses and usability.
- Pre-hook and post-hook for function calls: enabling users to validate arguments, add human-in-the-loop flows and validate results of tool calls.
Improvements
- Duplicate Endpoint Prevention: Enhanced custom endpoint creation logic to prevent duplicates.
- Workflow Session Logging: Improved logging mechanisms for workflow sessions.
- Ollama Tool Call Streaming: Updated the Ollama tool to improve call streaming capabilities.
- Logging Updates for Gemini: Enhanced logging functionality for Gemini models.
- Ollama LLM Class Updates: Resolved issues in tool calling to improve usage reliability.
- Product Manager Agent Workflow Example: Added a new example to demonstrate the practical use and capabilities of workflow.
- Dynamic Prompts: System prompt, user prompt and instructions can now be passed as functions resolved during run-time.
Bug Fixes
- Session Read-All Fix: Fixed an issue where titles were not created when users provided a list of messages instead of a single message.
- Ollama Tool Response Issue: Addressed inconsistencies where Ollama tools always returned empty responses.
Breaking Changes
- `Agent.add_context` is now `Agent.add_references` as the context terminology is now used for context injection. Similarly, `context_format` is now `references_format`.