AI Factory Operations Agent#
The AI Factory Operations Agent is available in the ClusterWareAI ™ GUI and uses a locally available version of Llama to query the ClusterWareAI backend and answer basic questions about your cluster. For example, you can ask it to provide a list of nodes that are down or to tell you what images are available. The AI Factory Operations Agent cannot make changes to your cluster and does not look for answers online. Only Full Admin users can interact with the AI Factory Operations Agent by default.
Note
Some configuration is required before you begin using the AI Factory Operations Agent. See Configure LLM Server for the AI Factory Operations Agent for details.
Access the AI Factory Operations Agent using the 
icon on the lower right corner of
many ClusterWareAI GUI pages.
The AI Factory Operations Agent page has status indicators at the top of the page for the LLM service, LLM model, and ClusterWareAI API. All three need to be available for the AI Factory Operations Agent to answer questions and provide information about the cluster.
AI Agent Conversation History#
The ClusterWareAI software maintains an AI Factory Operations Agent conversation history with each user per head node. Each conversation is a record of previously asked questions. The conversation context is not retained, even between questions in the same conversation, due to the frequently changing nature of a cluster. For example, asking the status of compute node N1 and then asking another question about node N1 can result in different answers if the status of node N1 changes in the time between questions. Use conversations as a way to organize your queries. For example, one conversation could be about how to run certain commands while another could be about node status queries.
Click the New button to start a new conversation. Return to previous conversations by clicking the conversation name in the Conversations panel.
Hover over a conversation and click the pencil icon to rename a conversation. Delete old conversations by hovering over the conversation and clicking the delete icon.
Use the Export Chat button at the top of the page to export your conversation history.
AI Agent Quick Prompts#
A list of common prompts are available in the main chat panel when you start a new conversation. Additional common prompts are available in the Quick Prompts panel on the left. Clicking one of the prompts pre-populates the chat with the query. Use the Hide/Show Prompts button to show or hide the Quick Prompts panel.
AI Agent Terminal#
The Terminal panel on the right shows the interaction with the ClusterWareAI backend and can be used to help troubleshoot issues. Terminal history is not saved. Use the Hide/Show Terminal button to show or hide the Terminal panel.
AI Agent Logging#
The AI Factory Operations Agent publishes audit logs to MQTT for chat history, chat session changes, tools used, and authorization failures. Log messages include up to 2000 characters, so longer chat requests and responses may not be fully captured in the audit log message.
View log history using an MQTT client to subscribe to applicable topics or using the Audit Log Viewer Grafana dashboard. See MQTT Messaging and Grafana Cluster Monitoring for details.