[improvement][headless-fe] Revamped the dimension value settings in the assistant module. (#1842)

* [improvement][semantic-fe] Fixing the logic error in the dimension value setting.

* [improvement][semantic-fe] Fixing the synchronization issue with the question and answer settings information.

* [improvement][semantic-fe] Optimizing the canvas functionality for better performance and user experience.

* [improvement][semantic-fe] Optimizing the update process for drawing model relationship edges in the canvas.

* [improvement][semantic-fe] Changing the line type for canvas connections.

* [improvement][semantic-fe] Replacing the initialization variable from "semantic" to "headless".

* [improvement][semantic-fe] Fixing the missing migration issue for default drill-down dimension configuration in model editing. Additionally, optimizing the data retrieval method for initializing fields in the model.

* [improvement][semantic-fe] Updating the logic for the fieldName.

* [improvement][semantic-fe] Adjusting the position of the metrics tab.

* [improvement][semantic-fe] Changing the 字段名称 to 英文名称.

* [improvement][semantic-fe] Fix metric measurement deletion.

* [improvement][semantic-fe] UI optimization for metric details page.

* [improvement][semantic-fe] UI optimization for metric details page.

* [improvement][semantic-fe] UI adjustment for metric details page.

* [improvement][semantic-fe] The granularity field in the time type of model editing now supports setting it as empty.

* [improvement][semantic-fe] Added field type and metric type to the metric creation options.

* [improvement][semantic-fe] The organization structure selection feature has been added to the permission management.

* [improvement][semantic-fe] Improved user experience for the metric list.

* [improvement][semantic-fe] fix update the metric list.

* [improvement][headless-fe] Added view management functionality.

* [improvement][headless-fe] The view management functionality has been added. This feature allows users to create, edit, and manage different views within the system.

* [improvement][headless-fe] Added model editing side effect detection.

* [improvement][headless-fe] Fixed the logic error in view editing.

* [improvement][headless-fe] Fixed the issue with initializing dimension associations in metric settings.

* [improvement][headless-fe] Added the ability to hide the Q&A settings entry point.

* [improvement][headless-fe] Fixed the issue with selecting search results in metric field creation.

* [improvement][headless-fe] Added search functionality to the field list in model editing.

* [improvement][headless-fe] fix the field list in model editing

* [improvement][headless-fe] Restructured the data for the dimension value settings interface.

* [improvement][headless-fe] Added dynamic variable functionality to model creation based on SQL scripts.

* [improvement][headless-fe] Added support for passing dynamic variables as parameters in the executeSql function.

* [improvement][headless-fe] Resolved the issue where users were unable to select all options for dimensions, metrics, and fields in the metric generation process.

* [improvement][headless-fe] Replaced the term "view" with "dataset"

* [improvement][headless-fe] Added the ability to export metrics and dimensions to a specific target.

* [improvement][headless-fe] Enhanced dataset creation to support the tag mode.

* [improvement][headless-fe] Added tag value setting.

* [improvement][headless-fe] Optimized the tag setting system.

* [improvement][headless-fe] Optimized the tag setting system.

* [improvement][headless-fe] Updated the data initialization for model editing to use API requests instead.

* [improvement][headless-fe] Added search functionality to model management.

* [improvement][headless-fe] Removed field null validation during model editing.

* [improvement][headless-fe] Updated the batch operation button component.

* [improvement][headless-fe] Optimized the logic for initializing indicators in dimension value settings.

* [improvement][headless-fe] Adjusted the length of the input field for model editing names.

* [improvement][headless-fe]  Lock the version of the @ant-design/pro-table component and replace it with @ant-design/pro-components.

* [improvement][headless-fe] Optimized the style of the metrics market and tags market.

* [improvement][headless-fe] The quick creation of model fields now defaults to using the "comment" field for filling.

* [improvement][headless-fe] The quick creation of model fields now defaults to using the "comment" field for filling

* [improvement][headless-fe] The quick creation of model fields now defaults to using the "comment" field for filling.

* [improvement][headless-fe] Fixed the issue where the conditions for metric measurement creation were not being saved correctly.

* [improvement][headless-fe] Default value setting for hiding dimensions.

* [improvement][headless-fe] Updated the file imports in the project.

* [improvement][headless-fe] Adjusted the logic for displaying the tab in the theme domain.

* [improvement][headless-fe] Added term management functionality.

* [improvement][headless-fe] When creating a model, the current metric operator now allows for clearance.

* [improvement][headless-fe] Term management interface transformation

* [improvement][headless-fe] Migrating scaffold version to @umi/max

* [improvement][headless-fe] remove modle column

* [improvement][headless-fe] 1.Added configuration for the large language model in the agent; 2.upgraded React version from 17 to 18; 3.modified some UI effects.

* [improvement][headless-fe] Added a simplified mode to the question-answering system.

* [improvement][headless-fe] remove pnpm-lock

* [improvement][headless-fe] add pnpm-lock

* [improvement][headless-fe] Fixed the issue with passing the modelId during initialization.

* [improvement][headless-fe] Fixed the issue with abnormal comments during model creation.

* [improvement][headless-fe] fix  build bugs

* [improvement][headless-fe]  change build config

* [improvement][headless-fe] route config change

* [improvement][headless-fe] Optimized data updating when switching domains.

* [improvement][headless-fe] css change

* [improvement][semantic-fe] logo css change

* [improvement][semantic-fe] system config add defaultValue support

* [improvement][semantic-fe] tag mode wording change

* [improvement][semantic-fe] fix metric edit page init error

* [improvement][supersonic-fe] Updated the way chat projects are imported in supersonic-fe.

* [improvement][chat-engine] Added a background silent mode for watching chat projects.

* [improvement][supersonic-fe] fix proxy url

* [improvement][headless-fe] agent setting update

* [improvement][headless-fe] Agent configuration: Added connectivity testing for large models.

* [improvement][headless-fe] Chat: Enabled integration with agent configuration.

* [improvement][headless-fe] SQL formatter: Updated the import method.

* [improvement][headless-fe] login fixed

* [improvement][headless-fe] Agent: Optimized the logic for saving.

* [improvement][headless-fe] Model management: Integrated into the main theme domain.

* [improvement][headless-fe] Sensitivity: Added bulk modification functionality.

* [improvement][headless-fe] wording change

* [improvement][headless-fe] Prompt configuration: Added the ability to configure prompts.

* [improvement][headless-fe] Added the ability to configure embedding models.

* [improvement][headless-fe] hidden configure embedding models.

* [improvement][headless-fe] Connection test prompt update for large language model settings.

* [improvement][headless-fe]  add memory review config

* [improvement][headless-fe] Rollback of data structure for large language model configuration.

* [improvement][headless-fe] Added dependency relationships between various items in system configuration.

* [improvement][headless-fe] Added password parsing to the generation rules of system settings.

* [improvement][headless-fe] Added slider parsing to the generation rules of system settings.

* [improvement][headless-fe] Optimized the logic for initializing values in system settings.

* [improvement][headless-fe] Optimized the time format

* [improvement][headless-fe] Unified the SQL generation method for data sets to ensure consistency and improve efficiency.

* [improvement][headless-fe] Added support for data sets with non-partitioned time fields

* [improvement][headless-fe] Added support for editing time formats in dimension settings

* [improvement][headless-fe] Rolled back the time parameter in the metric details page to its previous state

* [improvement][headless-fe] Fixed the issue with hidden field validation when editing dimensions

* [improvement][headless-fe] Added a connectivity test for large models in the system settings

* [improvement][headless-fe] Changed the METRIC type in ChatContextType queryType to AGGREGATE

* [improvement][headless-fe] Added query and batch delete operations to the terminology management feature

* [improvement][headless-fe] Enhanced the memory management feature by adding sorting functionality and other optimization features.

* [improvement][headless-fe] Resolved the compatibility issue with the backend service where the updatedAt and other time fields were not being properly converted to the updated_at format for sorting purposes.

* [improvement][headless-fe] Added a configuration interface for large language models

* [improvement][headless-fe] Introduced a new configuration option in the assistant module specifically for large model applications.

* [improvement][headless-fe] Replaced the agentConfig with toolConfig

* [improvement][headless-fe] Resolved the issue with the test connection parameters for the large model configuration.

* [improvement][headless-fe] Implemented a new feature where the tool configuration types can be fetched from the backend API

* [improvement][headless-fe] Updated the dimension value settings to retrieve and display values from a dictionary.

* [improvement][headless-fe] Adjusted the pageSize of the dimension value settings list to 20.

* [improvement][headless-fe] Introduced a revamped configuration for the large model in the assistant module.

* [improvement][headless-fe] Added new functionality to the assistant's memory management system

* [improvement][headless-fe] Optimized the management of CSS styles in the assistant module.

* [improvement][headless] fixed build config

* [improvement][headless-fe] Revamped the dimension value settings in the assistant module.

---------

Co-authored-by: tristanliu <tristanliu@tencent.com>
This commit is contained in:
tristanliu
2024-10-23 15:24:34 +08:00
committed by GitHub
parent c792543d19
commit 5eefeb85a3
22 changed files with 1088 additions and 780 deletions

View File

@@ -1,10 +1,20 @@
import React, { useEffect, useState } from 'react';
import { Button, Modal, message, Space, Tooltip, Tabs, Input } from 'antd';
import { Button, Modal, message, Tabs, Input, Form, Divider } from 'antd';
import TableHeaderFilter from '@/components/TableHeaderFilter';
import { ISemantic } from '../data';
import CommonEditTable from './CommonEditTable';
import { updateDimension, getDictData } from '../service';
import { KnowledgeConfigTypeEnum, KnowledgeConfigStatusEnum } from '../enum';
import BatchCtrlDropDownButton from '@/components/BatchCtrlDropDownButton';
import {
updateDimension,
getDictData,
searchKnowledgeConfigQuery,
editDictConfig,
} from '../service';
import { uniqueArray } from '@/utils/utils';
import DimensionValueSettingForm from './Entity/DimensionValueSettingForm';
import DimensionValueFilterModal from './Entity/DimensionValueFilterModal';
export type CreateFormProps = {
dimensionValueSettingList: ISemantic.IDimensionValueSettingItem[];
@@ -14,7 +24,7 @@ export type CreateFormProps = {
onSubmit: (values?: any) => void;
};
type TableDataSource = { techName: string; bizName: string; alias?: string[] };
type TableDataSource = { value: string; bizName: string; alias?: string[] };
const DimensionValueSettingModal: React.FC<CreateFormProps> = ({
onCancel,
@@ -25,16 +35,29 @@ const DimensionValueSettingModal: React.FC<CreateFormProps> = ({
}) => {
const [tableDataSource, setTableDataSource] = useState<TableDataSource[]>([]);
const [dimValueMaps, setDimValueMaps] = useState<ISemantic.IDimensionValueSettingItem[]>([]);
const [form] = Form.useForm();
const [refreshLoading, setRefreshLoading] = useState<boolean>(false);
const [knowledgeConfig, setKnowledgeConfig] = useState<ISemantic.IDictKnowledgeConfigItem>();
const [dimensionVisibleState, setDimensionVisibleState] = useState<KnowledgeConfigStatusEnum>(
KnowledgeConfigStatusEnum.OFFLINE,
);
const [selectedRowKeys, setSelectedRowKeys] = useState<React.Key[]>([]);
const [llmLoading, setLlmLoading] = useState<boolean>(false);
const [filterParams, setFilterParams] = useState<Record<string, any>>({});
const [menuKey, setMenuKey] = useState<string>('default');
const [saveLoading, setSaveLoading] = useState<boolean>(false);
const [dimensionValueFilterModalVisible, setDimensionValueFilterModalVisible] =
useState<boolean>(false);
const defaultPagination = {
current: 1,
pageSize: 20,
pageSize: 10,
total: 0,
};
const [pagination, setPagination] = useState(defaultPagination);
useEffect(() => {
searchKnowledgeConfig();
queryDictData();
setDimValueMaps(dimensionValueSettingList);
}, [dimensionValueSettingList]);
@@ -59,6 +82,54 @@ const DimensionValueSettingModal: React.FC<CreateFormProps> = ({
message.error(msg);
};
const editConfigQuery = async (config: Record<string, any>) => {
if (!knowledgeConfig?.id) {
message.success('配置不存在!');
return;
}
setSaveLoading(true);
const queryConfig = {
...knowledgeConfig,
config: {
...knowledgeConfig.config,
...config,
},
};
const { code } = await editDictConfig(queryConfig);
setSaveLoading(false);
if (code === 200) {
searchKnowledgeConfig();
message.success('维度值设置保存成功!');
return;
}
message.error('维度值设置保存失败!');
};
const searchKnowledgeConfig = async () => {
setRefreshLoading(true);
const { code, data } = await searchKnowledgeConfigQuery({
type: KnowledgeConfigTypeEnum.DIMENSION,
itemId: dimensionItem.id,
});
setRefreshLoading(false);
if (code !== 200) {
message.error('获取字典导入配置失败!');
return;
}
const configItem = data[0];
if (configItem) {
const { status, config } = configItem;
setDimensionVisibleState(status);
form.setFieldsValue({
...config,
});
setKnowledgeConfig(configItem);
} else {
}
};
const queryDictData = async (params = {}) => {
setLlmLoading(true);
const { code, data } = await getDictData({
@@ -139,30 +210,11 @@ const DimensionValueSettingModal: React.FC<CreateFormProps> = ({
],
},
},
// {
// title: '业务名称',
// dataIndex: 'bizName',
// width: 200,
// tooltip:
// '查询完成后,最终返回给用户的维度值信息。比如将技术名称kw转换成酷我平台,最终返回给用户是酷我平台',
// fieldProps: {
// placeholder: '请填写业务名称',
// },
// formItemProps: {
// rules: [
// {
// required: true,
// whitespace: true,
// message: '此项是必填项',
// },
// ],
// },
// },
{
title: '别名',
dataIndex: 'alias',
valueType: 'select',
width: 500,
width: 480,
tooltip:
'解析用户查询意图时,支持别名到技术名称的转换。比如用户输入kw、kuwo、酷我,完成设置后,都可以将其转换成技术名称kw',
fieldProps: {
@@ -172,95 +224,235 @@ const DimensionValueSettingModal: React.FC<CreateFormProps> = ({
tokenSeparators: [','],
},
},
];
const tabItem = [
{
label: '维度值管理',
key: 'default',
children: (
<CommonEditTable
tableDataSource={tableDataSource}
columnList={columns}
onDataSourceChange={(tableData) => {
const dimValueMaps = tableData.map((item: TableDataSource) => {
return {
...item,
};
});
setDimValueMaps(dimValueMaps);
}}
hideCtrlBtn={['deleteBtn']}
editableProTableProps={{
recordCreatorProps: false,
pagination: pagination,
headerTitle: (
<TableHeaderFilter
components={[
{
label: '维度值搜索',
component: (
<Input.Search
style={{ width: 280 }}
placeholder="请输入维度值名称"
onSearch={(value) => {
setFilterParams((preState) => {
return {
...preState,
keyValue: value,
};
});
queryDictData({ keyValue: value });
}}
/>
),
},
]}
/>
),
onTableChange: (data: any) => {
const { current, pageSize, total } = data;
setPagination({
current,
pageSize,
total,
});
queryDictData({ current, pageSize });
},
}}
/>
),
title: '黑名单',
dataIndex: 'black',
width: 80,
editable: false,
render: (_, record: TableDataSource) => {
const list = knowledgeConfig?.config?.blackList;
if (Array.isArray(list) && list.includes(record.value)) {
return <span style={{ color: '#1677ff' }}></span>;
}
return '-';
},
},
{
label: '维度值设置',
key: 'setting',
children: <DimensionValueSettingForm dataItem={dimensionItem} />,
title: '白名单',
dataIndex: 'white',
width: 80,
editable: false,
render: (_, record: TableDataSource) => {
const list = knowledgeConfig?.config?.whiteList;
if (Array.isArray(list) && list.includes(record.value)) {
return <span style={{ color: '#1677ff' }}></span>;
}
return '-';
},
},
];
const handleMenuChange = (key: string) => {
setMenuKey(key);
const rowSelection = {
onChange: (selectedRowKeys: React.Key[]) => {
setSelectedRowKeys(selectedRowKeys);
},
};
const onMenuClick = (key: string, selectedKeys: React.Key[]) => {
if (selectedKeys.length === 0) {
message.error('请选择至少一个维度值');
return;
}
switch (key) {
case 'batchDimensionValueBlackList': {
const configBlackList = knowledgeConfig?.config?.blackList || [];
const blackList = uniqueArray([...selectedKeys, ...configBlackList]);
editConfigQuery({
blackList,
});
break;
}
case 'batchDimensionValueWhiteList': {
const configWhiteList = knowledgeConfig?.config?.whiteList || [];
const whiteList = uniqueArray([...selectedKeys, ...configWhiteList]);
editConfigQuery({
whiteList,
});
break;
}
case 'batchRemoveDimensionValueBlackList': {
const configBlackList = knowledgeConfig?.config?.blackList || [];
const blackList = configBlackList.filter((item) => {
return !selectedKeys.includes(item);
});
editConfigQuery({
blackList,
});
break;
}
case 'batchRemoveDimensionValueWhiteList':
{
const configWhiteList = knowledgeConfig?.config?.whiteList || [];
const whiteList = configWhiteList.filter((item) => {
return !selectedKeys.includes(item);
});
editConfigQuery({
whiteList,
});
}
break;
case 'batchAddRuleList':
{
editConfigQuery({
ruleList: selectedKeys,
});
}
break;
default:
break;
}
};
// const refreshTableData = () => {
// queryDictData({
// ...pagination,
// ...filterParams,
// });
// };
// const tabItem = [
// {
// label: '维度值管理',
// key: 'default',
// children: (
// ),
// },
// {
// label: '维度值设置',
// key: 'setting',
// children: <DimensionValueSettingForm dataItem={dimensionItem} />,
// },
// ];
// const handleMenuChange = (key: string) => {
// setMenuKey(key);
// };
return (
<Modal
width={1200}
destroyOnClose
title="维度值设置"
title={`维度值设置[${dimensionItem?.name}]`}
style={{ top: 48 }}
maskClosable={false}
open={open}
footer={renderFooter()}
onCancel={onCancel}
>
<Tabs
items={tabItem}
size="large"
activeKey={menuKey}
onChange={(menuKey: string) => {
handleMenuChange(menuKey);
}}
/>
<div>
<DimensionValueSettingForm
dataItem={dimensionItem}
knowledgeConfig={knowledgeConfig}
onVisibleChange={(state) => {
setDimensionVisibleState(state);
}}
/>
{dimensionVisibleState === KnowledgeConfigStatusEnum.ONLINE && (
<>
<Divider style={{ margin: 10 }} />
<CommonEditTable
rowKey="value"
tableDataSource={tableDataSource}
columnList={columns}
onDataSourceChange={(tableData) => {
const dimValueMaps = tableData.map((item: TableDataSource) => {
return {
...item,
};
});
setDimValueMaps(dimValueMaps);
}}
hideCtrlBtn={['deleteBtn']}
editableProTableProps={{
toolBarRender: () => [
<Button
key="3"
type="primary"
onClick={() => {
setDimensionValueFilterModalVisible(true);
}}
>
</Button>,
<BatchCtrlDropDownButton
key="ctrlBtnList"
hiddenList={['batchStart', 'batchStop', 'batchDownload', 'batchDelete']}
extenderList={[
'batchDimensionValueBlackList',
'batchDimensionValueWhiteList',
'batchRemoveDimensionValueBlackList',
'batchRemoveDimensionValueWhiteList',
]}
onMenuClick={(key) => {
onMenuClick(key, selectedRowKeys);
}}
/>,
],
rowSelection: {
type: 'checkbox',
...rowSelection,
},
recordCreatorProps: false,
pagination: pagination,
headerTitle: (
<TableHeaderFilter
components={[
{
label: '维度值搜索',
component: (
<Input.Search
style={{ width: 280 }}
placeholder="请输入维度值名称"
onSearch={(value) => {
setFilterParams((preState) => {
return {
...preState,
keyValue: value,
};
});
queryDictData({ keyValue: value });
}}
/>
),
},
]}
/>
),
onTableChange: (data: any) => {
const { current, pageSize, total } = data;
setPagination({
current,
pageSize,
total,
});
queryDictData({ current, pageSize });
},
}}
/>
</>
)}
</div>
{dimensionValueFilterModalVisible && (
<DimensionValueFilterModal
config={knowledgeConfig!}
onCancel={() => {
setDimensionValueFilterModalVisible(false);
}}
onMenuClick={onMenuClick}
/>
)}
</Modal>
);
};