Commit Graph

1428 Commits

Author SHA1 Message Date
jerryjzhang
a18c340a64 Merge remote-tracking branch 'origin/master' 2024-09-21 13:15:13 +08:00
jerryjzhang
b6765387f5 [improvement][headless]Introduce new time mode CURRENT. #1692 2024-09-21 13:14:47 +08:00
LXW
79dc6c04ce (improvement)(chat) Avoid occasional npe when obtaining recommended dimensions (#1693)
Co-authored-by: lxwcodemonkey
2024-09-21 12:27:32 +08:00
jerryjzhang
26ca5300f4 [improvement][launcher]Introduce ollama local models to Text2SQLEval. 2024-09-20 18:48:55 +08:00
daikon
a200483b5c Support limit (#1688) 2024-09-20 18:35:25 +08:00
jerryjzhang
901a8e722a [improvement][project]Apply spotless automatically when maven compile/test. 2024-09-20 18:29:53 +08:00
jerryjzhang
e0a2ed557d [improvement][chat-server]Iterate LLM prompt in the MemoryReviewTask. 2024-09-20 18:21:43 +08:00
jerryjzhang
ac250907f0 [fix][headless-chat]Fix NPE during word searching process.#1672 2024-09-20 17:54:29 +08:00
jerryjzhang
6a8686f513 [improvement][launcher]Add duration counter in Text2SQLEval. 2024-09-20 17:24:00 +08:00
jerryjzhang
c045b34328 [improvement][chat]Expose default prompt template to facilitate customization. 2024-09-20 16:57:21 +08:00
jerryjzhang
2c7758d0ca [improvement][headless-chat]Optimize HeuristicDataSetResolver to prioritize max similarity of dataset and metric.#1690 2024-09-20 14:40:09 +08:00
zhaodongsheng
5ba401addf (fixed)listColumnsBySql from get to Post (#1683)
* refactor(headless): 使用 ColumnReq 请求对象替换 getColumnsBySql引入 ColumnReq 请求对象以统一请求参数,并在 DatabaseController 中替换 getColumnsBySql 方法以使用此对象。相应地,更新 service.ts 中的函数以匹配新端点 listColumnsBySql,并在 SqlDetail.tsx 中调用更新后的函数。

* fix(SemanticModel): 更改listColumnsBySql函数的实现,将请求方法从GET更改为POST,
2024-09-19 11:47:12 +08:00
lexluo09
75bc470670 (improvement)(build) Fix the .NoClassDefFoundError: org/codehaus/stax2/XMLInputFactory2 error (#1682) 2024-09-18 21:40:49 +08:00
LXW
0c0fbb829e (improvement)(auth)Avoid printing error logs when key decryption and token parsing fail (#1681)
* (improvement)(auth) Avoid throwing exceptions after login token authentication fails #1679

(improvement)(common) Do not print error log when key decryption fails #1679


---------

Co-authored-by: lxwcodemonkey
2024-09-18 16:20:12 +08:00
lexluo09
70fff17fbe (improvement)(headless) Delete 'is null' and 'is not null' expressions only in the WHERE clause, and keep them in the HAVING clause (#1680) 2024-09-15 11:05:54 +08:00
zhaodongsheng
2086a560b1 refactor(headless): 使用 ColumnReq 请求对象替换 getColumnsBySql引入 ColumnReq 请求对象以统一请求参数,并在 DatabaseController 中替换 getColumnsBySql 方法以使用此对象。相应地,更新 service.ts 中的函数以匹配新端点 listColumnsBySql,并在 SqlDetail.tsx 中调用更新后的函数。 (#1678) 2024-09-14 20:18:07 +08:00
jerryjzhang
76f41cc32e [improvement][headless-chat]Adjust default mapping threshold, reducing # of similar names. 2024-09-14 15:45:40 +08:00
lexluo09
e64f47a15b (improvement)(common) Adjust the order of chat modes. (#1674) 2024-09-14 15:19:48 +08:00
jerryjzhang
9bcda52757 Merge branch 'master' of github.com:tencentmusic/supersonic 2024-09-14 14:32:44 +08:00
LXW
19f9e15521 (improvement)(headless) Compatible with semicolon after SQL when creating model by sql #1654 (#1673)
* (improvement)(headless) Compatible with semicolon after SQL when creating model by sql #1654

* (improvement)(headless) Compatible with semicolon after SQL when creating model by sql

---------

Co-authored-by: lxwcodemonkey
2024-09-14 14:30:23 +08:00
jerryjzhang
6ac7949a18 [fix][chat]Fix illegal argument exception. 2024-09-14 14:30:04 +08:00
lexluo09
4e1b2e3dfe (improvement)(common) Support deleting 'is null' and 'is not null' expressions in the WHERE clause (#1670) 2024-09-13 23:33:57 +08:00
tristanliu
5981b3a6f4 [improvement][headless-fe] Fixed the issue with hidden field validation when editing dimensions (#1668)
* [improvement][semantic-fe] Optimizing pagination logic and some CSS styles

* [improvement][semantic-fe] Fixing the API for the indicator list by changing "current" to "pageNum"

* [improvement][semantic-fe] Fixing the default value setting for the indicator list

* [improvement][semantic-fe] Adding batch operations for indicators/dimensions/models

* [improvement][semantic-fe] Replacing the single status update API for indicators/dimensions with a batch update API

* [improvement][semantic-fe] Redesigning the indicator homepage to incorporate trend charts and table functionality for indicators

* [improvement][semantic-fe] Optimizing the logic for setting dimension values and editing data sources, and adding system settings functionality

* [improvement][semantic-fe] Upgrading antd version to 5.x, extracting the batch operation button component, optimizing the interaction for system settings, and expanding the configuration generation types for list-to-select component.

* [improvement][semantic-fe] Adding the ability to filter dimensions based on whether they are tags or not.

* [improvement][semantic-fe] Adding the ability to edit relationships between models in the canvas.

* [improvement][semantic-fe] Updating the datePicker component to use dayjs instead.

* [improvement][semantic-fe] Fixing the issue with passing the model ID for dimensions in the indicator market.

* [improvement][semantic-fe] Fixing the abnormal state of the popup when creating a model.

* [improvement][semantic-fe] Adding permission logic for bulk operations in the indicator market.

* [improvement][semantic-fe] Adding the ability to download and transpose data.

* [improvement][semantic-fe] Fixing the initialization issue with the date selection component in the indicator details page when switching time granularity.

* [improvement][semantic-fe] Fixing the logic error in the dimension value setting.

* [improvement][semantic-fe] Fixing the synchronization issue with the question and answer settings information.

* [improvement][semantic-fe] Optimizing the canvas functionality for better performance and user experience.

* [improvement][semantic-fe] Optimizing the update process for drawing model relationship edges in the canvas.

* [improvement][semantic-fe] Changing the line type for canvas connections.

* [improvement][semantic-fe] Replacing the initialization variable from "semantic" to "headless".

* [improvement][semantic-fe] Fixing the missing migration issue for default drill-down dimension configuration in model editing. Additionally, optimizing the data retrieval method for initializing fields in the model.

* [improvement][semantic-fe] Updating the logic for the fieldName.

* [improvement][semantic-fe] Adjusting the position of the metrics tab.

* [improvement][semantic-fe] Changing the 字段名称 to 英文名称.

* [improvement][semantic-fe] Fix metric measurement deletion.

* [improvement][semantic-fe] UI optimization for metric details page.

* [improvement][semantic-fe] UI optimization for metric details page.

* [improvement][semantic-fe] UI adjustment for metric details page.

* [improvement][semantic-fe] The granularity field in the time type of model editing now supports setting it as empty.

* [improvement][semantic-fe] Added field type and metric type to the metric creation options.

* [improvement][semantic-fe] The organization structure selection feature has been added to the permission management.

* [improvement][semantic-fe] Improved user experience for the metric list.

* [improvement][semantic-fe] fix update the metric list.

* [improvement][headless-fe] Added view management functionality.

* [improvement][headless-fe] The view management functionality has been added. This feature allows users to create, edit, and manage different views within the system.

* [improvement][headless-fe] Added model editing side effect detection.

* [improvement][headless-fe] Fixed the logic error in view editing.

* [improvement][headless-fe] Fixed the issue with initializing dimension associations in metric settings.

* [improvement][headless-fe] Added the ability to hide the Q&A settings entry point.

* [improvement][headless-fe] Fixed the issue with selecting search results in metric field creation.

* [improvement][headless-fe] Added search functionality to the field list in model editing.

* [improvement][headless-fe] fix the field list in model editing

* [improvement][headless-fe] Restructured the data for the dimension value settings interface.

* [improvement][headless-fe] Added dynamic variable functionality to model creation based on SQL scripts.

* [improvement][headless-fe] Added support for passing dynamic variables as parameters in the executeSql function.

* [improvement][headless-fe] Resolved the issue where users were unable to select all options for dimensions, metrics, and fields in the metric generation process.

* [improvement][headless-fe] Replaced the term "view" with "dataset"

* [improvement][headless-fe] Added the ability to export metrics and dimensions to a specific target.

* [improvement][headless-fe] Enhanced dataset creation to support the tag mode.

* [improvement][headless-fe] Added tag value setting.

* [improvement][headless-fe] Optimized the tag setting system.

* [improvement][headless-fe] Optimized the tag setting system.

* [improvement][headless-fe] Updated the data initialization for model editing to use API requests instead.

* [improvement][headless-fe] Added search functionality to model management.

* [improvement][headless-fe] Removed field null validation during model editing.

* [improvement][headless-fe] Updated the batch operation button component.

* [improvement][headless-fe] Optimized the logic for initializing indicators in dimension value settings.

* [improvement][headless-fe] Adjusted the length of the input field for model editing names.

* [improvement][headless-fe]  Lock the version of the @ant-design/pro-table component and replace it with @ant-design/pro-components.

* [improvement][headless-fe] Optimized the style of the metrics market and tags market.

* [improvement][headless-fe] The quick creation of model fields now defaults to using the "comment" field for filling.

* [improvement][headless-fe] The quick creation of model fields now defaults to using the "comment" field for filling

* [improvement][headless-fe] The quick creation of model fields now defaults to using the "comment" field for filling.

* [improvement][headless-fe] Fixed the issue where the conditions for metric measurement creation were not being saved correctly.

* [improvement][headless-fe] Default value setting for hiding dimensions.

* [improvement][headless-fe] Updated the file imports in the project.

* [improvement][headless-fe] Adjusted the logic for displaying the tab in the theme domain.

* [improvement][headless-fe] Added term management functionality.

* [improvement][headless-fe] When creating a model, the current metric operator now allows for clearance.

* [improvement][headless-fe] Term management interface transformation

* [improvement][headless-fe] Migrating scaffold version to @umi/max

* [improvement][headless-fe] remove modle column

* [improvement][headless-fe] 1.Added configuration for the large language model in the agent; 2.upgraded React version from 17 to 18; 3.modified some UI effects.

* [improvement][headless-fe] Added a simplified mode to the question-answering system.

* [improvement][headless-fe] remove pnpm-lock

* [improvement][headless-fe] add pnpm-lock

* [improvement][headless-fe] Fixed the issue with passing the modelId during initialization.

* [improvement][headless-fe] Fixed the issue with abnormal comments during model creation.

* [improvement][headless-fe] fix  build bugs

* [improvement][headless-fe]  change build config

* [improvement][headless-fe] route config change

* [improvement][headless-fe] Optimized data updating when switching domains.

* [improvement][headless-fe] css change

* [improvement][semantic-fe] logo css change

* [improvement][semantic-fe] system config add defaultValue support

* [improvement][semantic-fe] tag mode wording change

* [improvement][semantic-fe] fix metric edit page init error

* [improvement][supersonic-fe] Updated the way chat projects are imported in supersonic-fe.

* [improvement][chat-engine] Added a background silent mode for watching chat projects.

* [improvement][supersonic-fe] fix proxy url

* [improvement][headless-fe] agent setting update

* [improvement][headless-fe] Agent configuration: Added connectivity testing for large models.

* [improvement][headless-fe] Chat: Enabled integration with agent configuration.

* [improvement][headless-fe] SQL formatter: Updated the import method.

* [improvement][headless-fe] login fixed

* [improvement][headless-fe] Agent: Optimized the logic for saving.

* [improvement][headless-fe] Model management: Integrated into the main theme domain.

* [improvement][headless-fe] Sensitivity: Added bulk modification functionality.

* [improvement][headless-fe] wording change

* [improvement][headless-fe] Prompt configuration: Added the ability to configure prompts.

* [improvement][headless-fe] Added the ability to configure embedding models.

* [improvement][headless-fe] hidden configure embedding models.

* [improvement][headless-fe] Connection test prompt update for large language model settings.

* [improvement][headless-fe]  add memory review config

* [improvement][headless-fe] Rollback of data structure for large language model configuration.

* [improvement][headless-fe] Added dependency relationships between various items in system configuration.

* [improvement][headless-fe] Added password parsing to the generation rules of system settings.

* [improvement][headless-fe] Added slider parsing to the generation rules of system settings.

* [improvement][headless-fe] Optimized the logic for initializing values in system settings.

* [improvement][headless-fe] Optimized the time format

* [improvement][headless-fe] Unified the SQL generation method for data sets to ensure consistency and improve efficiency.

* [improvement][headless-fe] Added support for data sets with non-partitioned time fields

* [improvement][headless-fe] Added support for editing time formats in dimension settings

* [improvement][headless-fe] Rolled back the time parameter in the metric details page to its previous state

* [improvement][headless-fe] Fixed the issue with hidden field validation when editing dimensions

---------

Co-authored-by: tristanliu <tristanliu@tencent.com>
2024-09-13 17:09:11 +08:00
williamhliu
4c9f16728a (feature)(chat-sdk) add time display above card (#1667) 2024-09-13 15:11:00 +08:00
jerryjzhang
579394af40 [fix][headless-chat]Fix NPE problem. 2024-09-13 14:54:34 +08:00
jipeli
5f4d24348a [improvement][headless] fix queryData by dimension error (#1666) 2024-09-13 14:37:14 +08:00
jerryjzhang
e901ff8370 [improvement][launcher]Fix some test cases in Text2SQLEval. 2024-09-13 11:57:40 +08:00
lexluo09
faae692dff (fix)(headless) Fix the error that occurs when inserting in multiple cases of drill-down dimensions (#1665) 2024-09-13 11:47:28 +08:00
jerryjzhang
d89d6661a9 [improvement][headless]Format the Text2SQL prompt to make it more readable. 2024-09-13 09:31:50 +08:00
yudong
0ff31ddf61 (improvement)(chat) 优化提示工程、重试机制 (#1658) 2024-09-13 09:25:55 +08:00
jerryjzhang
37f12391b0 [improvement][headless]Add databaseType into the Schema part of the Text2SQL prompt. #1621 2024-09-12 23:20:49 +08:00
SuperLiChaoRen
47cc933aec (fix)(headless)When reload dictWord, the old data was not cleared (#1659) 2024-09-12 22:27:17 +08:00
williamhliu
e07ba7cfdb (improvement)(chat-sdk) modify sql field and plugin card width (#1662) 2024-09-12 20:32:01 +08:00
jerryjzhang
c99d240b65 [improvement][headless]Restructure LLMReq and LLMSchema. 2024-09-12 20:10:17 +08:00
lexluo09
4b1dab8e4a (improvement)(headless) Upgrade to the latest version of langchain4j and add support for embedding deletion operation and reset. (#1660) 2024-09-12 18:16:16 +08:00
jerryjzhang
693356e46a [improvement][headless]Add metricFormat field to metric metadata of the Text2SQL prompt. #1621 2024-09-12 18:13:44 +08:00
jerryjzhang
2fa3bfe019 (improvement)(headless)Add timeFormat to dimension metadata of the Text2SQL prompt.
(improvement)(headless)Add `timeFormat` to dimension metadata of the Text2SQL prompt. #1621.
2024-09-12 10:03:24 +08:00
lexluo09
ff0833ddfa [improvement](headless) Optimize the reload embedding interface (#1655) 2024-09-11 22:52:46 +08:00
yudong
51e7a9bcd7 (fix)(chat) 修复做embedding检索时,出现重复数据的问题 (#1643) 2024-09-11 22:07:23 +08:00
jerryjzhang
989ae3c128 [improvement][headless]Add partitionTime and primaryKey field into the Schema part of the Text2SQL prompt. #1621 2024-09-11 21:34:49 +08:00
jerryjzhang
82b5fa966a [improvement][headless]Add partitionTime and primaryKey field into the Schema part of the Text2SQL prompt. #1621 2024-09-11 21:29:37 +08:00
williamhliu
a82e3c8b1e (improvement)(chat-sdk) optimize card title (#1653) 2024-09-11 19:37:31 +08:00
williamhliu
91982a99eb (improvement)(chat-sdk) optimize tip and card title (#1652) 2024-09-11 19:17:27 +08:00
lexluo09
fb96ce5843 [improvement](chat) Use the word-based approach for comparing Schema Mapping rules and fix the issue where the results were not being modified. (#1650) 2024-09-10 23:21:12 +08:00
lexluo09
879696e493 [improvement](chat) Optimize the Schema Mapping rules (#1649) 2024-09-10 22:58:34 +08:00
lexluo09
183caf7931 [improvement](chat) Refactor the code for the Map phase (#1646) 2024-09-10 17:19:05 +08:00
daikon
ffc84dfc4c (improvement)(common) update OpenAiModelFactory default model (#1641) 2024-09-09 12:27:46 +08:00
lexluo09
5f59e89eea (improvement)(build) Add spotless during the build process. (#1639) 2024-09-07 00:36:17 +08:00
jerryjzhang
ee15a88b06 (improvement)(headless)Refactor the prompts for generating semantic aliases. 2024-09-06 17:55:33 +08:00
lexluo09
45777f0abc (improvement)(headless) Optimized the code for populating column information and resolved the issue with number type fields (#1633) 2024-09-05 17:44:37 +08:00