Commit Graph

404 Commits

Author SHA1 Message Date
jerryjzhang
37f12391b0 [improvement][headless]Add databaseType into the Schema part of the Text2SQL prompt. #1621 2024-09-12 23:20:49 +08:00
lexluo09
4b1dab8e4a (improvement)(headless) Upgrade to the latest version of langchain4j and add support for embedding deletion operation and reset. (#1660) 2024-09-12 18:16:16 +08:00
jerryjzhang
693356e46a [improvement][headless]Add metricFormat field to metric metadata of the Text2SQL prompt. #1621 2024-09-12 18:13:44 +08:00
jerryjzhang
989ae3c128 [improvement][headless]Add partitionTime and primaryKey field into the Schema part of the Text2SQL prompt. #1621 2024-09-11 21:34:49 +08:00
lexluo09
5f59e89eea (improvement)(build) Add spotless during the build process. (#1639) 2024-09-07 00:36:17 +08:00
lexluo09
be9a8bbc27 (improvement)(chat) Remove the special field 'data date' to avoid generating non-existent time fields. (#1596) 2024-08-23 13:37:14 +08:00
lexluo09
10a5e485cb (improvement)(chat) Add unit tests for each chatModel and embeddingModel. (#1582) 2024-08-18 23:43:47 +08:00
LXW
95be7f3ce1 (improvement)(headless) Opt encrypt database password, avoid repeated decryption.(#1326) (#1562)
Co-authored-by: lxwcodemonkey
2024-08-13 10:10:52 +08:00
jerryjzhang
b13b38c645 (fix)(headless)Fix demo conversations with DETAIL query mode.
(fix)(headless)Fix demo conversations with DETAIL query mode.
2024-08-10 23:19:46 +08:00
jerryjzhang
ba9e6afa51 (improvement)(headless)Introduce DetailDimensionQuery as a type of rule-based parsing query. 2024-08-10 18:27:50 +08:00
jerryjzhang
ecc651e12d (improvement)(headless)Optimize Text2SQL prompt, explicitly ask LLM not hallucinate columns. 2024-08-09 19:27:38 +08:00
jerryjzhang
f06cd0b296 (improvement)(headless)Decrease the number of database queries to the s2_domain table. #1472 2024-08-08 20:59:31 +08:00
lexluo09
cdb67650c5 (improvement)(chat) The existing data uses partition_time for time, resolving the issue of models being unable to query. (#1536) 2024-08-08 15:31:53 +08:00
lexluo09
208686de46 (improvement)(chat) Rules, large models, and query dimension values support timelessness. (#1522) 2024-08-07 13:29:07 +08:00
lexluo09
3621766a0d (improvement)(chat) Support compatibility for handling historical primary and foreign data. (#1517) 2024-08-06 14:45:49 +08:00
lexluo09
0a4272c25e (improvement)(chat) Enable partition dates in the demo and support partition dates at the dataset granularity. (#1513) 2024-08-04 23:01:54 +08:00
lexluo09
a9232fa1c7 (improvement)(chat) Optimize and fix the NatureHelper code. (#1510)
Co-authored-by: lexluo <lexluo@tencent.com>
2024-08-03 23:52:52 +08:00
jerryjzhang
ac6b28ebb7 (improvement)(launcher)Add unit tests to the Text2SQLEval. 2024-08-02 18:08:54 +08:00
lexluo09
e26263d229 (improvement)(project) Fix the concurrency issue in unit tests. (#1506) 2024-08-02 13:41:22 +08:00
lexluo09
cabcbf16ff (improvement)(project) Fix the issue of occasional failure in the TagTest unit test. (#1500) 2024-08-01 20:05:54 +08:00
jerryjzhang
4a5bb9e457 (fix)(headless)Fix multi-turn conversation issue, recalling history ChatQuery instead of ChatParse. 2024-07-30 21:57:44 +08:00
LXW
26f682cc45 (improvement)(headless) Add semantic retrieval to term descriptions and extract relevant semantic information (#1468)
Co-authored-by: lxwcodemonkey
2024-07-29 09:15:18 +08:00
jerryjzhang
ccd79e4830 [improvement][headless]Optimize code structure and code style. 2024-07-28 10:06:16 +08:00
jerryjzhang
e5504473a4 [improvement][headless&chat]Move EntityInfoProcessor from chat to headless module and optimize code.
[improvement][headless&chat]Move `EntityInfoProcessor` from `chat` to `headless` module and optimize code.
2024-07-27 18:10:06 +08:00
jerryjzhang
f38a84bc8c (improvement)(headless)Reformat data semantics in the prompt. 2024-07-26 14:08:20 +08:00
jerryjzhang
cd8f38c334 (improvement)(headless)Move Values from sideInfo to schema part of the prompt and optimize prompt text. 2024-07-26 10:54:30 +08:00
lexluo09
ae34c15c95 (improvement)(chat) Improve vector recall performance. (#1458) 2024-07-25 22:19:35 +08:00
lexluo09
d64ed02df9 (improvement)(chat) Remove langchain4j configuration file and perform all configuration for the large model through the UI interface. (#1442) 2024-07-20 21:30:46 +08:00
HweiH
3797cc2ce8 [Enhancement] 升级底层 Spring Boot 版本至 2.7.2 (#1367) (#1435) 2024-07-20 14:38:46 +08:00
lexluo09
b5768b27aa (improvement)(test) Fix failing unit tests for CentOS and Ubuntu. (#1436) 2024-07-20 11:29:32 +08:00
sjwan
17f965eabd (fix)(launcher) fix mysql init script typo. (#1427)
Co-authored-by: wan2000 <wansj@samsundot.com>
2024-07-19 15:27:48 +08:00
jerryjzhang
2eac301076 (improvement)(headless)Introduce side_information to the prompt and exemplar. 2024-07-18 11:29:07 +08:00
jerryjzhang
ff38a6d250 (improvement)(headless)Restructure to remove web parent package. 2024-07-16 17:59:26 +08:00
jerryjzhang
782b768950 (improvement)(headless&chat)The Chat module only references facade service of the Headless module. 2024-07-16 17:53:01 +08:00
LXW
13ae312e51 (improvement)(headless) Update S2VisitsDemo (#1409)
Co-authored-by: lxwcodemonkey
2024-07-15 22:08:47 +08:00
lexluo09
4eb6193699 (improvement)(chat) Integrate llm configuration into system settings. (#1403) 2024-07-14 14:47:17 +08:00
LXW
407c8d4702 (improvement)(Headless) Refactor ChatLayerService and SemanticLayerService (#1404)
Co-authored-by: lxwcodemonkey
2024-07-14 11:23:47 +08:00
jerryjzhang
baff30550e (improvement)(headless&chat)Move ChatContext from Headless module to Chat module. 2024-07-12 19:50:12 +08:00
jerryjzhang
5bf4a4160d (fix)(chat&headless)Agent references ChatModelConfig instead of ModelConfig. 2024-07-12 14:15:54 +08:00
jerryjzhang
37da1ac2ae (improvement)(chat)Enable memory directly if the review result by LLM is positive. 2024-07-12 09:59:58 +08:00
jerryjzhang
d6c5702b5a (feature)(chat)Rewrite error message to make it more understandable to the user. #1320 2024-07-11 20:33:32 +08:00
jerryjzhang
e0647dd990 (improvement)(launcher)Opt schema-mysql sql declaration. 2024-07-11 11:00:25 +08:00
jerryjzhang
9bb95ca4be (feature)(chat)Add switch to enable LLM-based memory review, as it leads to more token costs. #1385 2024-07-10 21:08:02 +08:00
jerryjzhang
78a91ad8c2 (improvement)(headless)Modify text2sql prompts to remove dependency on datediff, thus avoiding SQL compatibility issues. #1391 2024-07-10 20:32:12 +08:00
LXW
03f5678732 (improvement)(script) update schema-mysql.sql and sql-update.sql (#1390)
Co-authored-by: lxwcodemonkey
2024-07-10 19:39:12 +08:00
jerryjzhang
f0b4eb46cf (improvement)(headless)Remove unnecessary TranslateSqlReq, use SemanticQueryReq instead. 2024-07-09 11:28:43 +08:00
LXW
9911e6772c (improvement)(auth) Make row permissions take effect during the translate sql phase and refactor the auth code (#1368)
Co-authored-by: lxwcodemonkey
2024-07-07 20:46:53 +08:00
jerryjzhang
64786cb0ef (improvement)(headless)Add explicit TRANSLATING stage and rename several classes by the way. 2024-07-07 09:30:32 +08:00
lexluo09
4d7bfe07aa (improvement)(chat) Support embedding store configuration. (#1363) 2024-07-07 00:30:19 +08:00
jerryjzhang
e0e77a3b64 (improvement)(headless&chat)Execute against SemanticLayerService instead of ChatQueryService in chat-server and rename several classes by the way. 2024-07-06 23:32:59 +08:00