Commit Graph

219 Commits

Author SHA1 Message Date
jerryjzhang
ba9e6afa51 (improvement)(headless)Introduce DetailDimensionQuery as a type of rule-based parsing query. 2024-08-10 18:27:50 +08:00
jerryjzhang
ecc651e12d (improvement)(headless)Optimize Text2SQL prompt, explicitly ask LLM not hallucinate columns. 2024-08-09 19:27:38 +08:00
lexluo09
9dbc8657e2 (improvement)(chat) When making corrections, the 'group by' field must not be included in the function. (#1532) 2024-08-07 23:08:43 +08:00
lexluo09
208686de46 (improvement)(chat) Rules, large models, and query dimension values support timelessness. (#1522) 2024-08-07 13:29:07 +08:00
yudong
89b028b594 [fix][headless]指定不限制数据集查询范围时时Detail类型也不再额外增加限制 (#1514) 2024-08-06 14:06:40 +08:00
lexluo09
0a4272c25e (improvement)(chat) Enable partition dates in the demo and support partition dates at the dataset granularity. (#1513) 2024-08-04 23:01:54 +08:00
lexluo09
e2e45a40ab (improvement)(chat) Decide whether to add or remove dates based on whether the dataset has partition dates. (#1512) 2024-08-04 17:39:23 +08:00
lexluo09
a9232fa1c7 (improvement)(chat) Optimize and fix the NatureHelper code. (#1510)
Co-authored-by: lexluo <lexluo@tencent.com>
2024-08-03 23:52:52 +08:00
yudong
53a9f7c451 [improvement][headless&chat]当LLM生成SQL包含日期类型字段时,Correcter不再额外增加日期 (#1473) 2024-08-02 14:14:29 +08:00
ylhh353
5a18ad5229 [improvement][headless-chat] improvement sql generation ``` (#1498) (#1499) 2024-08-01 20:04:11 +08:00
jerryjzhang
23af977972 (fix)(headless)Fix default date calculation. #1471 2024-07-30 09:54:58 +08:00
LXW
9a14728152 (fix)(headless) Fix queryText replaced when semantic retrieval to term descriptions (#1469)
Co-authored-by: lxwcodemonkey
2024-07-29 10:18:58 +08:00
LXW
26f682cc45 (improvement)(headless) Add semantic retrieval to term descriptions and extract relevant semantic information (#1468)
Co-authored-by: lxwcodemonkey
2024-07-29 09:15:18 +08:00
jerryjzhang
ccd79e4830 [improvement][headless]Optimize code structure and code style. 2024-07-28 10:06:16 +08:00
jerryjzhang
e5504473a4 [improvement][headless&chat]Move EntityInfoProcessor from chat to headless module and optimize code.
[improvement][headless&chat]Move `EntityInfoProcessor` from `chat` to `headless` module and optimize code.
2024-07-27 18:10:06 +08:00
JackLiang
8f620480c6 fix:加载模型到内存时内存泄露bug (#1465)
* fix existSegment bug which embedding search not has min-score,so that it will return true.
2024-07-26 18:07:49 +08:00
jerryjzhang
f38a84bc8c (improvement)(headless)Reformat data semantics in the prompt. 2024-07-26 14:08:20 +08:00
jerryjzhang
cd8f38c334 (improvement)(headless)Move Values from sideInfo to schema part of the prompt and optimize prompt text. 2024-07-26 10:54:30 +08:00
lexluo09
ae34c15c95 (improvement)(chat) Improve vector recall performance. (#1458) 2024-07-25 22:19:35 +08:00
jerryjzhang
c39460ee02 (improvement)(headless)Add alias of metrics & dimensions to the schema part of the prompts. 2024-07-24 20:20:11 +08:00
jerryjzhang
2425067091 (improvement)(common)Rename SqlExemplar to Text2SQLExemplar. 2024-07-18 14:19:56 +08:00
jerryjzhang
2eac301076 (improvement)(headless)Introduce side_information to the prompt and exemplar. 2024-07-18 11:29:07 +08:00
lexluo09
4eb6193699 (improvement)(chat) Integrate llm configuration into system settings. (#1403) 2024-07-14 14:47:17 +08:00
LXW
407c8d4702 (improvement)(Headless) Refactor ChatLayerService and SemanticLayerService (#1404)
Co-authored-by: lxwcodemonkey
2024-07-14 11:23:47 +08:00
jerryjzhang
baff30550e (improvement)(headless&chat)Move ChatContext from Headless module to Chat module. 2024-07-12 19:50:12 +08:00
jerryjzhang
e365a36749 (improvement)(headless)Remove mapper related configs from system configuration UI. 2024-07-12 15:16:01 +08:00
jerryjzhang
5bf4a4160d (fix)(chat&headless)Agent references ChatModelConfig instead of ModelConfig. 2024-07-12 14:15:54 +08:00
jerryjzhang
37da1ac2ae (improvement)(chat)Enable memory directly if the review result by LLM is positive. 2024-07-12 09:59:58 +08:00
jerryjzhang
41ad1ada6c (fix)(headless)Fix checkstyle issues following #1395. 2024-07-11 20:49:25 +08:00
21Janur
f9d6ea11c5 (improvement)(headless)Improve dataset time query judgment (#1395)
(improvement)(headless)Improve dataset time query judgment
The official document describes that if you do not want to add a time limit, please set the time to -1, but it has not taken effect. During LLM parsing, the parameters passed to the model still default to the date parameter. Now change to include the date parameter only when [unit!=-1 '] is checked in the dataset query settings
2024-07-11 20:44:05 +08:00
jerryjzhang
78a91ad8c2 (improvement)(headless)Modify text2sql prompts to remove dependency on datediff, thus avoiding SQL compatibility issues. #1391 2024-07-10 20:32:12 +08:00
jerryjzhang
f0b4eb46cf (improvement)(headless)Remove unnecessary TranslateSqlReq, use SemanticQueryReq instead. 2024-07-09 11:28:43 +08:00
jerryjzhang
efd617b2e5 (improvement)(headless)Rename QueryTextReq to QueryNLReq to explicitly reflect natural language concept. 2024-07-08 10:20:20 +08:00
jerryjzhang
64786cb0ef (improvement)(headless)Add explicit TRANSLATING stage and rename several classes by the way. 2024-07-07 09:30:32 +08:00
lexluo09
4d7bfe07aa (improvement)(chat) Support embedding store configuration. (#1363) 2024-07-07 00:30:19 +08:00
jerryjzhang
e0e77a3b64 (improvement)(headless&chat)Execute against SemanticLayerService instead of ChatQueryService in chat-server and rename several classes by the way. 2024-07-06 23:32:59 +08:00
lexluo09
6db6aaf98d (improvement)(chat) Support configuring embeddingModel or embeddingStore at the agent level. (#1361) 2024-07-06 20:44:23 +08:00
jerryjzhang
72465cd88c # This is a combination of 2 commits.
(feature)(headless)Support custom prompt template. #1348.
2024-07-05 15:30:52 +08:00
lexluo09
097f2f4fe7 (improvement)(chat) Support additional operators in QueryFilter correction. (#1347) 2024-07-05 13:20:40 +08:00
jerryjzhang
14b9086d83 (improvement)(headless)Remove LLMProxy abstraction as not needed any more. 2024-07-05 10:24:09 +08:00
jerryjzhang
bb4cd880b0 (improvement)(headless)Normalize space SQL strings in the log messages. 2024-07-04 20:09:24 +08:00
jerryjzhang
38b4154b9e (improvement)(headless)Opt logging messages to make it cleaner. 2024-06-30 13:16:39 +08:00
jerryjzhang
1d0b288922 (improvement)(headless)Adapt s2_exemplar file to new version of prompting strategy. 2024-06-30 11:25:52 +08:00
lexluo09
528491717b (improvement)(headless) Add support for the Ollama provider in the frontend and optimize the code (#1270) 2024-06-28 17:29:58 +08:00
lexluo09
a3d4f18df4 (improvement)(project) Remove Python module and related Python code. (#1263) 2024-06-28 12:01:13 +08:00
lexluo09
28f95ddf9e (improvement)(test) Fix NullPointerException in SelectCorrectorTest unit test (#1260) 2024-06-27 23:02:59 +08:00
LXW
995c4f8ada (fix)(Chat) Fix dimension value query failed (#1257)
Co-authored-by: lxwcodemonkey
2024-06-27 22:27:09 +08:00
jipeli
4e4943ffd1 (improvement)(chat) fixed HanLP multiple uppercase(#963) (#1254) 2024-06-27 18:56:34 +08:00
lexluo09
bbd61ac937 (improvement)(config) Split the application-local.yml file based on functionality. (#1250) 2024-06-27 16:56:16 +08:00
jerryjzhang
8b88528938 (improvement)(common)Opt package structure 2024-06-27 15:39:52 +08:00