Commit Graph

551 Commits

Author SHA1 Message Date
LXW
47df22d1a0 (improvement)(auth) When checking auth, only the models involved in the query are considered rather than the models included in the data set. #1625 (#1731)
Co-authored-by: lxwcodemonkey
2024-09-29 00:33:10 +08:00
lexluo09
3a11ccb6e9 (improvement)(headless) Optimize jsqlparser code and add support for complex queries like WITH in the corrector (#1730) 2024-09-28 23:26:39 +08:00
jerryjzhang
a50fe98f00 [improvement][headless-chat]Prioritize LLMSqlParser over RuleSqlParser. 2024-09-27 16:21:46 +08:00
jerryjzhang
ae3e9f142b [improvement][headless]Rename METRIC query type enum to AGGREGATE. 2024-09-27 15:19:26 +08:00
jerryjzhang
35030aeb23 [improvement][headless]Rename metric and tag query type to aggregate and detail respectively. 2024-09-26 20:29:51 +08:00
lexluo09
4ef5719953 (improvement)(chat) Including agg refers to the metric pattern, adding the missing dimensions for count distinct in the group by clause, and increasing the timeout duration in H2 (#1700) 2024-09-23 16:02:33 +08:00
jerryjzhang
cd08cf51c5 [improvement][project]Use DatePeriodEnum to replace DAY/MONTH/YEAR period constants. 2024-09-22 17:14:55 +08:00
jerryjzhang
b6765387f5 [improvement][headless]Introduce new time mode CURRENT. #1692 2024-09-21 13:14:47 +08:00
jerryjzhang
26ca5300f4 [improvement][launcher]Introduce ollama local models to Text2SQLEval. 2024-09-20 18:48:55 +08:00
jerryjzhang
6a8686f513 [improvement][launcher]Add duration counter in Text2SQLEval. 2024-09-20 17:24:00 +08:00
jipeli
5f4d24348a [improvement][headless] fix queryData by dimension error (#1666) 2024-09-13 14:37:14 +08:00
jerryjzhang
e901ff8370 [improvement][launcher]Fix some test cases in Text2SQLEval. 2024-09-13 11:57:40 +08:00
lexluo09
faae692dff (fix)(headless) Fix the error that occurs when inserting in multiple cases of drill-down dimensions (#1665) 2024-09-13 11:47:28 +08:00
jerryjzhang
37f12391b0 [improvement][headless]Add databaseType into the Schema part of the Text2SQL prompt. #1621 2024-09-12 23:20:49 +08:00
lexluo09
4b1dab8e4a (improvement)(headless) Upgrade to the latest version of langchain4j and add support for embedding deletion operation and reset. (#1660) 2024-09-12 18:16:16 +08:00
jerryjzhang
693356e46a [improvement][headless]Add metricFormat field to metric metadata of the Text2SQL prompt. #1621 2024-09-12 18:13:44 +08:00
jerryjzhang
989ae3c128 [improvement][headless]Add partitionTime and primaryKey field into the Schema part of the Text2SQL prompt. #1621 2024-09-11 21:34:49 +08:00
lexluo09
5f59e89eea (improvement)(build) Add spotless during the build process. (#1639) 2024-09-07 00:36:17 +08:00
lexluo09
be9a8bbc27 (improvement)(chat) Remove the special field 'data date' to avoid generating non-existent time fields. (#1596) 2024-08-23 13:37:14 +08:00
lexluo09
10a5e485cb (improvement)(chat) Add unit tests for each chatModel and embeddingModel. (#1582) 2024-08-18 23:43:47 +08:00
LXW
95be7f3ce1 (improvement)(headless) Opt encrypt database password, avoid repeated decryption.(#1326) (#1562)
Co-authored-by: lxwcodemonkey
2024-08-13 10:10:52 +08:00
jerryjzhang
b13b38c645 (fix)(headless)Fix demo conversations with DETAIL query mode.
(fix)(headless)Fix demo conversations with DETAIL query mode.
2024-08-10 23:19:46 +08:00
jerryjzhang
ba9e6afa51 (improvement)(headless)Introduce DetailDimensionQuery as a type of rule-based parsing query. 2024-08-10 18:27:50 +08:00
jerryjzhang
ecc651e12d (improvement)(headless)Optimize Text2SQL prompt, explicitly ask LLM not hallucinate columns. 2024-08-09 19:27:38 +08:00
jerryjzhang
f06cd0b296 (improvement)(headless)Decrease the number of database queries to the s2_domain table. #1472 2024-08-08 20:59:31 +08:00
lexluo09
cdb67650c5 (improvement)(chat) The existing data uses partition_time for time, resolving the issue of models being unable to query. (#1536) 2024-08-08 15:31:53 +08:00
lexluo09
208686de46 (improvement)(chat) Rules, large models, and query dimension values support timelessness. (#1522) 2024-08-07 13:29:07 +08:00
lexluo09
3621766a0d (improvement)(chat) Support compatibility for handling historical primary and foreign data. (#1517) 2024-08-06 14:45:49 +08:00
lexluo09
0a4272c25e (improvement)(chat) Enable partition dates in the demo and support partition dates at the dataset granularity. (#1513) 2024-08-04 23:01:54 +08:00
lexluo09
a9232fa1c7 (improvement)(chat) Optimize and fix the NatureHelper code. (#1510)
Co-authored-by: lexluo <lexluo@tencent.com>
2024-08-03 23:52:52 +08:00
jerryjzhang
ac6b28ebb7 (improvement)(launcher)Add unit tests to the Text2SQLEval. 2024-08-02 18:08:54 +08:00
lexluo09
e26263d229 (improvement)(project) Fix the concurrency issue in unit tests. (#1506) 2024-08-02 13:41:22 +08:00
lexluo09
cabcbf16ff (improvement)(project) Fix the issue of occasional failure in the TagTest unit test. (#1500) 2024-08-01 20:05:54 +08:00
jerryjzhang
4a5bb9e457 (fix)(headless)Fix multi-turn conversation issue, recalling history ChatQuery instead of ChatParse. 2024-07-30 21:57:44 +08:00
LXW
26f682cc45 (improvement)(headless) Add semantic retrieval to term descriptions and extract relevant semantic information (#1468)
Co-authored-by: lxwcodemonkey
2024-07-29 09:15:18 +08:00
jerryjzhang
ccd79e4830 [improvement][headless]Optimize code structure and code style. 2024-07-28 10:06:16 +08:00
jerryjzhang
e5504473a4 [improvement][headless&chat]Move EntityInfoProcessor from chat to headless module and optimize code.
[improvement][headless&chat]Move `EntityInfoProcessor` from `chat` to `headless` module and optimize code.
2024-07-27 18:10:06 +08:00
jerryjzhang
f38a84bc8c (improvement)(headless)Reformat data semantics in the prompt. 2024-07-26 14:08:20 +08:00
jerryjzhang
cd8f38c334 (improvement)(headless)Move Values from sideInfo to schema part of the prompt and optimize prompt text. 2024-07-26 10:54:30 +08:00
lexluo09
ae34c15c95 (improvement)(chat) Improve vector recall performance. (#1458) 2024-07-25 22:19:35 +08:00
lexluo09
d64ed02df9 (improvement)(chat) Remove langchain4j configuration file and perform all configuration for the large model through the UI interface. (#1442) 2024-07-20 21:30:46 +08:00
HweiH
3797cc2ce8 [Enhancement] 升级底层 Spring Boot 版本至 2.7.2 (#1367) (#1435) 2024-07-20 14:38:46 +08:00
lexluo09
b5768b27aa (improvement)(test) Fix failing unit tests for CentOS and Ubuntu. (#1436) 2024-07-20 11:29:32 +08:00
sjwan
17f965eabd (fix)(launcher) fix mysql init script typo. (#1427)
Co-authored-by: wan2000 <wansj@samsundot.com>
2024-07-19 15:27:48 +08:00
jerryjzhang
2eac301076 (improvement)(headless)Introduce side_information to the prompt and exemplar. 2024-07-18 11:29:07 +08:00
jerryjzhang
ff38a6d250 (improvement)(headless)Restructure to remove web parent package. 2024-07-16 17:59:26 +08:00
jerryjzhang
782b768950 (improvement)(headless&chat)The Chat module only references facade service of the Headless module. 2024-07-16 17:53:01 +08:00
LXW
13ae312e51 (improvement)(headless) Update S2VisitsDemo (#1409)
Co-authored-by: lxwcodemonkey
2024-07-15 22:08:47 +08:00
lexluo09
4eb6193699 (improvement)(chat) Integrate llm configuration into system settings. (#1403) 2024-07-14 14:47:17 +08:00
LXW
407c8d4702 (improvement)(Headless) Refactor ChatLayerService and SemanticLayerService (#1404)
Co-authored-by: lxwcodemonkey
2024-07-14 11:23:47 +08:00