Commit Graph

426 Commits

Author SHA1 Message Date
jerryjzhang
0654a54c8d [improvement][headless-chat]Prompt the LLM to add a fixed prefix to all aliases created by the AS command. 2024-10-09 09:16:14 +08:00
jerryjzhang
0f2b0e7986 [improvement][launcher]Add some examples to demo agent. 2024-10-08 19:13:05 +08:00
jerryjzhang
aa32a2a640 [improvement][headless-chat]Rename methods of ChatQuery and ChatLayer service. 2024-10-08 17:48:28 +08:00
jerryjzhang
27e654a873 [improvement][headless-chat]Prompt LLM to generate with SQL statement to handle secondary calculation scenario.#1718 2024-10-08 17:39:10 +08:00
jerryjzhang
8bf5d395a7 [improvement][headless-chat]Demo queries only use rule-based parser. 2024-10-08 15:49:23 +08:00
lexluo09
71a9954be5 (improvement)[build] Use Spotless to customize the code formatting (#1750) 2024-10-04 00:05:04 +08:00
lexluo09
44d1cde34f [improvement][corrector] Abstract the RuleSqlCorrector component. (#1748) 2024-09-30 19:09:06 +08:00
jerryjzhang
bfdf9004ea [fix][launcher]Enable multi-turn conversation in S2VisitsDemo. 2024-09-29 14:31:59 +08:00
LXW
47df22d1a0 (improvement)(auth) When checking auth, only the models involved in the query are considered rather than the models included in the data set. #1625 (#1731)
Co-authored-by: lxwcodemonkey
2024-09-29 00:33:10 +08:00
lexluo09
3a11ccb6e9 (improvement)(headless) Optimize jsqlparser code and add support for complex queries like WITH in the corrector (#1730) 2024-09-28 23:26:39 +08:00
jerryjzhang
a50fe98f00 [improvement][headless-chat]Prioritize LLMSqlParser over RuleSqlParser. 2024-09-27 16:21:46 +08:00
jerryjzhang
ae3e9f142b [improvement][headless]Rename METRIC query type enum to AGGREGATE. 2024-09-27 15:19:26 +08:00
jerryjzhang
35030aeb23 [improvement][headless]Rename metric and tag query type to aggregate and detail respectively. 2024-09-26 20:29:51 +08:00
lexluo09
4ef5719953 (improvement)(chat) Including agg refers to the metric pattern, adding the missing dimensions for count distinct in the group by clause, and increasing the timeout duration in H2 (#1700) 2024-09-23 16:02:33 +08:00
jerryjzhang
cd08cf51c5 [improvement][project]Use DatePeriodEnum to replace DAY/MONTH/YEAR period constants. 2024-09-22 17:14:55 +08:00
jerryjzhang
b6765387f5 [improvement][headless]Introduce new time mode CURRENT. #1692 2024-09-21 13:14:47 +08:00
jerryjzhang
26ca5300f4 [improvement][launcher]Introduce ollama local models to Text2SQLEval. 2024-09-20 18:48:55 +08:00
jerryjzhang
6a8686f513 [improvement][launcher]Add duration counter in Text2SQLEval. 2024-09-20 17:24:00 +08:00
LXW
0c0fbb829e (improvement)(auth)Avoid printing error logs when key decryption and token parsing fail (#1681)
* (improvement)(auth) Avoid throwing exceptions after login token authentication fails #1679

(improvement)(common) Do not print error log when key decryption fails #1679


---------

Co-authored-by: lxwcodemonkey
2024-09-18 16:20:12 +08:00
jipeli
5f4d24348a [improvement][headless] fix queryData by dimension error (#1666) 2024-09-13 14:37:14 +08:00
jerryjzhang
e901ff8370 [improvement][launcher]Fix some test cases in Text2SQLEval. 2024-09-13 11:57:40 +08:00
lexluo09
faae692dff (fix)(headless) Fix the error that occurs when inserting in multiple cases of drill-down dimensions (#1665) 2024-09-13 11:47:28 +08:00
jerryjzhang
37f12391b0 [improvement][headless]Add databaseType into the Schema part of the Text2SQL prompt. #1621 2024-09-12 23:20:49 +08:00
lexluo09
4b1dab8e4a (improvement)(headless) Upgrade to the latest version of langchain4j and add support for embedding deletion operation and reset. (#1660) 2024-09-12 18:16:16 +08:00
jerryjzhang
693356e46a [improvement][headless]Add metricFormat field to metric metadata of the Text2SQL prompt. #1621 2024-09-12 18:13:44 +08:00
jerryjzhang
989ae3c128 [improvement][headless]Add partitionTime and primaryKey field into the Schema part of the Text2SQL prompt. #1621 2024-09-11 21:34:49 +08:00
lexluo09
5f59e89eea (improvement)(build) Add spotless during the build process. (#1639) 2024-09-07 00:36:17 +08:00
lexluo09
be9a8bbc27 (improvement)(chat) Remove the special field 'data date' to avoid generating non-existent time fields. (#1596) 2024-08-23 13:37:14 +08:00
lexluo09
10a5e485cb (improvement)(chat) Add unit tests for each chatModel and embeddingModel. (#1582) 2024-08-18 23:43:47 +08:00
LXW
95be7f3ce1 (improvement)(headless) Opt encrypt database password, avoid repeated decryption.(#1326) (#1562)
Co-authored-by: lxwcodemonkey
2024-08-13 10:10:52 +08:00
jerryjzhang
b13b38c645 (fix)(headless)Fix demo conversations with DETAIL query mode.
(fix)(headless)Fix demo conversations with DETAIL query mode.
2024-08-10 23:19:46 +08:00
jerryjzhang
ba9e6afa51 (improvement)(headless)Introduce DetailDimensionQuery as a type of rule-based parsing query. 2024-08-10 18:27:50 +08:00
jerryjzhang
ecc651e12d (improvement)(headless)Optimize Text2SQL prompt, explicitly ask LLM not hallucinate columns. 2024-08-09 19:27:38 +08:00
jerryjzhang
f06cd0b296 (improvement)(headless)Decrease the number of database queries to the s2_domain table. #1472 2024-08-08 20:59:31 +08:00
lexluo09
cdb67650c5 (improvement)(chat) The existing data uses partition_time for time, resolving the issue of models being unable to query. (#1536) 2024-08-08 15:31:53 +08:00
lexluo09
208686de46 (improvement)(chat) Rules, large models, and query dimension values support timelessness. (#1522) 2024-08-07 13:29:07 +08:00
lexluo09
3621766a0d (improvement)(chat) Support compatibility for handling historical primary and foreign data. (#1517) 2024-08-06 14:45:49 +08:00
lexluo09
0a4272c25e (improvement)(chat) Enable partition dates in the demo and support partition dates at the dataset granularity. (#1513) 2024-08-04 23:01:54 +08:00
lexluo09
a9232fa1c7 (improvement)(chat) Optimize and fix the NatureHelper code. (#1510)
Co-authored-by: lexluo <lexluo@tencent.com>
2024-08-03 23:52:52 +08:00
jerryjzhang
ac6b28ebb7 (improvement)(launcher)Add unit tests to the Text2SQLEval. 2024-08-02 18:08:54 +08:00
lexluo09
e26263d229 (improvement)(project) Fix the concurrency issue in unit tests. (#1506) 2024-08-02 13:41:22 +08:00
lexluo09
cabcbf16ff (improvement)(project) Fix the issue of occasional failure in the TagTest unit test. (#1500) 2024-08-01 20:05:54 +08:00
jerryjzhang
4a5bb9e457 (fix)(headless)Fix multi-turn conversation issue, recalling history ChatQuery instead of ChatParse. 2024-07-30 21:57:44 +08:00
LXW
26f682cc45 (improvement)(headless) Add semantic retrieval to term descriptions and extract relevant semantic information (#1468)
Co-authored-by: lxwcodemonkey
2024-07-29 09:15:18 +08:00
jerryjzhang
ccd79e4830 [improvement][headless]Optimize code structure and code style. 2024-07-28 10:06:16 +08:00
jerryjzhang
e5504473a4 [improvement][headless&chat]Move EntityInfoProcessor from chat to headless module and optimize code.
[improvement][headless&chat]Move `EntityInfoProcessor` from `chat` to `headless` module and optimize code.
2024-07-27 18:10:06 +08:00
jerryjzhang
f38a84bc8c (improvement)(headless)Reformat data semantics in the prompt. 2024-07-26 14:08:20 +08:00
jerryjzhang
cd8f38c334 (improvement)(headless)Move Values from sideInfo to schema part of the prompt and optimize prompt text. 2024-07-26 10:54:30 +08:00
lexluo09
ae34c15c95 (improvement)(chat) Improve vector recall performance. (#1458) 2024-07-25 22:19:35 +08:00
lexluo09
d64ed02df9 (improvement)(chat) Remove langchain4j configuration file and perform all configuration for the large model through the UI interface. (#1442) 2024-07-20 21:30:46 +08:00