Jun Zhang
593597fe26
Refactor translator module ( #1932 )
...
* [improvement][Chat] Support agent permission management #1143
* [improvement][chat]Iterate LLM prompts of parsing and correction.
* [improvement][headless]Clean code logic of headless core.
* (fix) (chat) 记忆管理更新不生效 (#1912 )
* [improvement][headless-fe] Added null-check conditions to the data formatting function.
* [improvement][headless]Clean code logic of headless translator.
* [improvement][headless-fe] Added permissions management for agents.
* [improvement][headless-fe] Unified the assistant's permission settings interaction to match the system style.
* [improvement](Dict)Support returns dict task list of dimensions by page
* [improvement][headless-fe] Revised the interaction for semantic modeling routing and implemented the initial version of metric management switching.
* [improvement][launcher]Set system property `s2.test` in junit tests in order to facilitate conditional breakpoints.
* [improvement][headless] add validateAndQuery interface in SqlQueryApiController
* [improvement][launcher]Use API to get element ID avoiding hard-code.
* [improvement][launcher]Support DuckDB database and refactor translator code structure.
---------
Co-authored-by: lxwcodemonkey <jolunoluo@tencent.com >
Co-authored-by: tristanliu <tristanliu@tencent.com >
Co-authored-by: daikon12 <1059907724@qq.com >
Co-authored-by: lexluo09 <39718951+lexluo09@users.noreply.github.com >
2024-11-30 00:27:33 +08:00
Jun Zhang
cb183b7ac8
[improvement][Chat] Support agent permission management ( #1923 )
...
* [improvement][Chat] Support agent permission management #1143
* [improvement][chat]Iterate LLM prompts of parsing and correction.
* [improvement][headless-fe] Added null-check conditions to the data formatting function.
* [improvement][headless]Clean code logic of headless translator.
---------
Co-authored-by: lxwcodemonkey <jolunoluo@tencent.com >
Co-authored-by: tristanliu <tristanliu@tencent.com >
2024-11-23 09:09:04 +08:00
jerryjzhang
14a19a901f
[improvement][project]Simplify code logic in multiple modules.
2024-11-10 14:31:12 +08:00
lexluo09
3b65b1c80b
[improvement][headless] Remove entities from the dictionary and search interface ( #1878 )
2024-11-04 10:06:10 +08:00
jerryjzhang
1e5bf7909e
[improvement][headless]Deprecate and remove entity-related abstraction and logic.#1876
2024-11-04 09:53:18 +08:00
lexluo09
a43e47e491
[improvement][headless] Determine if the SQL is supported by agg for more complex scenarios ( #1872 )
2024-11-01 10:37:26 +08:00
jipeli
0cb1faaf53
(improvement)(Headless) Fixed duplicate fields error ( #1870 )
2024-10-31 22:46:46 +08:00
lexluo09
cf359f3e2f
[improvement][chat] Optimize and modify the mapper method for terminology ( #1866 )
2024-10-31 11:18:35 +08:00
jipeli
858feb9c3c
(improvement)(Headless) define the measure without agg funciton by the model ( #1864 )
2024-10-30 22:13:13 +08:00
lexluo09
5c70607851
[improvement][common] Field replacement is performed using a recursive approach, and it supports field replacement with complex expressions ( #1859 )
2024-10-30 13:17:28 +08:00
jerryjzhang
53ddc67262
[improvement][chat]Sort parses in NL2SQLParser right after rule-based parsing.
2024-10-29 23:31:02 +08:00
jerryjzhang
996cb3df56
[improvement][chat]Change query type resolution logic.
2024-10-29 19:03:10 +08:00
jerryjzhang
400b9f86f0
[improvement][chat]Modify core workflow of NL2SQLParser, always invoking rule-based parsers first.#1729
2024-10-29 13:12:56 +08:00
lexluo09
5d9b1b917e
[improvement][chat] The parser interface supports using the dataSetId provided by the frontend as the reference ( #1852 )
2024-10-28 21:51:11 +08:00
lexluo09
de4384062c
[improvement][chat] The similarity of MapModeEnum.STRICT is 1 ( #1851 )
2024-10-28 19:58:13 +08:00
lexluo09
920c6e2846
[improvement][chat] Add threshold judgment to field replacement ( #1850 )
2024-10-28 13:57:35 +08:00
jerryjzhang
1842261dfe
[improvement][project]Remove unnecessary copy from Request to Context objects.
2024-10-27 15:59:49 +08:00
lexluo09
3a905d7fb1
[improvement][chat] Milvus supports setting the user and password parameters ( #1845 )
2024-10-24 22:59:35 +08:00
zhaodongsheng
0ddcdf93ec
(feat)Support for managing large models with Dify #1830;2、add user access token; #1829 ; 3、support change password #1824 ( #1839 )
2024-10-22 13:58:58 +08:00
lexluo09
473329d398
[improvement][chat] Filter at the lowest level in the Map based on the dataSetId ( #1834 )
2024-10-20 21:51:57 +08:00
LXW
1f208ffcb7
(improvement)(Common) Move ChatModel management to common modules and add chatApp for data-model builder ( #1831 )
...
Co-authored-by: lxwcodemonkey
2024-10-20 18:42:08 +08:00
lexluo09
3df4011f81
[improvement][chat] Add SqlReplaceFieldsTest test class ( #1811 )
2024-10-16 10:49:11 +08:00
lexluo09
fdbb588fab
[improvement][chat] Optimize the logic for field replacement and fix the replacement of 'GROUP BY' functions ( #1807 )
2024-10-15 19:41:23 +08:00
lexluo09
d7f301064a
[improvement][common] Fix the issue of missing 'ORDER BY' clause generation ( #1802 )
2024-10-15 10:22:22 +08:00
Zhengyang Jia
1ef642d0dd
[improvement][common]Add pgvector vector library adaptation. ( #1800 )
2024-10-15 09:16:32 +08:00
jerryjzhang
0b71390fde
[improvement][chat]Introduce AppModule to classify chat apps.
2024-10-14 14:21:41 +08:00
lexluo09
28b7847389
[improvement][headless] Support merging SQL queries with WITH using the LIMIT clause ( #1795 )
2024-10-13 21:37:34 +08:00
jerryjzhang
7c76c69ac0
[feature][headless-chat]Introduce ChatApp to support more flexible chat model config.#1739
2024-10-12 15:21:48 +08:00
jerryjzhang
3501f592e7
[feature][headless-chat]Introduce ChatApp to support more flexible chat model config.#1739
2024-10-12 13:04:06 +08:00
jerryjzhang
0cce0a76b4
[feature][headless-chat]Introduce ChatApp to support more flexible chat model config.#1739
2024-10-12 11:58:34 +08:00
jerryjzhang
2717a1603c
[feature][headless-chat]Introduce ChatApp to support more flexible chat model config.#1739
2024-10-12 11:51:37 +08:00
jipeli
b6e4577784
[improvement][headless] Fix interval time sql error( #1717 ) ( #1786 )
2024-10-11 18:53:49 +08:00
jipeli
50b0036d0f
[improvement][headless] Fix permission exception loss ( #1764 ) ( #1782 )
2024-10-11 12:00:41 +08:00
lexluo09
484861571f
[improvement][headless] Fix the issue with the query when using the with clause along with a join ( #1779 )
2024-10-10 21:53:29 +08:00
lexluo09
0299743c69
(improvement)[headless] Remove the as alias containing _ during the headless stage. ( #1767 )
2024-10-10 11:53:57 +08:00
lexluo09
1215efbdce
(improvement)[headless] Optimize table name replacement in complex SQL ( #1763 )
2024-10-09 23:14:18 +08:00
lexluo09
2c75a6972a
(improvement)[build] Format the enumeration class with line breaks ( #1761 )
2024-10-09 20:56:08 +08:00
jipeli
3cae4c1ea6
(improvement)(headless) not merge nested aggregations ( #1760 )
2024-10-09 20:18:59 +08:00
jerryjzhang
cd57d2344e
[fix][chat]Model provider is case sensitive.#1739
2024-10-09 17:48:42 +08:00
jerryjzhang
248f4f83f6
[feature][chat]Refactor chat model config related codes.#1739
2024-10-09 17:27:07 +08:00
jerryjzhang
9ffe67c962
[feature][chat]Add API to get ChatModelType list.#1739
2024-10-09 14:56:34 +08:00
lexluo09
fc040970b2
(improvement)[chat] Skip the corrector for complex SQL, and do not add the HAVING field to the SELECT clause ( #1754 )
2024-10-09 14:38:12 +08:00
jerryjzhang
7b9ff2e281
[feature][chat]Introduce dedicated LLM management.#1739
2024-10-09 12:00:24 +08:00
lexluo09
ff709aec60
(improvement)(headless) When retrieving all field names, consider alias fields. ( #1751 )
2024-10-05 13:24:16 +08:00
lexluo09
71a9954be5
(improvement)[build] Use Spotless to customize the code formatting ( #1750 )
2024-10-04 00:05:04 +08:00
lexluo09
44d1cde34f
[improvement][corrector] Abstract the RuleSqlCorrector component. ( #1748 )
2024-09-30 19:09:06 +08:00
lexluo09
8693e7f8a7
[improvement][headless] In the translator, adopt Calcite to support multiple WITH structures and optimize the Calcite code. ( #1747 )
2024-09-30 18:53:27 +08:00
lexluo09
5a163936a8
(improvement)(headless) Determine if there are any 'GROUP BY' fields that require compatibility with self-queries in WITH clauses. ( #1734 )
2024-09-29 11:28:31 +08:00
lexluo09
3a11ccb6e9
(improvement)(headless) Optimize jsqlparser code and add support for complex queries like WITH in the corrector ( #1730 )
2024-09-28 23:26:39 +08:00
jerryjzhang
764d3d24aa
[improvement][headless]Set default query limits of DataSet.
2024-09-27 16:07:25 +08:00
