Commit Graph

481 Commits

Author SHA1 Message Date
Jun Zhang
593597fe26 Refactor translator module (#1932)
* [improvement][Chat] Support agent permission management #1143

* [improvement][chat]Iterate LLM prompts of parsing and correction.

* [improvement][headless]Clean code logic of headless core.

* (fix) (chat) 记忆管理更新不生效 (#1912)

* [improvement][headless-fe] Added null-check conditions to the data formatting function.

* [improvement][headless]Clean code logic of headless translator.

* [improvement][headless-fe] Added permissions management for agents.

* [improvement][headless-fe] Unified the assistant's permission settings interaction to match the system style.

* [improvement](Dict)Support returns dict task list of dimensions by page

* [improvement][headless-fe] Revised the interaction for semantic modeling routing and implemented the initial version of metric management switching.

* [improvement][launcher]Set system property `s2.test` in junit tests in order to facilitate conditional breakpoints.

* [improvement][headless] add validateAndQuery interface in SqlQueryApiController

* [improvement][launcher]Use API to get element ID avoiding hard-code.

* [improvement][launcher]Support DuckDB database and refactor translator code structure.

---------

Co-authored-by: lxwcodemonkey <jolunoluo@tencent.com>
Co-authored-by: tristanliu <tristanliu@tencent.com>
Co-authored-by: daikon12 <1059907724@qq.com>
Co-authored-by: lexluo09 <39718951+lexluo09@users.noreply.github.com>
2024-11-30 00:27:33 +08:00
wangk
224c114d20 fix:重启服务后存在多个闲聊助手 (#1928) 2024-11-26 21:41:20 +08:00
Jun Zhang
cb183b7ac8 [improvement][Chat] Support agent permission management (#1923)
* [improvement][Chat] Support agent permission management #1143

* [improvement][chat]Iterate LLM prompts of parsing and correction.

* [improvement][headless-fe] Added null-check conditions to the data formatting function.

* [improvement][headless]Clean code logic of headless translator.

---------

Co-authored-by: lxwcodemonkey <jolunoluo@tencent.com>
Co-authored-by: tristanliu <tristanliu@tencent.com>
2024-11-23 09:09:04 +08:00
Jun Zhang
e8c9855163 [improvement][launcher]Clean code logic of s2demos and remove tag-related constructs. 2024-11-16 17:23:35 +08:00
Jun Zhang
ba1938f04b Merge fixes and improvements (#1910)
Co-authored-by: tristanliu <tristanliu@tencent.com>
2024-11-16 13:57:54 +08:00
LXW
87729956e8 (improvement)(Headless) Refactor the SemanticModeller to rule first and then llm, and automatically infer field types in the rule method. (#1900)
Co-authored-by: lxwcodemonkey
2024-11-11 00:10:58 +08:00
jerryjzhang
ea6a9ebc5f [improvement][launcher]Refactor built-in demos. 2024-11-10 21:29:49 +08:00
jerryjzhang
14a19a901f [improvement][project]Simplify code logic in multiple modules. 2024-11-10 14:31:12 +08:00
Jun Zhang
e0e167fd40 [improvement][chat]Refactor code logic in rule-based parsing. 2024-11-09 15:49:08 +08:00
Jun Zhang
c9c6dc4e44 Merge a number of fixes and improvements (#1896) 2024-11-09 00:23:02 +08:00
jerryjzhang
6f2af79756 [improvement][chat]Move processor related logic from headless to chat. 2024-11-04 16:27:26 +08:00
jerryjzhang
1e5bf7909e [improvement][headless]Deprecate and remove entity-related abstraction and logic.#1876 2024-11-04 09:53:18 +08:00
lexluo09
cf359f3e2f [improvement][chat] Optimize and modify the mapper method for terminology (#1866) 2024-10-31 11:18:35 +08:00
LXW
838745d415 (improvement)(Headless) Implement SemanticModeller through SPI (#1865)
Co-authored-by: lxwcodemonkey
2024-10-30 23:32:38 +08:00
jerryjzhang
fa75a13888 [fix][chat]Fix Text2SQL case, making it more robust. 2024-10-30 22:38:49 +08:00
LXW
68d5dac14c (improvement)(Headless) Remove unnecessary code (#1863)
Co-authored-by: lxwcodemonkey
2024-10-30 21:56:32 +08:00
jerryjzhang
53ddc67262 [improvement][chat]Sort parses in NL2SQLParser right after rule-based parsing. 2024-10-29 23:31:02 +08:00
jerryjzhang
cbb76550c7 [improvement][chat]Optimize NL2SQL parsing logic. 2024-10-29 20:33:32 +08:00
LXW
ec6d7ba93d (improvement)(Headless) Support setting fields as foreign keys when creating data-model (#1857)
Co-authored-by: lxwcodemonkey
2024-10-29 18:42:31 +08:00
jerryjzhang
826354cdf1 [improvement][launcher]Add DictConf for dimensions in S2VisitsDemo. 2024-10-29 14:38:58 +08:00
jerryjzhang
400b9f86f0 [improvement][chat]Modify core workflow of NL2SQLParser, always invoking rule-based parsers first.#1729 2024-10-29 13:12:56 +08:00
jerryjzhang
b3d4440781 [improvement][chat]Support user feedback to multiple candidate semantic parses.#1847 2024-10-28 17:31:33 +08:00
jerryjzhang
5dda539798 [improvement][chat]Rename implementation classes of ResultProcessor. 2024-10-28 14:06:26 +08:00
jerryjzhang
14badcd4ae [improvement][chat]Introduce separate ChatParseResp in Chat module. 2024-10-28 12:44:39 +08:00
LXW
c2785139f2 (improvement)(Headless) Add exemplars for building data-model by LLM #1319 (#1849)
Co-authored-by: lxwcodemonkey
2024-10-27 23:17:33 +08:00
jerryjzhang
b69ee81d58 [improvement][chat]Move generation of semantic text info and rewrite of error message to dedicated ResultProcessor. 2024-10-27 22:34:16 +08:00
jerryjzhang
bb363a0286 [improvement][headless-chat]Incorporate Request into Context objects, removing unnecessary copy. 2024-10-27 18:47:34 +08:00
LXW
bd82b0904b (improvement)(Headless) Add integration testing for building data-model by LLM (#1848)
Co-authored-by: lxwcodemonkey
2024-10-27 18:16:59 +08:00
zhaodongsheng
0ddcdf93ec (feat)Support for managing large models with Dify #1830;2、add user access token; #1829; 3、support change password #1824 (#1839) 2024-10-22 13:58:58 +08:00
lexluo09
473329d398 [improvement][chat] Filter at the lowest level in the Map based on the dataSetId (#1834) 2024-10-20 21:51:57 +08:00
LXW
1f208ffcb7 (improvement)(Common) Move ChatModel management to common modules and add chatApp for data-model builder (#1831)
Co-authored-by: lxwcodemonkey
2024-10-20 18:42:08 +08:00
jerryjzhang
2b70140619 [feature][chat]Introduce LLM-based DataInterpreter. #1828 2024-10-20 15:23:39 +08:00
lexluo09
2250289c94 (fix)(chat) Fix the issue of mapping in the map (#1825) 2024-10-19 13:22:39 +08:00
jerryjzhang
5c8b9a0ee1 [improvement][project]Optimize log files and outputs. 2024-10-18 14:17:47 +08:00
jerryjzhang
d064393253 [fix][chat]Fix NPE problem. 2024-10-16 13:08:22 +08:00
jerryjzhang
2901460845 [feature][chat]Add deleteQuery API to support try-again feature.#1808 2024-10-15 20:14:59 +08:00
jerryjzhang
0b71390fde [improvement][chat]Introduce AppModule to classify chat apps. 2024-10-14 14:21:41 +08:00
jerryjzhang
6d993b4785 [improvement][project]Remove unused classes and update README. 2024-10-12 21:24:12 +08:00
jerryjzhang
a7fe900394 [fix][launcher]Config chat apps for S2ArtistDemo 2024-10-12 20:38:57 +08:00
lexluo09
83cf171ec5 [improvement][chat] Fix the display of aliases or synonyms for terms (#1793) 2024-10-12 20:26:24 +08:00
lexluo09
396c8c52e9 [feature][project] Enable authentication support for Swagger (#1791) 2024-10-12 16:50:51 +08:00
jerryjzhang
612f046c0d [feature][chat]Add switch to allow human involvement.#1729 2024-10-12 16:39:13 +08:00
jerryjzhang
3501f592e7 [feature][headless-chat]Introduce ChatApp to support more flexible chat model config.#1739 2024-10-12 13:04:06 +08:00
jerryjzhang
2717a1603c [feature][headless-chat]Introduce ChatApp to support more flexible chat model config.#1739 2024-10-12 11:51:37 +08:00
lexluo09
0fe7f0e1a7 [improvement][headless] Fix the null pointer issue when handling execution permissions and retrieving recommended metrics (#1780) 2024-10-10 23:22:48 +08:00
daikon
30e85355b9 update system default dimension value (#1774) 2024-10-10 20:24:08 +08:00
jerryjzhang
c47b8b37b9 [fix][launcher]Fix Text2SQLEval. 2024-10-10 16:53:41 +08:00
jerryjzhang
e56b513758 [improvement][launcher]Support environment variable LLM configs in DEMO. 2024-10-10 15:08:48 +08:00
Jun Zhang
85552fb73a [improvement][chat]Merge RuleTool and LLMTool.#1766 (#1768) 2024-10-10 14:53:54 +08:00
lexluo09
2c75a6972a (improvement)[build] Format the enumeration class with line breaks (#1761) 2024-10-09 20:56:08 +08:00