545 Commits

Author	SHA1	Message	Date
jerryjzhang	d40400d2a4	[fix][chat]Memory enabled by the review task should be stored in embedding store.	2024-12-26 00:11:12 +08:00
lexluo09	72780f9acf	[improvement][common] The thread pool adopts a generic thread pool configuration. (#1966)	2024-12-21 19:01:53 +08:00
jerryjzhang	9f63aca132	[fix][chat]Fix minor logic issue.	2024-12-21 18:49:27 +08:00
jerryjzhang	94e97c9a1d	[improvement][chat]Use accept() pattern to improve code readability.	2024-12-19 09:47:38 +08:00
mislayming	07f6be51c7	SpringBoot3升级 (#1947)	2024-12-11 17:09:20 +08:00
mislayming	848b4a1e44	(fix)(chat-api) 小范围整理一下lombok标签，增加默认构造函数避免高版本json框架无法实例化报错 (#1951)	2024-12-10 19:14:32 +08:00
Jun Zhang	e55f43c737	[improvement]Use QueryWrapper in place of hard-coded SQLs (#1944) ... * [improvement][launcher]Use API to get element ID avoiding hard-code. * [fix][launcher]Fix mysql scripts. * [improvement][launcher]Support DuckDB database and refactor translator code structure. * [improvement][headless-fe] Revamped the interaction for semantic modeling routing and successfully implemented the switching between dimension and dataset management. * [improvement][Headless] Add table ddl in Dbschema * [improvement][Headless] Add get database by type * [improvement][Headless] Supports automatic batch creation of models based on db table names. * [improvement][Headless] Supports getting domain by bizName * [improvement][launcher]Refactor unit tests and demo data. * [fix][launcher]Change default vector dimension to 512. * [improvement](Dict) add dimValueAliasMap info for KnowledgeBaseService * [improvement][headless]Use QueryWrapper to replace hard-code SQL in mapper xml. * [improvement][chat]Introduce ChatMemory to delegate ChatMemoryDO. * [fix][common]Fix embedding store sys configs. * [fix][common]Fix postgres schema, using varchar instead of char. * [improvement][launcher]Change supersonic docker deployment from mysql to postgres. * [Fix][launcher]Fix a number of issues related to semantic modeling. * [Fix][headless]Fix the evaluation logic of agg type. * [fix][assembly]Fix Dockerfile and add docker compose run script. * [fix][chat]Fix "multiple assignments to same column "similar_queries". * [improvement][headless]Use LamdaQueryWrapper to avoid hard-coded column names. * [improvement][headless]Refactor headless infra to support advanced semantic modelling. * [improvement][headless]Change class name `Dim` to `Dimension`. * [improvement][chat]Introduce `TimeFieldMapper` to always map time field. * [fix][headless]Remove unnecessary dimension existence check. * [fix][chat]Fix adjusted filters don't take effect. ---------	2024-12-08 13:32:29 +08:00
Jun Zhang	0fc29304a8	[improvement][launcher]Refactor unit tests and demo data. (#1935)	2024-12-01 21:08:26 +08:00
Jun Zhang	cb183b7ac8	[improvement][Chat] Support agent permission management (#1923) ... * [improvement][Chat] Support agent permission management #1143 * [improvement][chat]Iterate LLM prompts of parsing and correction. * [improvement][headless-fe] Added null-check conditions to the data formatting function. * [improvement][headless]Clean code logic of headless translator. --------- Co-authored-by: lxwcodemonkey <jolunoluo@tencent.com> Co-authored-by: tristanliu <tristanliu@tencent.com>	2024-11-23 09:09:04 +08:00
解(xie)先生🌽	534da49309	(fix) 同环比计算为null时最新日期的数据被覆盖前端显示一直为0	2024-11-18 23:10:37 +08:00
解(xie)先生🌽	5a8c20a00b	(fix) (chat) 记忆管理更新不生效 (#1912)	2024-11-18 14:39:34 +08:00
jerryjzhang	ea6a9ebc5f	[improvement][launcher]Refactor built-in demos.	2024-11-10 21:29:49 +08:00
jerryjzhang	14a19a901f	[improvement][project]Simplify code logic in multiple modules.	2024-11-10 14:31:12 +08:00
Jun Zhang	e0e167fd40	[improvement][chat]Refactor code logic in rule-based parsing.	2024-11-09 15:49:08 +08:00
lexluo09	d4a9d5a7e6	[fix][chat] The terms in the descriptor of the term no longer undergo descriptor mapping (#1897)	2024-11-09 14:16:55 +08:00
Jun Zhang	c9c6dc4e44	Merge a number of fixes and improvements (#1896)	2024-11-09 00:23:02 +08:00
yudong	524ec38edc	[improvement][chat]记忆评估性能优化 (#1887)	2024-11-08 23:06:43 +08:00
xiao liang	9edcb9f91c	chat接口，匹配数据集逻辑错误，导致智能匹配第一个数据集 (#1884)	2024-11-04 17:10:41 +08:00
jerryjzhang	6f2af79756	[improvement][chat]Move processor related logic from headless to chat.	2024-11-04 16:27:26 +08:00
jerryjzhang	1e5bf7909e	[improvement][headless]Deprecate and remove entity-related abstraction and logic.#1876	2024-11-04 09:53:18 +08:00
jerryjzhang	7773c82eea	[improvement][chat]Iterate the prompt of data interpretation.	2024-10-31 21:48:40 +08:00
jerryjzhang	02f3bb8f5d	[feature][chat]Introduce separate field to return summary generated by DataInterpretProcessor.	2024-10-31 12:57:19 +08:00
jerryjzhang	621fefb4d4	[fix][chat]Fix NPE in parse info persistence.	2024-10-30 15:43:20 +08:00
jerryjzhang	4102082f2a	[improvement][chat]Make the total # of candidates to the user configurable.	2024-10-30 10:16:08 +08:00
jerryjzhang	29489b4669	[improvement][chat]Optimize format of parse text info.	2024-10-30 00:35:11 +08:00
jerryjzhang	53ddc67262	[improvement][chat]Sort parses in NL2SQLParser right after rule-based parsing.	2024-10-29 23:31:02 +08:00
jerryjzhang	847505b293	[fix][chat]Deprecate and remove ContextInheritParser.	2024-10-29 22:34:11 +08:00
lexluo09	d9cf874536	[improvement][chat] In STRICT mode, embedingMapper does not perform mapping (#1858)	2024-10-29 20:54:37 +08:00
jerryjzhang	cbb76550c7	[improvement][chat]Optimize NL2SQL parsing logic.	2024-10-29 20:33:32 +08:00
jerryjzhang	400b9f86f0	[improvement][chat]Modify core workflow of NL2SQLParser, always invoking rule-based parsers first.#1729	2024-10-29 13:12:56 +08:00
jerryjzhang	414aaaa0b6	[improvement][chat]Modify core workflow of NL2SQLParser, always invoking rule-based parsers first.#1729	2024-10-29 00:41:44 +08:00
lexluo09	5d9b1b917e	[improvement][chat] The parser interface supports using the dataSetId provided by the frontend as the reference (#1852)	2024-10-28 21:51:11 +08:00
jerryjzhang	e046a55567	[improvement][chat]Only return the parse info of the highest score for one dataset pass.#1847	2024-10-28 20:00:34 +08:00
jerryjzhang	b3d4440781	[improvement][chat]Support user feedback to multiple candidate semantic parses.#1847	2024-10-28 17:31:33 +08:00
jerryjzhang	5dda539798	[improvement][chat]Rename implementation classes of ResultProcessor.	2024-10-28 14:06:26 +08:00
jerryjzhang	14badcd4ae	[improvement][chat]Introduce separate ChatParseResp in Chat module.	2024-10-28 12:44:39 +08:00
jerryjzhang	eb28d832bc	[improvement][chat]Support user feedback to semantic parse info.#1729	2024-10-28 02:07:54 +08:00
jerryjzhang	b69ee81d58	[improvement][chat]Move generation of semantic text info and rewrite of error message to dedicated ResultProcessor.	2024-10-27 22:34:16 +08:00
jerryjzhang	3e0f724e97	[improvement][chat]Incorporate Response into Context objects.	2024-10-27 17:44:29 +08:00
jerryjzhang	1842261dfe	[improvement][project]Remove unnecessary copy from Request to Context objects.	2024-10-27 15:59:49 +08:00
jerryjzhang	397b527bc6	[improvement][project]Remove unnecessary SchemaMapInfo from ParseContext.	2024-10-27 15:16:42 +08:00
jerryjzhang	b20abdd75a	[feature][chat]Optimize the prompt of LLM-based DataInterpreter. #1828	2024-10-20 22:44:30 +08:00
lexluo09	473329d398	[improvement][chat] Filter at the lowest level in the Map based on the dataSetId (#1834)	2024-10-20 21:51:57 +08:00
LXW	1f208ffcb7	(improvement)(Common) Move ChatModel management to common modules and add chatApp for data-model builder (#1831) ... Co-authored-by: lxwcodemonkey	2024-10-20 18:42:08 +08:00
jerryjzhang	2b70140619	[feature][chat]Introduce LLM-based DataInterpreter. #1828	2024-10-20 15:23:39 +08:00
LXW	f196561d55	(improvement)(Chat)Optimize dimension recommendation logic and code structure #1706 (#1826) ... Co-authored-by: lxwcodemonkey	2024-10-19 22:01:03 +08:00
jerryjzhang	bb07fd77cf	[improvement][headless-chat]Optimize text2sql prompt.	2024-10-18 22:53:30 +08:00
jerryjzhang	5c8b9a0ee1	[improvement][project]Optimize log files and outputs.	2024-10-18 14:17:47 +08:00
feelshana	f9e0bae721	[fix][chat]Fix the issue of chatModelConfig is missing in the PlainTextExecutor(#1816) (#1819)	2024-10-17 20:11:24 +08:00
lexluo09	ee4b218a1e	[improvement][chat] Fix the issue of HDFS path concatenation (#1820)	2024-10-17 14:12:12 +08:00