232 Commits

Author	SHA1	Message	Date
zyclove	5e3bafb953	feat:Support kyuubi presto trino (#2109)	2025-02-26 17:33:14 +08:00
mislayming	f9198cb8e0	(improvement)(chat) Enhancing the capability of embedding with LLM-based secondary judgment. (#2096)	2025-02-24 12:55:39 +08:00
jerryjzhang	94e853f57e	[improvement][headless]Support dataSetNames that contain dash. ... [improvement][headless]Support dataSetNames that contain dash. [improvement][headless]Support dataSetNames that contain dash.	2025-02-21 01:25:02 +08:00
jerryjzhang	335e1f9ada	(fix)(headless)Fix updating measure agg doesn't take effect.	2025-02-19 18:11:02 +08:00
weimengdalao	9aa305ca7a	[fix][headless]fix Check if metricFilters is empty not dimensionFilters (#2064)	2025-02-18 12:49:43 +08:00
jerryjzhang	32793ecf69	(improvement)(chat)Determine if with statement is supported and send explicitly message in the prompt to the LLM.	2025-02-17 21:21:43 +08:00
jerryjzhang	eef7b3c443	[improvement][chat]Make a few code restructure.	2025-02-08 14:39:23 +08:00
jerryjzhang	be2e380b4c	[fix][headless]Fix published metrics issue.	2025-02-07 15:35:30 +08:00
jerryjzhang	fd306db3fe	[fix][chat]Fix compatibility issue.	2025-02-07 09:52:03 +08:00
jerryjzhang	cc66ebd684	[improvement][chat]Add queryId to QueryNLReq.	2025-02-05 17:24:48 +08:00
Jun Zhang	0417f12324	[fix][headless]Fix schema corrector test cases. (#2027)	2025-02-02 15:52:23 +08:00
Jun Zhang	d294fec2a0	[fix](headless)Fix a number of issues. (#2026)	2025-02-02 12:50:29 +08:00
Jun Zhang	de92b357df	(Fix)(headless)Fix expression replacement issue. (#2024)	2025-01-30 08:54:42 +08:00
jerryjzhang	2b28aeea6f	[fix][headless]Fix a set of known issues.	2025-01-14 20:31:59 +08:00
jerryjzhang	329756056c	[improvement][headless]Opt code format.	2025-01-11 09:25:27 +08:00
jerryjzhang	cd863705a4	[improvement][chat]Opt log infos.	2025-01-08 20:46:44 +08:00
jerryjzhang	6fcfdc15e1	[improvement][headless]Remove deprecated tag related constructs.	2025-01-05 15:42:54 +08:00
jerryjzhang	4738b9d01b	[improvement][headless]Release brand new version of Translator module.	2025-01-05 00:00:18 +08:00
Jun Zhang	be59b051fc	[fix][headless]Fix logic bug in s2sql parsing. (#1996)	2025-01-04 14:58:48 +08:00
jerryjzhang	22f6190e7c	[improvement][chat]Introduce parameter to control # of semantic fields should be sent to the LLM.	2025-01-03 22:44:12 +08:00
jerryjzhang	6486257c9e	[improvement][chat&headless]Remove deprecated system time fields.	2024-12-29 03:22:42 +08:00
jerryjzhang	0612833618	[fix][chat]Fix logic in s2sql parsing.	2024-12-27 14:18:20 +08:00
jerryjzhang	7145f27671	[fix][chat]Fix logic in s2sql parsing.	2024-12-27 14:12:10 +08:00
lexluo09	a23d1071a3	[improvement][chat] Optimize the logic for obtaining the generic thread pool (#1979)	2024-12-26 23:37:55 +08:00
jerryjzhang	d834e98a66	[improvement][chat]Introduce AllFieldMapper to increase parsing robustness when normal pipeline fails.	2024-12-26 23:28:59 +08:00
jerryjzhang	94267f6028	[improvement][chat]Introduce AllFieldMapper to increase parsing robustness when normal pipeline fails. ... [improvement][chat]Introduce `AllFieldMapper` to increase parsing robustness when normal pipeline fails.	2024-12-26 23:20:43 +08:00
jerryjzhang	68963b9ec9	[improvement][project]Adjust files based on code style.	2024-12-26 09:12:12 +08:00
lexluo09	c483bb891a	[fix][chat] Fix the issue with the order of parallel execution in the map. (#1976)	2024-12-25 20:52:52 +08:00
lexluo09	8c6ae62522	[improvement][chat] Change the embedding to execute in parallel (#1967)	2024-12-21 20:32:03 +08:00
jerryjzhang	933b54085c	[fix][chat]Fix minor logic issue.	2024-12-21 18:49:07 +08:00
lexluo09	f7fce0217f	[improvement][chat] Use a generic thread pool to perform concurrent mapping. (#1965)	2024-12-21 11:58:02 +08:00
jerryjzhang	4cb2256351	[improvement][headless]Merge function of QueryConverter abstraction to QueryParser.	2024-12-19 21:45:24 +08:00
lexluo09	8b69d57c4b	[improvement][chat] Fix the issue with the DatabaseMatchStrategy variable under multi-threading (#1963)	2024-12-19 10:04:17 +08:00
jerryjzhang	91856ddebd	[improvement][chat]Inject schema info into the prompt of LLMSqlCorrector.	2024-12-19 09:55:32 +08:00
jerryjzhang	6fcd105249	[improvement][chat]Inject schema info into the prompt of LLMSqlCorrector.	2024-12-18 12:04:06 +08:00
jerryjzhang	9f8793bfe2	[improvement][headless]Remove fixed TimeEnums fields.	2024-12-12 00:27:09 +08:00
Jun Zhang	a8868ba9ab	Merge branch 'tencentmusic:master' into master	2024-12-11 22:48:14 +08:00
jerryjzhang	8c44c9f42f	[improvement][headless]Remove fixed TimeEnums fields.	2024-12-11 21:33:43 +08:00
mislayming	07f6be51c7	SpringBoot3升级 (#1947)	2024-12-11 17:09:20 +08:00
Jun Zhang	e55f43c737	[improvement]Use QueryWrapper in place of hard-coded SQLs (#1944) ... * [improvement][launcher]Use API to get element ID avoiding hard-code. * [fix][launcher]Fix mysql scripts. * [improvement][launcher]Support DuckDB database and refactor translator code structure. * [improvement][headless-fe] Revamped the interaction for semantic modeling routing and successfully implemented the switching between dimension and dataset management. * [improvement][Headless] Add table ddl in Dbschema * [improvement][Headless] Add get database by type * [improvement][Headless] Supports automatic batch creation of models based on db table names. * [improvement][Headless] Supports getting domain by bizName * [improvement][launcher]Refactor unit tests and demo data. * [fix][launcher]Change default vector dimension to 512. * [improvement](Dict) add dimValueAliasMap info for KnowledgeBaseService * [improvement][headless]Use QueryWrapper to replace hard-code SQL in mapper xml. * [improvement][chat]Introduce ChatMemory to delegate ChatMemoryDO. * [fix][common]Fix embedding store sys configs. * [fix][common]Fix postgres schema, using varchar instead of char. * [improvement][launcher]Change supersonic docker deployment from mysql to postgres. * [Fix][launcher]Fix a number of issues related to semantic modeling. * [Fix][headless]Fix the evaluation logic of agg type. * [fix][assembly]Fix Dockerfile and add docker compose run script. * [fix][chat]Fix "multiple assignments to same column "similar_queries". * [improvement][headless]Use LamdaQueryWrapper to avoid hard-coded column names. * [improvement][headless]Refactor headless infra to support advanced semantic modelling. * [improvement][headless]Change class name `Dim` to `Dimension`. * [improvement][chat]Introduce `TimeFieldMapper` to always map time field. * [fix][headless]Remove unnecessary dimension existence check. * [fix][chat]Fix adjusted filters don't take effect. ---------	2024-12-08 13:32:29 +08:00
jerryjzhang	aa400176a5	[improvement][chat]Introduce TimeFieldMapper to always map time field.	2024-12-04 23:48:43 +08:00
daikon12	efac1efdb0	[improvement](Dict) add dimValueAliasMap info for KnowledgeBaseService	2024-12-01 23:48:51 +08:00
Jun Zhang	593597fe26	Refactor translator module (#1932) ... * [improvement][Chat] Support agent permission management #1143 * [improvement][chat]Iterate LLM prompts of parsing and correction. * [improvement][headless]Clean code logic of headless core. * (fix) (chat) 记忆管理更新不生效 (#1912) * [improvement][headless-fe] Added null-check conditions to the data formatting function. * [improvement][headless]Clean code logic of headless translator. * [improvement][headless-fe] Added permissions management for agents. * [improvement][headless-fe] Unified the assistant's permission settings interaction to match the system style. * [improvement](Dict)Support returns dict task list of dimensions by page * [improvement][headless-fe] Revised the interaction for semantic modeling routing and implemented the initial version of metric management switching. * [improvement][launcher]Set system property `s2.test` in junit tests in order to facilitate conditional breakpoints. * [improvement][headless] add validateAndQuery interface in SqlQueryApiController * [improvement][launcher]Use API to get element ID avoiding hard-code. * [improvement][launcher]Support DuckDB database and refactor translator code structure. --------- Co-authored-by: lxwcodemonkey <jolunoluo@tencent.com> Co-authored-by: tristanliu <tristanliu@tencent.com> Co-authored-by: daikon12 <1059907724@qq.com> Co-authored-by: lexluo09 <39718951+lexluo09@users.noreply.github.com>	2024-11-30 00:27:33 +08:00
jerryjzhang	c80794e8fc	[fix][launcher]Fix mysql scripts.	2024-11-28 09:44:49 +08:00
Jun Zhang	cb183b7ac8	[improvement][Chat] Support agent permission management (#1923) ... * [improvement][Chat] Support agent permission management #1143 * [improvement][chat]Iterate LLM prompts of parsing and correction. * [improvement][headless-fe] Added null-check conditions to the data formatting function. * [improvement][headless]Clean code logic of headless translator. --------- Co-authored-by: lxwcodemonkey <jolunoluo@tencent.com> Co-authored-by: tristanliu <tristanliu@tencent.com>	2024-11-23 09:09:04 +08:00
jerryjzhang	d7586a5d3b	[improvement][headless]Clean code logic of headless translator.	2024-11-20 22:23:53 +08:00
jerryjzhang	a0f53359ef	[improvement][chat]Iterate LLM prompts of parsing and correction.	2024-11-17 09:06:42 +08:00
Jun Zhang	ba1938f04b	Merge fixes and improvements (#1910) ... Co-authored-by: tristanliu <tristanliu@tencent.com>	2024-11-16 13:57:54 +08:00
zhaodongsheng	5e22b412c6	(fix) CoreDictionaryPath Incorrect Assignment (#1903)	2024-11-14 22:34:59 +08:00
jerryjzhang	14a19a901f	[improvement][project]Simplify code logic in multiple modules.	2024-11-10 14:31:12 +08:00