279 Commits

Author	SHA1	Message	Date
superhero	3ae0d645a7	Merge pull request #2307 from guilinlewis/lewis-pr ... (improvement)(common|headless|chat|auth) 鉴权优化与召回优化	2025-06-23 17:29:21 +08:00
guilinlewis	1faf84e372	(improvement)(common|headless|chat|auth) 鉴权优化与召回优化 ... 1 修复生成的用户token 一生成就失效的问题 2 如果用户设置的token ，需校验是否数据库存在，因为用户可设置一年的token 有泄露风险 3 结果解析优化， 去除不可以解析的情况，解析问题需要改写后的问， 4 召回样例，用相似度，保住至少有一个样例是高相似度的 5 数据集召回，填加完全匹配格式筛选逻辑	2025-06-23 10:03:17 +08:00
guilinlewis	7e6639df83	(improvement)(common|headless|chat|auth) 鉴权优化与召回优化 ... 1 修复生成的用户token 一生成就失效的问题 2 如果用户设置的token ，需校验是否数据库存在，因为用户可设置一年的token 有泄露风险 3 结果解析优化， 去除不可以解析的情况，解析问题需要改写后的问， 4 召回样例，用相似度，保住至少有一个样例是高相似度的 5 数据集召回，填加完全匹配格式筛选逻辑	2025-06-23 09:47:48 +08:00
柯慕灵	f899d23b63	add new chat corrector ... 在助理最终执行物理SQL前，加入一步LLM优化性能功能	2025-06-21 04:57:04 +08:00
wanglongqiang	0709575cd9	when sql script has variables, generate sql can't be executed, this commit supports variable replement (#2259)	2025-05-20 22:35:28 +08:00
jerryjzhang	1fed8ca4d9	(fix)(headless)Fix hash code issue of MetricSchemaResp and DimensionSchemaResp.	2025-03-30 07:20:07 +08:00
jerryjzhang	d2a43a99c8	(feature)(headless)Support offset clause in struct query.	2025-03-23 14:30:56 +08:00
jerryjzhang	35b835172b	(fix)(headless)Updating dimension should update modelDetail as well.	2025-03-19 10:05:04 +08:00
jerryjzhang	12f6cfa42d	(fix)(headless)Metric filters do not take effect in struct query.	2025-03-13 18:53:13 +08:00
beat4ocean	0c8c2d4804	[fix][headless] Fix issue filterSql is not working. (#2157)	2025-03-12 13:53:08 +08:00
jerryjzhang	93d585c0d5	[feature][common]Add permission management to chat model.	2025-03-10 23:58:19 +08:00
jerryjzhang	a99f5985f5	(improvement)(headless)Set fields of model detail when restoring model.	2025-03-09 10:58:49 +08:00
jerryjzhang	a76b5a4300	(improvement)(headless)Add unit to measure.	2025-03-09 09:15:13 +08:00
jerryjzhang	c1f9df963c	(improvement)(headless)Add expr to semantic column.	2025-03-09 08:31:48 +08:00
jerryjzhang	56cfddea60	(improvement)(format)Follow the code style.	2025-02-26 19:19:25 +08:00
zyclove	5e3bafb953	feat:Support kyuubi presto trino (#2109)	2025-02-26 17:33:14 +08:00
zyclove	11ff99cdbe	fix: Caused by: java.io.NotSerializableException: DateConf、SchemaNameLengthComparator、SqlEvaluation and etc. (#2110)	2025-02-26 17:32:20 +08:00
mislayming	f9198cb8e0	(improvement)(chat) Enhancing the capability of embedding with LLM-based secondary judgment. (#2096)	2025-02-24 12:55:39 +08:00
jerryjzhang	94e853f57e	[improvement][headless]Support dataSetNames that contain dash. ... [improvement][headless]Support dataSetNames that contain dash. [improvement][headless]Support dataSetNames that contain dash.	2025-02-21 01:25:02 +08:00
jerryjzhang	32793ecf69	(improvement)(chat)Determine if with statement is supported and send explicitly message in the prompt to the LLM.	2025-02-17 21:21:43 +08:00
jerryjzhang	d6620e6ea7	[fix][headless]Adjust none operator enum.	2025-02-16 10:40:11 +08:00
jerryjzhang	eef7b3c443	[improvement][chat]Make a few code restructure.	2025-02-08 14:39:23 +08:00
jerryjzhang	c34b85c8a4	[improvement][chat]Introduce new chat workflow state.	2025-02-08 09:24:23 +08:00
jerryjzhang	cc66ebd684	[improvement][chat]Add queryId to QueryNLReq.	2025-02-05 17:24:48 +08:00
Jun Zhang	ef161fe1f2	[improvement][headless]Add ANY agg operator and remove table name from bizName of field. (#2028)	2025-02-02 19:43:43 +08:00
Jun Zhang	de92b357df	(Fix)(headless)Fix expression replacement issue. (#2024)	2025-01-30 08:54:42 +08:00
LXW	be5eeae707	(improvement)(headless) Opt logic of obtaining faker user (#2014) ... * (improvement)(headless) opt logic of obtaining faker user * (improvement)(headless) Fill in default values for data set creating * (improvement)(headless) modify dataEvent type when creating model --------- Co-authored-by: lxwcodemonkey	2025-01-19 14:59:33 +08:00
jerryjzhang	61e22c2104	[improvement][headless]Add sql field in the OntologyQuery.	2025-01-08 19:43:32 +08:00
jerryjzhang	6fcfdc15e1	[improvement][headless]Remove deprecated tag related constructs.	2025-01-05 15:42:54 +08:00
jerryjzhang	4738b9d01b	[improvement][headless]Release brand new version of Translator module.	2025-01-05 00:00:18 +08:00
jerryjzhang	7b46ef64fd	[fix][headless]Fix getModelList filter issue.	2025-01-04 22:25:45 +08:00
lxwcodemonkey	6af345044a	(fix)(headless) fix schemaItem useCnt always 0	2025-01-04 22:25:39 +08:00
jerryjzhang	a2f54d4c80	[improvement][headless]Remove unnecessary Database class	2024-12-29 21:58:39 +08:00
jerryjzhang	6486257c9e	[improvement][chat&headless]Remove deprecated system time fields.	2024-12-29 03:22:42 +08:00
jerryjzhang	d834e98a66	[improvement][chat]Introduce AllFieldMapper to increase parsing robustness when normal pipeline fails.	2024-12-26 23:28:59 +08:00
jerryjzhang	94267f6028	[improvement][chat]Introduce AllFieldMapper to increase parsing robustness when normal pipeline fails. ... [improvement][chat]Introduce `AllFieldMapper` to increase parsing robustness when normal pipeline fails.	2024-12-26 23:20:43 +08:00
lwhy	b425c49c5b	[fix][headless] Unexpected update of dimensions when modifying a model (#1971)	2024-12-25 19:33:10 +08:00
jerryjzhang	214d90772d	[improvement][headless]Move discovery of query models from SemanticNode to SqlQueryParser. ... [improvement][headless]Move discovery of query models from SemanticNode to `SqlQueryParser`.	2024-12-22 21:15:23 +08:00
jerryjzhang	d8b8c4e6b9	[improvement][headless]Move discovery of query models from SemanticNode to QueryParser.	2024-12-22 17:45:32 +08:00
jerryjzhang	1d0f5612b7	[fix][headless]Fix NEP problem.	2024-12-18 09:05:32 +08:00
jerryjzhang	b4c19533a4	[improvement][headless]bizName of dimension and metric shall not be the same as the field name in the database table.	2024-12-17 15:18:08 +08:00
jerryjzhang	831fbfe475	[improvement][headless]Refactor translator module to make code logic cleaner and more readable.	2024-12-15 21:03:57 +08:00
jerryjzhang	f9cc395e49	[improvement][headless]Refactor translator module to make code logic cleaner and more readable.	2024-12-15 08:48:48 +08:00
Jun Zhang	a8868ba9ab	Merge branch 'tencentmusic:master' into master	2024-12-11 22:48:14 +08:00
jerryjzhang	8c44c9f42f	[improvement][headless]Remove fixed TimeEnums fields.	2024-12-11 21:33:43 +08:00
mislayming	07f6be51c7	SpringBoot3升级 (#1947)	2024-12-11 17:09:20 +08:00
Jun Zhang	e55f43c737	[improvement]Use QueryWrapper in place of hard-coded SQLs (#1944) ... * [improvement][launcher]Use API to get element ID avoiding hard-code. * [fix][launcher]Fix mysql scripts. * [improvement][launcher]Support DuckDB database and refactor translator code structure. * [improvement][headless-fe] Revamped the interaction for semantic modeling routing and successfully implemented the switching between dimension and dataset management. * [improvement][Headless] Add table ddl in Dbschema * [improvement][Headless] Add get database by type * [improvement][Headless] Supports automatic batch creation of models based on db table names. * [improvement][Headless] Supports getting domain by bizName * [improvement][launcher]Refactor unit tests and demo data. * [fix][launcher]Change default vector dimension to 512. * [improvement](Dict) add dimValueAliasMap info for KnowledgeBaseService * [improvement][headless]Use QueryWrapper to replace hard-code SQL in mapper xml. * [improvement][chat]Introduce ChatMemory to delegate ChatMemoryDO. * [fix][common]Fix embedding store sys configs. * [fix][common]Fix postgres schema, using varchar instead of char. * [improvement][launcher]Change supersonic docker deployment from mysql to postgres. * [Fix][launcher]Fix a number of issues related to semantic modeling. * [Fix][headless]Fix the evaluation logic of agg type. * [fix][assembly]Fix Dockerfile and add docker compose run script. * [fix][chat]Fix "multiple assignments to same column "similar_queries". * [improvement][headless]Use LamdaQueryWrapper to avoid hard-coded column names. * [improvement][headless]Refactor headless infra to support advanced semantic modelling. * [improvement][headless]Change class name `Dim` to `Dimension`. * [improvement][chat]Introduce `TimeFieldMapper` to always map time field. * [fix][headless]Remove unnecessary dimension existence check. * [fix][chat]Fix adjusted filters don't take effect. ---------	2024-12-08 13:32:29 +08:00
jerryjzhang	c98c5ade9e	[improvement][headless]Change class name Dim to Dimension. ... [improvement][headless]Change class name `Dim` to `Dimension`.	2024-12-04 22:06:41 +08:00
jerryjzhang	28d5f38ffb	[improvement][headless]Refactor headless infra to support advanced semantic modelling.	2024-12-04 14:56:34 +08:00
jerryjzhang	3e903b862e	[Fix][headless]Fix the evaluation logic of agg type.	2024-12-02 23:39:53 +08:00