Commit Graph

72 Commits

Author SHA1 Message Date
guilinlewis
1faf84e372 (improvement)(common|headless|chat|auth) 鉴权优化与召回优化
1 修复生成的用户token 一生成就失效的问题
2 如果用户设置的token ,需校验是否数据库存在,因为用户可设置一年的token 有泄露风险
3 结果解析优化, 去除不可以解析的情况,解析问题需要改写后的问,
4 召回样例,用相似度,保住至少有一个样例是高相似度的
5 数据集召回,填加完全匹配格式筛选逻辑
2025-06-23 10:03:17 +08:00
guilinlewis
7e6639df83 (improvement)(common|headless|chat|auth) 鉴权优化与召回优化
1 修复生成的用户token 一生成就失效的问题
2 如果用户设置的token ,需校验是否数据库存在,因为用户可设置一年的token 有泄露风险
3 结果解析优化, 去除不可以解析的情况,解析问题需要改写后的问,
4 召回样例,用相似度,保住至少有一个样例是高相似度的
5 数据集召回,填加完全匹配格式筛选逻辑
2025-06-23 09:47:48 +08:00
supersonicbi
1c9cf788cb (feature)(auth)Support deletion of user. 2025-05-07 14:11:01 +08:00
beat4ocean
232a202275 [Improvement] Upgrade dependencies and fix vulnerabilities. (#2190)
Some checks failed
supersonic CentOS CI / build (21) (push) Has been cancelled
supersonic mac CI / build (21) (push) Has been cancelled
supersonic ubuntu CI / build (21) (push) Has been cancelled
supersonic windows CI / build (21) (push) Has been cancelled
2025-03-28 09:07:49 +08:00
jerryjzhang
f9d4ce2128 [fix][auth]Fix last_login of user not being selected. 2025-03-28 01:18:48 +08:00
jerryjzhang
1f28aaeaed (feature)(auth)Add last_login field to User. 2025-03-21 20:58:59 +08:00
jerryjzhang
8f361f9932 (improvement)(auth)Use interface in place of impl class.
Some checks are pending
supersonic CentOS CI / build (21) (push) Waiting to run
supersonic mac CI / build (21) (push) Waiting to run
supersonic ubuntu CI / build (21) (push) Waiting to run
supersonic windows CI / build (21) (push) Waiting to run
2025-03-04 17:56:41 +08:00
jerryjzhang
46316cadcf [fix][headless]Adjust none operator enum. 2025-02-16 15:38:53 +08:00
jerryjzhang
6cc145935d [fix][auth]Fix user registration and resetPassword issue.
Some checks are pending
supersonic CentOS CI / build (21) (push) Waiting to run
supersonic mac CI / build (21) (push) Waiting to run
supersonic ubuntu CI / build (21) (push) Waiting to run
supersonic windows CI / build (21) (push) Waiting to run
2025-02-14 00:28:36 +08:00
LXW
be5eeae707 (improvement)(headless) Opt logic of obtaining faker user (#2014)
Some checks failed
supersonic CentOS CI / build (21) (push) Has been cancelled
supersonic mac CI / build (21) (push) Has been cancelled
supersonic ubuntu CI / build (21) (push) Has been cancelled
supersonic windows CI / build (21) (push) Has been cancelled
* (improvement)(headless) opt logic of obtaining faker user

* (improvement)(headless) Fill in default values for data set creating

* (improvement)(headless) modify dataEvent type when creating model

---------

Co-authored-by: lxwcodemonkey
2025-01-19 14:59:33 +08:00
mislayming
07f6be51c7 SpringBoot3升级 (#1947)
Some checks failed
supersonic CentOS CI / build (21) (push) Has been cancelled
supersonic mac CI / build (21) (push) Has been cancelled
supersonic ubuntu CI / build (21) (push) Has been cancelled
supersonic windows CI / build (21) (push) Has been cancelled
2024-12-11 17:09:20 +08:00
mislayming
a298c670ed (improvement)(auth) 增强UserStrategy的可配置性 (#1949) 2024-12-10 19:09:22 +08:00
Jun Zhang
e55f43c737 [improvement]Use QueryWrapper in place of hard-coded SQLs (#1944)
Some checks are pending
supersonic CentOS CI / build (11) (push) Waiting to run
supersonic CentOS CI / build (21) (push) Waiting to run
supersonic CentOS CI / build (8) (push) Waiting to run
supersonic mac CI / build (11) (push) Waiting to run
supersonic mac CI / build (21) (push) Waiting to run
supersonic mac CI / build (8) (push) Waiting to run
supersonic ubuntu CI / build (11) (push) Waiting to run
supersonic ubuntu CI / build (21) (push) Waiting to run
supersonic ubuntu CI / build (8) (push) Waiting to run
supersonic windows CI / build (11) (push) Waiting to run
supersonic windows CI / build (21) (push) Waiting to run
supersonic windows CI / build (8) (push) Waiting to run
* [improvement][launcher]Use API to get element ID avoiding hard-code.

* [fix][launcher]Fix mysql scripts.

* [improvement][launcher]Support DuckDB database and refactor translator code structure.

* [improvement][headless-fe] Revamped the interaction for semantic modeling routing and successfully implemented the switching between dimension and dataset management.

* [improvement][Headless] Add table ddl in Dbschema

* [improvement][Headless] Add get database by type

* [improvement][Headless] Supports automatic batch creation of models based on db table names.

* [improvement][Headless] Supports getting domain by bizName

* [improvement][launcher]Refactor unit tests and demo data.

* [fix][launcher]Change default vector dimension to 512.

* [improvement](Dict) add dimValueAliasMap info for KnowledgeBaseService

* [improvement][headless]Use QueryWrapper to replace hard-code SQL in mapper xml.

* [improvement][chat]Introduce ChatMemory to delegate ChatMemoryDO.

* [fix][common]Fix embedding store sys configs.

* [fix][common]Fix postgres schema, using varchar instead of char.

* [improvement][launcher]Change supersonic docker deployment from mysql to postgres.

* [Fix][launcher]Fix a number of issues related to semantic modeling.

* [Fix][headless]Fix the evaluation logic of agg type.

* [fix][assembly]Fix Dockerfile and add docker compose run script.

* [fix][chat]Fix "multiple assignments to same column "similar_queries".

* [improvement][headless]Use LamdaQueryWrapper to avoid hard-coded column names.

* [improvement][headless]Refactor headless infra to support advanced semantic modelling.

* [improvement][headless]Change class name `Dim` to `Dimension`.

* [improvement][chat]Introduce `TimeFieldMapper` to always map time field.

* [fix][headless]Remove unnecessary dimension existence check.

* [fix][chat]Fix adjusted filters don't take effect.

---------
2024-12-08 13:32:29 +08:00
Siri-Ray
722f40cdf7 (improvement)(auth) Add user email info to jwt claim (#1921) 2024-11-24 09:41:33 +08:00
zhaodongsheng
0ddcdf93ec (feat)Support for managing large models with Dify #1830;2、add user access token; #1829; 3、support change password #1824 (#1839) 2024-10-22 13:58:58 +08:00
lexluo09
8ac83e63c3 [improvement][auth] Optimize the TokenService-related code (#1835) 2024-10-20 23:07:30 +08:00
lexluo09
473329d398 [improvement][chat] Filter at the lowest level in the Map based on the dataSetId (#1834) 2024-10-20 21:51:57 +08:00
LXW
1f208ffcb7 (improvement)(Common) Move ChatModel management to common modules and add chatApp for data-model builder (#1831)
Co-authored-by: lxwcodemonkey
2024-10-20 18:42:08 +08:00
jerryjzhang
248f4f83f6 [feature][chat]Refactor chat model config related codes.#1739 2024-10-09 17:27:07 +08:00
lexluo09
71a9954be5 (improvement)[build] Use Spotless to customize the code formatting (#1750) 2024-10-04 00:05:04 +08:00
jerryjzhang
ae889bb0ae [improvement][project]Optimize certain code structures. 2024-09-21 18:13:31 +08:00
LXW
79dc6c04ce (improvement)(chat) Avoid occasional npe when obtaining recommended dimensions (#1693)
Co-authored-by: lxwcodemonkey
2024-09-21 12:27:32 +08:00
LXW
0c0fbb829e (improvement)(auth)Avoid printing error logs when key decryption and token parsing fail (#1681)
* (improvement)(auth) Avoid throwing exceptions after login token authentication fails #1679

(improvement)(common) Do not print error log when key decryption fails #1679


---------

Co-authored-by: lxwcodemonkey
2024-09-18 16:20:12 +08:00
lexluo09
5f59e89eea (improvement)(build) Add spotless during the build process. (#1639) 2024-09-07 00:36:17 +08:00
lexluo09
7e45ab675e (improvement)(headless) ClickHouse also adopts a connection-based approach, and the package path issue in UserRepositoryImpl has been fixed (#1622) 2024-09-03 13:14:40 +08:00
LXW
9911e6772c (improvement)(auth) Make row permissions take effect during the translate sql phase and refactor the auth code (#1368)
Co-authored-by: lxwcodemonkey
2024-07-07 20:46:53 +08:00
LXW
2f0ac2baf8 (improvement)(chat) add chat plugin webservice demo (#1317)
Co-authored-by: lxwcodemonkey
2024-07-01 18:56:53 +08:00
LXW
d8bc6a02a4 (improvement)(common) Remove AESUtil and add AES/CBC、AES/ECB encryption/decryption in AESEncryptionUtil (#1297)
Co-authored-by: lxwcodemonkey
2024-06-30 16:18:31 +08:00
二毛
3e8283a7b6 Fix milvus dependency conflict (#1246) 2024-06-28 14:14:04 +08:00
lexluo09
bbd61ac937 (improvement)(config) Split the application-local.yml file based on functionality. (#1250) 2024-06-27 16:56:16 +08:00
lexluo09
7c711f6105 (improvement)(project) Remove additional logging dependencies and use logback as the primary logging framework. (#1235) 2024-06-27 09:39:26 +08:00
lexluo09
fb97c7b58b (improvement)(auth) Optimize the code for login authentication. (#1214) 2024-06-25 11:43:38 +08:00
lexluo09
2fd2c5690b (improvement)(auth) Fix the issue of a too short key. (#1207) 2024-06-24 23:57:48 +08:00
lexluo09
96d8ba5ec4 (improvement)(chat) Fix the Zhipu embedding model issue. (#1206) 2024-06-24 22:44:51 +08:00
lexluo09
69bb64cdbf (improvement)(project) Fixed the default administrator password issue and the startup compatibility issue with embedding configuration. (#1187) 2024-06-22 01:39:47 +08:00
lexluo09
f2a12e56b7 (improvement)(code) Replace e.printStackTrace() with logger.error. (#1156) 2024-06-15 18:26:52 +08:00
jerryjzhang
eb18857a9b (improvement)(launcher)Move langchain4j related classes from launcher-common to common. 2024-06-15 09:08:44 +08:00
jipeli
abf440c4d4 (feature)(Headless) arrow flight sql endpoint (#634) (#1136) 2024-06-12 15:02:55 +08:00
lexluo09
82a3e30472 (improvement)(auth) Support token key allocation based on the integration application. (#1119) 2024-06-10 21:50:39 +08:00
lexluo09
9584d7bb2c (improvement)(build) Fixed the issue of unable to download JDK on CentOS. (#1118) 2024-06-09 11:10:15 +08:00
lexluo09
915d4ec4c2 (improvement)(auth)Initialize users and maintain compatibility with previous users. (#1117) 2024-06-09 10:16:03 +08:00
zhaodongsheng
5bc88b78a9 (improvement)(login) encrypt password (#1081) (#1116) 2024-06-09 08:16:45 +08:00
lexluo09
78d8e652cd (improvement)(auth) Optimize the code to support configurable token timeout duration, with a default value set to 2 hours. (#1077) 2024-06-02 00:08:24 +08:00
LXW
f07e80587d (improvement)(headless&chat) System parameter compatible with historical data and front-end (#1070)
This reverts commit 59f6169569.

Co-authored-by: jolunoluo
2024-06-01 12:09:09 +08:00
jerryjzhang
0f0847824f (improvement)(headless&chat)Refactor system parameter impl 2024-06-01 02:09:18 +08:00
LXW
8a342eb32a (improvement)(headless) Add integrate test for domain, model, view auth checking (#720)
Co-authored-by: jolunoluo
2024-02-04 21:56:30 +08:00
LXW
20c8456705 (improvement)(auth) Add organization demo (#664)
Co-authored-by: jolunoluo
2024-01-19 21:31:49 +08:00
LXW
1ef1aa53a3 (improvement)(headless) Remove redundant user dimensions in demo data (#663)
Co-authored-by: jolunoluo
2024-01-19 21:10:32 +08:00
LXW
ed54d7bae3 (improvement)(headless) Query metric/dimension by id in SchemaController and update api header check (#608)
* (improvement)(headless) Query metric/dimension by id in SchemaController and update api header check

* (improvement)(headless) Fix the issue where metrics were not recognized when the result field contained an aggregate function.

---------

Co-authored-by: jolunoluo
2024-01-09 10:26:10 +08:00
LXW
0858c13365 (improvement)(headless) Update server and core, server calls core one-way (#592)
* (improvement)(headless) Update server and core, server calls core one-way
* (improvement)(Auth) When obtaining the user information, determine whether the user is a system admin.
---------

Co-authored-by: jolunoluo
2024-01-04 12:08:12 +08:00