Commit Graph

122 Commits

Author SHA1 Message Date
jerryjzhang
16600ed6f0 [improvement][chat]Support reviewing query memory based on direct user feedback. 2024-12-26 09:49:47 +08:00
jerryjzhang
265e51c429 [fix][chat]Memory enabled by the review task should be stored in embedding store. 2024-12-26 09:03:32 +08:00
mislayming
07f6be51c7 SpringBoot3升级 (#1947)
Some checks failed
supersonic CentOS CI / build (21) (push) Has been cancelled
supersonic mac CI / build (21) (push) Has been cancelled
supersonic ubuntu CI / build (21) (push) Has been cancelled
supersonic windows CI / build (21) (push) Has been cancelled
2024-12-11 17:09:20 +08:00
mislayming
848b4a1e44 (fix)(chat-api) 小范围整理一下lombok标签,增加默认构造函数避免高版本json框架无法实例化报错 (#1951) 2024-12-10 19:14:32 +08:00
Jun Zhang
e55f43c737 [improvement]Use QueryWrapper in place of hard-coded SQLs (#1944)
Some checks are pending
supersonic CentOS CI / build (11) (push) Waiting to run
supersonic CentOS CI / build (21) (push) Waiting to run
supersonic CentOS CI / build (8) (push) Waiting to run
supersonic mac CI / build (11) (push) Waiting to run
supersonic mac CI / build (21) (push) Waiting to run
supersonic mac CI / build (8) (push) Waiting to run
supersonic ubuntu CI / build (11) (push) Waiting to run
supersonic ubuntu CI / build (21) (push) Waiting to run
supersonic ubuntu CI / build (8) (push) Waiting to run
supersonic windows CI / build (11) (push) Waiting to run
supersonic windows CI / build (21) (push) Waiting to run
supersonic windows CI / build (8) (push) Waiting to run
* [improvement][launcher]Use API to get element ID avoiding hard-code.

* [fix][launcher]Fix mysql scripts.

* [improvement][launcher]Support DuckDB database and refactor translator code structure.

* [improvement][headless-fe] Revamped the interaction for semantic modeling routing and successfully implemented the switching between dimension and dataset management.

* [improvement][Headless] Add table ddl in Dbschema

* [improvement][Headless] Add get database by type

* [improvement][Headless] Supports automatic batch creation of models based on db table names.

* [improvement][Headless] Supports getting domain by bizName

* [improvement][launcher]Refactor unit tests and demo data.

* [fix][launcher]Change default vector dimension to 512.

* [improvement](Dict) add dimValueAliasMap info for KnowledgeBaseService

* [improvement][headless]Use QueryWrapper to replace hard-code SQL in mapper xml.

* [improvement][chat]Introduce ChatMemory to delegate ChatMemoryDO.

* [fix][common]Fix embedding store sys configs.

* [fix][common]Fix postgres schema, using varchar instead of char.

* [improvement][launcher]Change supersonic docker deployment from mysql to postgres.

* [Fix][launcher]Fix a number of issues related to semantic modeling.

* [Fix][headless]Fix the evaluation logic of agg type.

* [fix][assembly]Fix Dockerfile and add docker compose run script.

* [fix][chat]Fix "multiple assignments to same column "similar_queries".

* [improvement][headless]Use LamdaQueryWrapper to avoid hard-coded column names.

* [improvement][headless]Refactor headless infra to support advanced semantic modelling.

* [improvement][headless]Change class name `Dim` to `Dimension`.

* [improvement][chat]Introduce `TimeFieldMapper` to always map time field.

* [fix][headless]Remove unnecessary dimension existence check.

* [fix][chat]Fix adjusted filters don't take effect.

---------
2024-12-08 13:32:29 +08:00
jerryjzhang
1e5bf7909e [improvement][headless]Deprecate and remove entity-related abstraction and logic.#1876 2024-11-04 09:53:18 +08:00
jerryjzhang
02f3bb8f5d [feature][chat]Introduce separate field to return summary generated by DataInterpretProcessor. 2024-10-31 12:57:19 +08:00
jerryjzhang
400b9f86f0 [improvement][chat]Modify core workflow of NL2SQLParser, always invoking rule-based parsers first.#1729 2024-10-29 13:12:56 +08:00
lexluo09
5d9b1b917e [improvement][chat] The parser interface supports using the dataSetId provided by the frontend as the reference (#1852) 2024-10-28 21:51:11 +08:00
jerryjzhang
b3d4440781 [improvement][chat]Support user feedback to multiple candidate semantic parses.#1847 2024-10-28 17:31:33 +08:00
jerryjzhang
14badcd4ae [improvement][chat]Introduce separate ChatParseResp in Chat module. 2024-10-28 12:44:39 +08:00
jerryjzhang
eb28d832bc [improvement][chat]Support user feedback to semantic parse info.#1729 2024-10-28 02:07:54 +08:00
jerryjzhang
1842261dfe [improvement][project]Remove unnecessary copy from Request to Context objects. 2024-10-27 15:59:49 +08:00
lexluo09
473329d398 [improvement][chat] Filter at the lowest level in the Map based on the dataSetId (#1834) 2024-10-20 21:51:57 +08:00
LXW
1f208ffcb7 (improvement)(Common) Move ChatModel management to common modules and add chatApp for data-model builder (#1831)
Co-authored-by: lxwcodemonkey
2024-10-20 18:42:08 +08:00
jerryjzhang
f26845e29b [feature][chat]Support creation of chat memory via REST API.#1603 2024-10-12 16:29:30 +08:00
jipeli
bf1f2ed60a [improvement][headless] add errorMsg to parse and execute response (#1764) (#1778) 2024-10-10 21:27:26 +08:00
jerryjzhang
9ffe67c962 [feature][chat]Add API to get ChatModelType list.#1739 2024-10-09 14:56:34 +08:00
jerryjzhang
8bf5d395a7 [improvement][headless-chat]Demo queries only use rule-based parser. 2024-10-08 15:49:23 +08:00
lexluo09
71a9954be5 (improvement)[build] Use Spotless to customize the code formatting (#1750) 2024-10-04 00:05:04 +08:00
lexluo09
de2385cd2c [improvement][headless] Backend uniformly supports other types of databases. (#1745) 2024-09-30 15:02:58 +08:00
LXW
6c2553ab8f (improvement)(Chat) Optimize memory management (#1741)
Co-authored-by: lxwcodemonkey
2024-09-29 17:13:06 +08:00
jerryjzhang
cd08cf51c5 [improvement][project]Use DatePeriodEnum to replace DAY/MONTH/YEAR period constants. 2024-09-22 17:14:55 +08:00
lexluo09
5f59e89eea (improvement)(build) Add spotless during the build process. (#1639) 2024-09-07 00:36:17 +08:00
xiuzhu9527
5606633481 (fix)(chat)Remove spaces when obtaining a MemoryReviewResult (#1594) 2024-08-26 10:27:08 +08:00
jerryjzhang
ccd79e4830 [improvement][headless]Optimize code structure and code style. 2024-07-28 10:06:16 +08:00
LXW
a3f17b3b68 (improvement)(chat) Opt update of ChatMemory (#1286)
Co-authored-by: lxwcodemonkey
2024-06-29 17:39:01 +08:00
LXW
89c63cd44d (improvement)(Chat) Put agent examples into ChatMemory automatically (#1249)
Co-authored-by: lxwcodemonkey
2024-06-27 17:12:35 +08:00
jerryjzhang
d4cc53acae (feature)(chat)Introduce new plain_text mode to allow users to talk to LLM directly. 2024-06-25 21:14:19 +08:00
LXW
4648e8d875 (improvement)(Chat)The chat history also returns the time taken for parsing and SQL generation (#1084)
Co-authored-by: jolunoluo
2024-06-03 21:18:32 +08:00
LXW
8aab359def (improvement)(Chat) Format the results of the parse and query phases into text (#1045)
Co-authored-by: jolunoluo
2024-05-29 17:02:45 +08:00
LXW
53b6c03288 (improvement)(Chat) add extend config for agent (#1010) 2024-05-20 12:58:21 +08:00
lexluo09
07b5eb47b6 (improvement)(Headless) Add 'topFields' to the map interface and return dataSet and field names in Chinese. (#892) 2024-04-07 21:29:53 +08:00
LXW
4291ec7bd7 (improvement)(Chat) Integrate chat with execute parse result processor (#825)
Co-authored-by: jolunoluo
2024-03-15 16:08:34 +08:00
LXW
5519a507ae (improvement)(Chat) Integrate chat with plugin recognizer and parse result processor (#820)
Co-authored-by: jolunoluo
2024-03-14 18:37:09 +08:00
LXW
f93bee81cb (improvement)(Chat) Move chat-core to headless (#805)
Co-authored-by: jolunoluo
2024-03-12 22:20:30 +08:00
lexluo09
ae7acb4817 (improvement)(Headless) Dataset supports query mode settings, and the chat layer supports tag mode (#802) 2024-03-12 12:15:21 +08:00
lexluo09
3ad18b0ee0 (improvement)(Chat)Integration of tags into chat. (#798) 2024-03-08 16:59:51 +08:00
lexluo09
b8ecfc6a99 [improvement](project) Adding tag abstraction to the dictionary and optimizing related code. (#785) 2024-03-05 18:00:48 +08:00
LXW
a41da3f5fe (improvement)(Headless)(Chat) Change View to DataSet (#782)
* (improvement)(Headless)(Chat) Change view to dataSet



---------

Co-authored-by: jolunoluo <jolunoluo@tencent.com>
2024-03-04 11:48:41 +08:00
LXW
6b6e54e95f (improvement)(chat) Fix modelId to viewId in QueryReq (#773)
Co-authored-by: jolunoluo
2024-02-27 21:42:40 +08:00
lexluo09
16643e8d75 (improvement)(chat) Adding the Metric API to Headless. (#738) 2024-02-22 20:42:07 +08:00
daikon
9600456bae headless integrates knowledge (#722) 2024-02-05 20:30:57 +08:00
lexluo09
1004f71ba4 [improvement][Chat] MetricRatio of Chat has been migrated to the processor, Rule and LLM queries now support unified ratio queries. (#711) 2024-02-01 22:32:48 +08:00
LXW
f29b1854ba (improvement)(chat) Parse info compatible with front-end (#704)
* (improvement)(headless) Modify view demo data

* (improvement)(chat) Parse info compatible with front-end

---------

Co-authored-by: jolunoluo
2024-01-30 22:06:23 +08:00
LXW
24b442baef (improvement)(headless)(chat) Add views and adapt chat and headless (#700)
* (improvement)(headless)(chat) Add views and adapt chat and headless

---------

Co-authored-by: jolunoluo
2024-01-30 20:43:53 +08:00
lexluo09
ade96c3adc (improvement)(chat) Clean up unused code and optimize some code and make the tests pass (#595) 2024-01-04 18:22:40 +08:00
lexluo09
023e84c420 (improvement)(chat) Split chat into three modules: server, api, and core. (#594) 2024-01-04 16:56:49 +08:00
LXW
52fea5311d (improvement)(headless) Merge server and core in headless-api (#590)
(improvement)(headless) Merge server and core in headless-api

---------

Co-authored-by: jolunoluo
2024-01-02 20:08:23 +08:00
LXW
e7f13572d7 (improvement)(headless) Modify the headless module structure to api, core and server (#588)
Co-authored-by: jolunoluo
2024-01-02 16:43:28 +08:00