Commit Graph

89 Commits

Author SHA1 Message Date
lexluo09
f5a064aaad [improvement](chat) add TAG to Element and Nature, fix MetricTagQuery queryMode (#429) 2023-11-27 17:51:54 +08:00
mainmain
c36082476f (improvement)(chat) improve corrector and support sql union (#427) 2023-11-27 17:02:04 +08:00
jipeli
27bb1b322e (improvement) Move out the datasource and merge the datasource with the model, and adapt the chat module (#423)
Co-authored-by: jolunoluo <jolunoluo@tencent.com>
2023-11-27 11:05:24 +08:00
lexluo09
fe2a424718 [improvement](project) Switch ENTITY to TAG uniformly in the queryType and semanticQuery (#420) 2023-11-24 18:17:48 +08:00
mainmain
42c0bea8fc [improvement](chat) rule and llm support replace metric (#415)
* [improvement] replace metric

* [improvement] replace metric

* [improvement] supports replace metric

---------

Co-authored-by: zuopengge
2023-11-22 15:05:10 +08:00
lexluo09
f917defea8 [improvement](chat) Converting bizName to Name requires consideration of the time field (#412) 2023-11-21 15:44:00 +08:00
mainmain
6d9a8095eb [improvement](chat) adapt checkstyle. (#410) 2023-11-20 20:42:23 +08:00
mainmain
5b8fdbc6fd [improvement](chat) rule and llm supports replace metric (#408) 2023-11-20 17:04:14 +08:00
LXW
980d317152 (improvement)(common) Add description for sys parameter (#407)
Co-authored-by: jolunoluo
2023-11-20 14:52:47 +08:00
LXW
0143b0a1b2 (improvement)(chat)Add PostProcessor to do some logic after parser and corrector (#403)
* (improvement)(chat) Add PostProcessor to do some logic after parser and corrector

* (improvement)(chat) Add MetricCheckPostProcessor used to verify whether the dimensions involved in the query in metric mode can drill down on the metric

---------

Co-authored-by: jolunoluo
2023-11-20 09:58:25 +08:00
lexluo09
f198ce1ef8 [improvement](chat) If there is no aggregate function in the S2SQL, add the field to the 'SELECT' statement. (#401) 2023-11-18 10:28:09 +08:00
LXW
18211a215d (improvement) (common) Update sys parameter init (#400)
Co-authored-by: jolunoluo
2023-11-17 18:34:58 +08:00
lexluo09
d6a386ad03 [improvement](project) Parameters are uniformly obtained from system settings, removing optimization.properties, and modifying SysParameter parameters (#399) 2023-11-17 18:11:07 +08:00
LXW
8f19584ad7 (improvement)(semantic)Simplify datasource related code and support setting filter SQL for dict generation (#397)
* (improvement) (semantic) Simplify datasource related code and support setting filtering SQL for dict generation
* (improvement) (semantic) Remove the semicolon at the end of the datasource SQL
* (improvement) (common) Update sys parameter init

---------

Co-authored-by: jolunoluo
2023-11-17 17:52:28 +08:00
lexluo09
05b1a7ec3b [improvement](chat) remove nativeQuery config in chat (#394) 2023-11-16 21:51:08 +08:00
lexluo09
46a9e5b097 [improvement](chat) Added query type parsing, supporting metrics, entities, and other query types. (#392) 2023-11-16 17:08:56 +08:00
lexluo09
5b3a9ffba8 [improvement](chat) remove duplicates from multiple SQL identified by LLM. (#391) 2023-11-16 09:59:54 +08:00
lexluo09
aa448b1ba3 [improvement](chat) Add a LLMParserLayer to interact with a Python service and add comments to certain classes (#388) 2023-11-15 14:49:22 +08:00
LXW
36c8938ff7 (improvement) (common) add sys parameter setting (#384)
Co-authored-by: jolunoluo
2023-11-14 21:41:59 +08:00
LXW
5ccde0206c (feature) (chat) add llm examples in chat config (#379)
Co-authored-by: jolunoluo
2023-11-14 16:27:10 +08:00
lexluo09
74ed269544 (improvement)(chat) linkingValues is not passed to llm and optimize SchemaCorrector code (#378) 2023-11-14 11:12:27 +08:00
LXW
1ad2c5402b (feature) (common) add sys parameter setting (#377)
Co-authored-by: jolunoluo
2023-11-13 22:07:18 +08:00
yangde
805abeb261 (fix)(chat)Fix WhereCorrector's handling of time dimensions of weeks and months (#372) 2023-11-13 21:06:49 +08:00
mainmain
47be92d5f6 [improvement] remove number condition (#375) 2023-11-13 19:52:18 +08:00
lexluo09
5feac0c14e (improvement)(chat) Fixed an error in struct sql query order by aggregate metric (#374) 2023-11-13 16:06:10 +08:00
mainmain
cdb84716b7 (improvement)(chat) aggregator supports from chinese to english in s2sql (#371) 2023-11-13 14:51:23 +08:00
LXW
8ed7e91221 (improvement) (semantic) support metric data batch download (#358)
Co-authored-by: jolunoluo
2023-11-10 16:35:17 +08:00
lexluo09
acee0a36da (improvement)(chat) fix test error (#349) 2023-11-09 20:48:40 +08:00
lexluo09
0365886270 (improvement)(chat) Rules and large model queries should be queried using s2sql (#334) 2023-11-07 16:23:31 +08:00
lexluo09
910384d17f (improvement)(chat) Support semantic understanding, optimize the overall code of the mapper. (#321) 2023-11-05 13:14:07 +08:00
yangde
2fe56e7462 (improvement)(chat) Special handling for count_distinct operator during SQL correcting and explaining (#320) 2023-11-04 12:58:25 +08:00
LXW
ad20380283 Feature/model data embedding for chat and support status for metric and dimension (#311)
* (improvement)(semantic) add offline status for metric and dimension

* (improvement)(chat) add metric recall

---------

Co-authored-by: jolunoluo
2023-11-02 18:44:58 +08:00
lexluo09
b9f5e0a354 (improvement)(project) The Corrector is integrated into the Semantic module as an intermediate step for translating S2QL into SQL (#306) 2023-11-01 22:34:55 +08:00
jipeli
372e4acc2c (improvement)(semantic) fixed withAs not supported on CK version lower than 20.4 (#305)
Co-authored-by: jipengli <jipengli@tencent.com>
2023-11-01 17:57:38 +08:00
lexluo09
8f37c3175f (improvement)(semantic) If the field of the "AS" statement is equal to the alias, then do not replace the alias (#304) 2023-10-31 21:12:47 +08:00
mainmain
ae9aa1ba0f (improvement)(chat) fix in replace bug (#302) 2023-10-31 15:54:15 +08:00
lexluo09
688d26c457 (improvement)(semantic) optimized llms2qlParser code and support prior exts to llm (#300) 2023-10-27 13:03:55 +08:00
mainmain
80cce47f58 [improvement] add dimensionValue alias for sql execute (#296) 2023-10-26 21:13:43 +08:00
lexluo09
d533496b2a (improvement)(semantic) support multi sub-query in select (#288) 2023-10-25 17:36:46 +08:00
lexluo09
9a3c71df4a (improvement)(chat) modelId similarity >=1 and change hanlpHelper FILE_SPILT to fit windows (#284) 2023-10-24 16:34:04 +08:00
mainmain
e4e39e0496 (improvement)(chat) add traceId and time cost for show (#272) 2023-10-24 16:21:30 +08:00
lexluo09
dd63b78937 (improvement)(chat) support InExpression in DimensionFilter and fix removeWhereExpression error (#266) 2023-10-20 16:01:43 +08:00
LXW
dc4fbb1a14 (improvement)(config) remove semantic url in standalone yaml (#258)
Co-authored-by: jolunoluo
2023-10-18 19:44:35 +08:00
mainmain
7d770d2a6d (improvement)(chat) dsl supports revision (#254) 2023-10-18 17:44:14 +08:00
LXW
a9bb1c1f68 (feature)add metric check parser in chat and add metric check convert in semantic, download metric data in semantic (#241)
* (improvement)(chat) add metric check parser

* (improvement)(semantic) support metric data download

---------

Co-authored-by: jolunoluo
2023-10-17 13:20:20 +08:00
jipeli
40ba179703 (feature)(semantic) add materialization optimizer (#239)
Co-authored-by: jipengli <jipengli@tencent.com>
2023-10-16 22:07:45 +08:00
lexluo09
e3232f0198 (improvement)(chat) support sub-query in having (#237) 2023-10-16 20:05:05 +08:00
lexluo09
151963ea79 (improvement)(chat) support nested query sql (#210) 2023-10-13 17:24:10 +08:00
lexluo09
f605cf0ef9 (improvment)(chat) if exist count() in dsl,set query to NATIVE and only order by field and group by field can add to select (#206) 2023-10-13 14:25:24 +08:00
lexluo09
de764f3353 (improvment)(chat) refactor the jsqlparser code (#204) 2023-10-13 11:45:04 +08:00