1346 Commits

Author SHA1 Message Date
chyezh
3f8777dbab
enable max result window limit (#24768)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-06-09 15:50:36 +08:00
yihao.dai
49630dca92
Add RBAC for FlushAll (#24751) (#24755)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-06-08 20:10:36 +08:00
congqixia
5973f5aeb9
Use go-api/v2 for milvus-proto (#24723)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-06-07 21:32:37 +08:00
jaime
cb4bb4479e
Add RBAC for Database API (#24653)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-06-05 14:24:35 +08:00
chyezh
c453830246
add independent nq limit option (#24612)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-06-02 15:24:33 +08:00
Gao
1a60fe43c7
Fix Autoindex panic (#24602)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-06-01 21:06:32 +08:00
wayblink
5710752fb5
Retry keepalive when keepalive channel close (#24574)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-06-01 16:14:36 +08:00
groot
f11ad946e6
Fix bug of bulkinsert for dynamic field (#24568)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-31 21:28:32 +08:00
wei liu
483f53210d
enable collection rate limit when only global limit set (#24456)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-05-31 17:03:30 +08:00
groot
4ef0a73e4b
Fix a crash bug for backup/restore (#24526)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-31 14:03:29 +08:00
zhenshan.cao
be62f82da4
Add consistency_level in search/query request (#24541)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-05-31 10:17:29 +08:00
Jiquan Long
f3fb19507f
Support AutoIndex (#24387) (#24443)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-05-30 16:53:29 +08:00
groot
1dde46bd30
Fix crash issue of bulkinsert by invalid numpy array file (#24480)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-29 17:27:30 +08:00
wei liu
2bd8be47be
reduce grpc client dial timeout (#24422)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-05-29 11:01:29 +08:00
xige-16
793864c12d
Clean tmp disk data when start milvus (#24400)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-05-26 14:13:27 +08:00
MrPresent-Han
d07c49da43
[skip e2e] avoid print immense logs on input node (#24411)
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-05-25 19:33:28 +08:00
groot
ebdd914579
Fix a bug of bulkinsert dynamic schema (#24405)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-25 18:17:28 +08:00
yah01
7436718478
Check the length of JSON (#24035) (#24072)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-05-23 12:07:25 +08:00
Jiquan Long
6e69ffd496
Support to manage connections (#24224) (#24293)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-05-23 09:45:26 +08:00
groot
1c46a0ecd9
Support dynamic field for bulkinsert (#24265)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-22 18:53:26 +08:00
yah01
1eb804fcbb
Fix the segcore payload reader can't read JSON data (#24212)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-05-20 22:23:25 +08:00
cai.zhang
4649f1a9b2
Support dynamic schema (#24062) (#24176) (#24205) (#24099)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-05-19 16:31:24 +08:00
groot
e5b456ff1c
Support JSON for bulkinsert (#24227)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-05-18 19:25:25 +08:00
MrPresent-Han
a327e9873e
support parms for import maxfilesize(#24191) (#24194)
Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2023-05-18 18:59:27 +08:00
Jiquan Long
c170a63f85
Fix flat index can be created with invalid metric type (#24180) (#24181)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-05-18 11:07:26 +08:00
xige-16
d4f7ebd110
Add ut for partition key (#24167)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-05-17 15:43:23 +08:00
yihao.dai
a9c05d1eb0
Support rate limit based on growing segments size (#24157)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-05-16 22:03:24 +08:00
jaime
d7bc8afecc
Support databse (#23742)
Co-authored-by: longjiquan jiquan.long@zilliz.com

Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-05-16 15:57:24 +08:00
chyezh
20054dc42b
Support configurable policy for query node, Add user level schedule policy (#23718)
Signed-off-by: chyezh <ye.zhen@zilliz.com>
2023-05-16 10:55:22 +08:00
congqixia
bc86aa666f
Fix session stop/goingStop stuck after connection lost (#23771)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-16 09:59:27 +08:00
xige-16
8b8f9f1e5d
Support partition key (#23994)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2023-05-15 21:31:24 +08:00
wei liu
c357cabe7d
enable config collection rate limit (#24068)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-05-12 18:13:26 +08:00
cai.zhang
73a2028756
Support expr with json field (#23804) (#24016)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2023-05-11 15:33:24 +08:00
shaoyue
d9e255f1b5
Support aliyun oss as object storage with ak or IAM (#23949)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2023-05-10 15:57:21 +08:00
yah01
62cabbfce2
Support JSON data type (#23839)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-05-09 22:11:24 +08:00
cqy123456
f7159189fd
modify diskann memory estimation method (#23892)
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2023-05-09 20:29:09 +08:00
Jiquan Long
a8306599db
Refactor check logic of index parameters (#23856) (#23903)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-05-09 14:20:42 +08:00
MrPresent-Han
6893a5b7b5
support cp lag behind policy(#23621) (#23889)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-05-06 19:00:40 +08:00
congqixia
c72db04c79
Make datanode load statslog lazy if SkipBFStatsLog is true (#23779)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-05 12:48:39 +08:00
congqixia
2fae8b87bc
Fix Int8~Int32 empty result set type (#23851)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-04 17:24:40 +08:00
yihao.dai
10e55c8b10
Add disk quota at the collection level (#23816)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-29 11:52:39 +08:00
yihao.dai
546d317941
Add collection number quota per DB (#23808)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-29 11:00:39 +08:00
MrPresent-Han
67dd70f1f9
enable scoreBasedBalancer default(#23454) (#23806)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-29 07:22:40 +08:00
wei liu
4d7f3af6fd
support collection level rate limit (#23658)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-28 19:28:39 +08:00
MrPresent-Han
a7c44b29d3
refine balance mechanism to avoid back and forth(#23454) (#23763)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-04-28 00:44:36 +08:00
wei liu
2ee23feaf7
fix node up (#23626)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-04-27 12:08:35 +08:00
Gao
21762d9c23
Seperate reading build and load params for diskann (#23722)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-04-27 10:54:36 +08:00
yah01
1a773b8db1
Refine the merge algorithm (#23721)
For given two search tasks t1, t2:
- same topk: merge them if nq1 + nq2 <= MaxNQ
- otherwises: merge them if the merge cost doesn't exceeded merge ratio

the merge cost is defined as:
total cost - min(cost1, cost2)

Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-04-27 09:52:36 +08:00
XuanYang-cn
b7cda1b2b4
Make compaction target able to exceed segment max size by a bit (#21068) (#23692)
issue: #21053

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Ten Thousand Leaves <69466447+soothing-rain@users.noreply.github.com>
Co-authored-by: Yuchen Gao <yuchen.gao@zilliz.com>
2023-04-26 12:02:35 +08:00
congqixia
75b5751117
Re-calculate segment entry num when binlog field is zero (#23696)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-04-26 10:24:35 +08:00