wei liu
7aed88113c
enhance: Deduplicate primary keys in upsert request batch ( #45249 )
...
issue: #44320
This change adds deduplication logic to handle duplicate primary keys
within a single upsert batch, keeping the last occurrence of each
primary key.
Key changes:
- Add DeduplicateFieldData function to remove duplicate PKs from field
data, supporting both Int64 and VarChar primary keys
- Refactor fillFieldPropertiesBySchema into two separate functions:
validateFieldDataColumns for validation and fillFieldPropertiesOnly for
property filling, improving code clarity and reusability
- Integrate deduplication logic in upsertTask.PreExecute to
automatically deduplicate data before processing
- Add comprehensive unit tests for deduplication with various PK types
(Int64, VarChar) and field types (scalar, vector)
- Add Python integration tests to verify end-to-end behavior
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2025-11-17 21:35:40 +08:00
yanliang567
9e5f9277c0
test: Split insert file and add test for allow insert auto id ( #44801 )
...
related issue: #44425
1. split insert.py into a few files: upsert.py, insert.py,
partial_upsert.py ...
2. add test for allow insert auto id
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-10-14 14:28:00 +08:00
yanliang567
abb3aeacdf
test: Refactor diskann and hsnw index, and update gen data functions ( #43452 )
...
related issue #40698
1. add diskann and hnsw index test
2. update gen_row_data and gen_column_data functions
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-07-23 22:04:54 +08:00
yanliang567
d475d93a3d
test: Add ivf_rabitq index tests ( #41914 )
...
related issue: #41760
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-05-20 19:28:24 +08:00
yanliang567
ee659d50db
test: [E2e Refactor] update search basic tests and add a pk_name instead of hard code ( #41669 )
...
related issue: https://github.com/milvus-io/milvus/issues/40698
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-05-09 21:58:54 +08:00
yanliang567
70b311735b
test: [E2e Refactor] use vector datatype instead of hard code dataype names ( #41497 )
...
related issue: #40698
1. use vector datat types instead of hard code datatpe names
2. update search pagination tests
3. remove checking distances in search results checking, for knowhere
customize the distances for different metrics and indexes. Now only
assert the distances are sorted correct.
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2025-04-25 10:46:38 +08:00
nico
5cdd906d4b
test: update test cases and sdk version ( #39443 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2025-02-11 18:42:45 +08:00
nico
224c2c8e6d
enhance: update pymilvus version ( #38225 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-12-09 19:52:47 +08:00
yanliang567
af433ffd68
test: Add expression template tests and use error msg only as assertion ( #37618 )
...
related issue: https://github.com/milvus-io/milvus/issues/37451
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-11-13 17:14:30 +08:00
qixuan
80aa9ab4d6
test: Add insert and upsert related cases for null and default value support ( #37088 )
...
issue: #36129
---------
Signed-off-by: qixuan <673771573@qq.com>
2024-10-25 11:03:29 +08:00
qixuan
36147b10f5
test: Add insert and upsert related cases for null and default value support ( #36932 )
...
issue: #36129
Signed-off-by: qixuan <673771573@qq.com>
2024-10-22 10:13:27 +08:00
yanliang567
c96bbe19ba
test: Add upsert in rows tests ( #36820 )
...
related issue: #36710
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-14 16:41:22 +08:00
nico
cfd636ed5b
test: add different language tests and modify some cases ( #36465 )
...
fix : #36396
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-09-26 09:21:13 +08:00
yanliang567
e013ef1908
test: Add tests for hybrid search group by ( #36326 )
...
related issue: #36295
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-09-19 09:41:12 +08:00
nico
f756f01445
test: update test cases ( #35640 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-08-26 12:00:58 +08:00
yanliang567
249dc4d9eb
test: Add tests for upsert with auto id ( #35556 )
...
Related issue: #34668
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-08-20 14:20:56 +08:00
smellthemoon
07b94b4615
enhance: support upsert autoid==true ( #30342 )
...
related with: #29258
---------
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-07-11 16:53:35 +08:00
elstic
1216a4bcd8
test: Add more sparse test cases ( #33916 )
...
issue: https://github.com/milvus-io/milvus/issues/31483
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-06-19 15:24:09 +08:00
yanliang567
ba3b2a91a0
test: Remove useless common types and refine error assert in negative cases ( #33023 )
...
Related issue: #32653
1. Remove some meaningless common types
2. Refine error assertion in negative cases
3. Remove some dup tests
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-14 15:03:33 +08:00
yanliang567
82a1e1ebe1
test: Update insert data tests and refactor some data gen functions ( #32924 )
...
related issue: #32653
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-10 14:57:32 +08:00
yanliang567
5bb672d70d
test: Add a new range search test for all indexes and align some index params ( #32724 )
...
related issue: https://github.com/milvus-io/milvus/issues/32653
1. align some default index params
2. add a new range search tests for all indexes and float vectors
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-04-30 17:37:27 +08:00
nico
e83651def4
test: update test cases ( #32396 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-18 16:15:25 +08:00
nico
f0caf3a2da
test: update some cases ( #32323 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-16 20:27:32 +08:00
nico
14a9785380
test: update pymilvus version and test cases ( #31827 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-07 18:49:16 +08:00
nico
9e7ce0a8f7
test: update test cases ( #31266 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-03-15 15:23:10 +08:00
nico
d8164c43d2
test: update test cases ( #30777 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-03-02 11:01:13 +08:00
nico
5bbace1094
enhance: update test cases and increase timeout of rbac pipeline ( #30549 )
...
issue: #29880
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-02-07 10:54:47 +08:00
nico
ba0e980db9
test: add test cases ( #29924 )
...
issue: #28499
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-01-19 20:58:53 +08:00
nico
e75467dbf7
test: modify test cases ( #29383 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-12-22 09:58:43 +08:00
nico
845851ea1c
test: add test cases ( #28541 )
...
1. modify test cases about output a non-existed field. issue: #28465
2. add cases about creating collection using different language
3. add test case about inserting a string value to a pk(int64) field
4. add test case about search with expression using double quotes.
issue: #28365
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-11-29 10:48:26 +08:00
nico
824e278219
test: update test cases for new error code&msg ( #28706 )
...
issue: #23075
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-11-24 14:52:25 +08:00
nico
6e6de17a8c
update pymilvus version ( #27791 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-24 09:28:21 +08:00
nico
a693af014f
Add test cases of array ( #27603 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-24 09:26:31 +08:00
zhenshan.cao
020ad9a6bc
Rectify wrong exception messages associated with Array datatype ( #27769 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-10-19 17:24:07 +08:00
nico
9ed3cfd925
add test cases ( #27376 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-17 14:16:08 +08:00
nico
f9137d880b
Modify nightly test cases ( #27517 )
...
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
2023-10-10 11:53:34 +08:00
nico
d77984c211
Modify test cases for instability of num_entities ( #27198 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-09-19 21:51:25 +08:00
nico
5e4ae757f5
update test cases ( #26872 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-09-07 09:45:15 +08:00
yah01
3349db4aa7
Refine errors to remove changes breaking design ( #26521 )
...
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-04 09:57:09 +08:00
nico
a8e5dc3517
Add test cases of integer overflow" ( #26645 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-08-30 18:47:01 +08:00
nico
552c6acbf2
Update test cases ( #25858 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-07-25 10:27:01 +08:00
nico
a8f73051e0
Update pymilvus version and update some test cases ( #25479 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-07-17 21:49:19 +08:00
nico
5bd93f2432
Update pymilvus version ( #25013 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-06-20 19:30:41 +08:00
nico
6b75b8465f
Add test cases of default value ( #24891 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-06-19 15:44:41 +08:00
nico
a64a029c72
Update test cases nightly ( #24711 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-06-07 19:48:35 +08:00
nico
48f2d2e534
Add test cases of default value ( #24636 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-06-06 12:06:41 +08:00
binbin
c9997a2703
Add json and dynamic support cases ( #24525 )
...
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2023-06-06 12:02:34 +08:00
nico
35bb577da1
Replace num_entities with count(*) in some test cases ( #24033 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-05-12 18:49:21 +08:00
nico
aae67f7c5d
Update pymilvus version and modify some cases ( #23787 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-05-06 16:54:39 +08:00
NicoYuan1986
6084980b05
Modify test cases of diskann” ( #23072 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-04-01 09:44:27 +08:00
