wei liu 16af4e230a

fix: Prevent panic in upsert due to missing nullable fields [Proxy] (#44070) ...

issue: #43980
Fixes a panic that occurred when a partial update was converted to an
insert due to a non-existent primary key. The panic was caused by
missing nullable fields that were not provided in the original partial
update request.

The upsert pre-execution logic is refactored to handle this correctly:
- Explicitly splits upsert data into 'insert' and 'update' batches.
- Automatically generates data for missing nullable or default-value
fields during inserts, preventing the panic.
- Enhances `typeutil.UpdateFieldData` to support different source and
destination indexes for flexible data merging.
- Adds comprehensive unit tests for mixed upsert, pure insert, and pure
update scenarios.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>

2025-08-29 18:33:51 +08:00

..

accesslog

enhance: Add grpc metadata header for client request time (#44059)

2025-08-27 14:27:49 +08:00

connection

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

authentication_interceptor_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

authentication_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

cgo_util_test.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

cgo_util.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

channels_mgr_test.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

channels_mgr.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

channels_time_ticker_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

channels_time_ticker.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

condition_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

condition.go

Propagate task ctx done err for proxy (#27892)

2023-10-26 19:06:13 +08:00

count_reducer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

count_reducer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

data_coord_mock_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

database_interceptor_test.go

feat:add BatchDescribeCollection interface (#43786)

2025-08-18 01:23:45 +08:00

database_interceptor.go

feat:add BatchDescribeCollection interface (#43786)

2025-08-18 01:23:45 +08:00

default_limit_reducer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

dummyreq_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

dummyreq.go

enhance: Use internal json(sonic) to replace std json lib (#37708)

2024-11-18 10:46:31 +08:00

hook_interceptor_test.go

enhance: set the rpc error code to avoid the invalid retry (#37024)

2024-10-22 10:33:26 +08:00

hook_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

http_req_impl_test.go

fix: Hide sensitive items for restful get configs (#44057)

2025-08-27 11:09:52 +08:00

http_req_impl.go

fix: Hide sensitive items for restful get configs (#44057)

2025-08-27 11:09:52 +08:00

impl_test.go

feat:add BatchDescribeCollection interface (#43786)

2025-08-18 01:23:45 +08:00

impl.go

feat: Add CMEK cipher plugin (#43722)

2025-08-27 11:15:52 +08:00

interface_def.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

lb_balancer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

lb_policy_test.go

fix: only clear exclude node list after refresh shard leader cache (#43553)

2025-07-25 14:18:54 +08:00

lb_policy.go

fix: only clear exclude node list after refresh shard leader cache (#43553)

2025-07-25 14:18:54 +08:00

look_aside_balancer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

look_aside_balancer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

management_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

management.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

meta_cache_adapter_test.go

enhance: Avoid initializing casbin enforcer for each request (#29117)

2023-12-12 10:36:43 +08:00

meta_cache_adapter.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

meta_cache_test.go

feat: impl StructArray -- create schema, insert, and retrieve data (#42855)

2025-07-27 01:30:55 +08:00

meta_cache_testonly.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

meta_cache.go

fix: Clean privilege cache after loading policy in InitPolicyInfo (#43642)

2025-07-30 16:57:37 +08:00

metrics_info_test.go

enhance: Add proxy task queue metrics (#42156)

2025-06-04 11:26:32 +08:00

metrics_info.go

enhance: Add proxy task queue metrics (#42156)

2025-06-04 11:26:32 +08:00

mock_cache.go

fix: Fix exclude nodes clearing logic position in load balancer retry (#42577)

2025-06-17 08:15:24 +08:00

mock_channels_manager.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

mock_lb_balancer.go

fix: mockery too unavailable after upgrade golang version (#41481)

2025-04-24 10:46:43 +08:00

mock_lb_policy.go

enhance: support run analyzer by loaded collection field (#42113)

2025-05-29 10:54:30 +08:00

mock_msgstream_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

mock_shardclient_manager.go

fix: Fix proxy panic at shard client manager (#42025)

2025-05-23 22:44:26 +08:00

mock_test.go

feat: impl StructArray -- create schema, insert, and retrieve data (#42855)

2025-07-27 01:30:55 +08:00

mock_tso_test.go

fix: mockery too unavailable after upgrade golang version (#41481)

2025-04-24 10:46:43 +08:00

msg_pack_test.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

msg_pack.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

OWNERS

[skip ci]Update OWNERS files (#11898)

2021-11-16 15:41:11 +08:00

privilege_cache_test.go

enhance: Add in-memory cache for casbin enforcer result (#35271)

2024-08-05 18:48:15 +08:00

privilege_cache.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

privilege_interceptor_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

privilege_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

proxy_rpc_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

proxy_test.go

feat: impl StructArray -- miscellaneous staffs for struct array (#43960)

2025-08-26 21:35:53 +08:00

proxy.go

feat: Add CMEK cipher plugin (#43722)

2025-08-27 11:15:52 +08:00

rate_limit_interceptor_test.go

feat: add DDLDB rate type and related quota configurations (#40651)

2025-03-14 15:38:09 +08:00

rate_limit_interceptor.go

feat: add DDLDB rate type and related quota configurations (#40651)

2025-03-14 15:38:09 +08:00

reducer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

reducer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

repack_func_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

repack_func.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

rootcoord_mock_test.go

enhance: add file resource api (#43766)

2025-08-08 14:17:41 +08:00

roundrobin_balancer_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

roundrobin_balancer.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

rpc_msg.go

Add slow log for read (#23272)

2023-04-14 15:30:29 +08:00

search_pipeline_test.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

search_pipeline.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

search_reduce_util_test.go

fix: empty search groupby result causing crash(#43137) (#43214)

2025-07-10 12:04:48 +08:00

search_reduce_util.go

enhance: Add search post pipeline (#43065)

2025-07-21 11:10:52 +08:00

search_util.go

feat: impl StructArray -- miscellaneous staffs for struct array (#43960)

2025-08-26 21:35:53 +08:00

service_provider_test.go

enhance: returning collection metadata from cache (#42823)

2025-07-14 10:54:50 +08:00

service_provider.go

feat: impl StructArray -- create schema, insert, and retrieve data (#42855)

2025-07-27 01:30:55 +08:00

shard_client_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

shard_client.go

feat: Implement partial result support on node down (#42009)

2025-05-28 00:12:28 +08:00

simple_rate_limiter_test.go

feat: support to deny dll according to database property (#40764)

2025-03-23 11:18:28 +08:00

simple_rate_limiter.go

feat: support to deny dll according to database property (#40764)

2025-03-23 11:18:28 +08:00

task_alias_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_alias.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_database_test.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_database.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_delete_streaming.go

feat: support use cipher hook in streaming node (#40562)

2025-08-19 10:41:44 +08:00

task_delete_test.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_delete.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_flush_all_streaming_test.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_flush_all_streaming.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_flush_all_test.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_flush_all.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_flush_streaming.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_flush.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_import.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_index_test.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

task_index.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

task_insert_streaming.go

feat: support use cipher hook in streaming node (#40562)

2025-08-19 10:41:44 +08:00

task_insert_test.go

feat: Supports more rerankers (#43270)

2025-08-22 17:29:47 +08:00

task_insert.go

feat: Supports more rerankers (#43270)

2025-08-22 17:29:47 +08:00

task_policies_test.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

task_policies.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

task_query_test.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

task_query.go

feat: impl StructArray -- support create index for vector array (embedding list) and search on it (#43726)

2025-08-20 10:27:46 +08:00

task_scheduler_test.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_scheduler.go

enhance: remove old arch non-streaming arch code (#43651)

2025-08-06 14:41:40 +08:00

task_search_test.go

feat: Supports more rerankers (#43270)

2025-08-22 17:29:47 +08:00

task_search.go

feat: Supports more rerankers (#43270)

2025-08-22 17:29:47 +08:00

task_statistic_test.go

feat: Implement partial result support on node down (#42009)

2025-05-28 00:12:28 +08:00

task_statistic.go

enhance: Merge RootCoord, DataCoord And QueryCoord into MixCoord (#41006)

2025-04-11 16:36:30 +08:00

task_test.go

feat: impl StructArray -- miscellaneous staffs for struct array (#43960)

2025-08-26 21:35:53 +08:00

task_upsert_streaming.go

feat: support use cipher hook in streaming node (#40562)

2025-08-19 10:41:44 +08:00

task_upsert_test.go

fix: Prevent panic in upsert due to missing nullable fields [Proxy] (#44070)

2025-08-29 18:33:51 +08:00

task_upsert.go

fix: Prevent panic in upsert due to missing nullable fields [Proxy] (#44070)

2025-08-29 18:33:51 +08:00

task_validator_test.go

enhance: disabling max entry limit by default (#43166)

2025-07-08 10:10:46 +08:00

task_validator.go

enhance: disabling max entry limit by default (#43166)

2025-07-08 10:10:46 +08:00

task.go

feat: temporarily disable Timestamptz collection creation (#43935)

2025-08-21 11:17:46 +08:00

timestamp_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

timestamp.go

fix: Update logging context and upgrade dependencies (#41318)

2025-04-23 10:52:38 +08:00

trace_log_interceptor_test.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

trace_log_interceptor.go

enhance: Use v2 package name for pkg module (#39990)

2025-02-22 23:15:58 +08:00

type_def.go

[skip e2e] Add comment for pChan (#14098)

2021-12-23 21:44:12 +08:00

util_test.go

fix: Prevent panic in upsert due to missing nullable fields [Proxy] (#44070)

2025-08-29 18:33:51 +08:00

util.go

fix: Prevent panic in upsert due to missing nullable fields [Proxy] (#44070)

2025-08-29 18:33:51 +08:00

validate_util_test.go

feat: impl StructArray -- miscellaneous staffs for struct array (#43960)

2025-08-26 21:35:53 +08:00

validate_util.go

feat: impl StructArray -- miscellaneous staffs for struct array (#43960)

2025-08-26 21:35:53 +08:00