tinswzy
1917bb720f
enhance: add fallback mechanism for WP when accessing object storage without Condition Write support ( #45735 )
...
related issue: #45733
related [wp issue:
#60 ](https://github.com/zilliztech/woodpecker/issues/60 )
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-12-07 21:59:11 +08:00
tinswzy
1427825133
enhance: improve WAL retention strategy ( #45350 )
...
issue: #44369
woodpecker related[ issue:
#59 ](https://github.com/zilliztech/woodpecker/issues/59 )
Refactor the WAL retention logic in Milvus StreamingNode:
- Remove the simple sampling-based truncation mechanism.
- After flush, WAL data is directly truncated.
- The retention control is now delegated to the underlying message queue
(MQ) implementation.
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-11-23 21:41:05 +08:00
Xiaofan
a9895bb904
enhance: add robust handle etcd servercrash ( #45304 )
...
related to #45303
fix milvus pod may restart when etcd pod start
Signed-off-by: xiaofanluan <xiaofan.luan@zilliz.com>
2025-11-13 10:23:36 +08:00
tinswzy
f342f49b32
enhance: add support for Azure Blob Storage in wp ( #44592 )
...
#44485
add support for blob in woodpecker
#43638
upgrade wp v0.1.6
related wp [issue#11](https://github.com/zilliztech/woodpecker/issues/11
)
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-09-29 09:51:44 +08:00
tinswzy
c7f21d5a06
enhance: purge small files right after wp segment compaction ( #44473 )
...
#43638
improve wp log output
[wp#43](https://github.com/zilliztech/woodpecker/issues/43 )
intro purge small files right after segment compaction
[wp#47](https://github.com/zilliztech/woodpecker/issues/47 )
The rootpath configured by milvus is uniformly used as the base for wp
local fs storage.
update to v0.1.5
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-09-21 16:32:01 +08:00
yihao.dai
51f69f32d0
feat: Add CDC support ( #44124 )
...
This PR implements a new CDC service for Milvus 2.6, providing log-based
cross-cluster replication.
issue: https://github.com/milvus-io/milvus/issues/44123
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2025-09-16 16:32:01 +08:00
tinswzy
173efe2b98
enhance: wp metrics and update deps to v0.1.0 ( #43569 )
...
#43574 #43604 #43431 #43603
Fix wp metrics not registered bug;
Update the version dependent on wp to v0.1.2-rc1;
improve advanced reader with concurrent prefetch blks;
add the segment rolling policy based on the number of blocks;
improve concurrent compaction
release lock failed bug
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-07-29 14:51:35 +08:00
tinswzy
36a4b74fc0
enhance: Adjust the default parameters of WP according to performance tests ( #42598 )
...
#42595
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-06-10 16:30:35 +08:00
tinswzy
f55f900c85
fix insert hang caused by WAL writer writing to a closing logfile ( #42078 )
...
related issue #42049
wp commit
[94de4](94de4cbc60
2025-06-03 09:58:36 +08:00
tinswzy
1735f557ca
fix sn oom issue during small file loading in wp ( #41946 )
...
#41846 #41894
Resolve SN OOM issue during small file loading in Woodpecker;
Correct WP fence/close execution order;
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-05-23 01:30:28 +08:00
tinswzy
4edb1bc6f1
fix: resolve wp WALImpls concurrent read/write bug ( #41763 )
...
#41563 #41579 #41842 #41846 #41758
Upgraded the wp dependency to incorporate recent fixes addressing
multiple concurrency bugs in WALImpls.
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-05-16 12:02:27 +08:00
Zhen Ye
dfbb02a5f7
enhance: make streaming message as a log field for easier coding ( #41545 )
...
issue: #41544
- implement message can be logged as a field by zap.
- fix too many slow log for woodpecker.
Signed-off-by: chyezh <chyezh@outlook.com>
2025-04-28 14:38:42 +08:00
tinswzy
6fa68c1f16
enhance: Support Woodpecker as a WAL storage option for Milvus ( #41095 )
...
#40916 Support Woodpecker as a WAL storage option for Milvus
Signed-off-by: tinswzy <zhenyuan.wei@zilliz.com>
2025-04-20 22:22:42 +08:00
