31 Commits

Author SHA1 Message Date
Yiqing Lu
89b4c58266
enhance: bump etcd version to 3.5.25 (#46093)
As title.

Signed-off-by: AlintaLu <yiqing.lu@zilliz.com>
2025-12-04 17:37:15 +08:00
sijie-ni-0214
19af1903f6
fix: etcd data persistence by adding --data-dir parameter (#45200)
issue: https://github.com/milvus-io/milvus/issues/45174

Signed-off-by: sijie-ni-0214 <sijie.ni@zilliz.com>
2025-11-04 19:37:34 +08:00
Yiqing Lu
ccc963279e
fix: update bitnami repo (#44955)
This pull request updates dependencies for Milvus deployments, focusing
on the images used for etcd and Kafka in both Helm and Docker Compose
configurations. The main goal is to align the deployment with newer or
organization-specific images for improved compatibility and maintenance.

**Helm deployment image updates:**

* Switched the etcd image repository from `bitnami/etcd` to
`milvusdb/etcd` and updated the etcd image tag from
`3.5.0-debian-10-r24` to `3.5.5-r2` in both standalone and cluster Helm
installation commands in `DeployTest.groovy`.

**Docker Compose image updates:**

* Changed the Kafka image from `bitnami/kafka:3.1.0` to
`bitnamilegacy/kafka:3.1.0` in `docker-compose.yml`.

issue: #44978

Signed-off-by: AlintaLu <yiqing.lu@zilliz.com>
2025-10-20 18:58:09 +08:00
zhikunyao
a71196ee65
enhance: update minio to RELEASE.2024-05-28T17-19-04Z (#43063)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-07-02 15:30:43 +08:00
zhikunyao
a0763b3c02
enhance: bump etcd version to 3.5.18 (#40231)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-02-27 11:53:58 +08:00
Rijin-N
a05a37a583
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)
Native support for Google cloud storage using the Google Cloud Storage
libraries. Authentication is performed using GCS service account
credentials JSON.

Currently, Milvus supports Google Cloud Storage using S3-compatible APIs
via the AWS SDK. This approach has the following limitations:

1. Overhead: Translating requests between S3-compatible APIs and GCS can
introduce additional overhead.
2. Compatibility Limitations: Some features of the original S3 API may
not fully translate or work as expected with GCS.

To address these limitations, This enhancement is needed.

Related Issue: #36212
2024-09-30 13:23:32 +08:00
yellow-shine
a802aea13c
enhance: bump etcd version (#35978)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-06 10:23:05 +08:00
SimFG
2944971507
enhance: fix the dev docker yaml and use go install to install the gotestsum (#32197)
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-04-12 19:17:18 +08:00
cai.zhang
7b5110d73b
enhance: Support azurite docker for develope env (#29021)
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-12-31 17:16:43 +08:00
sammy.huang
11687dce60
enhance: [skip e2e]upgrade minio version (#28971)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-05 14:14:34 +08:00
Enwei Jiao
940ead200a
Update Development.md (#23207)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-04-04 13:38:28 +08:00
smellthemoon
ce91f61e5a
Pre-create topics (#21907)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-04-03 16:44:23 +08:00
Bennu
15220f32e5
Bump etcd version (#22213)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-02-16 15:56:35 +08:00
edward.zeng
fa45dee543
Refine etcd config for docker-compose (#19293)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-09-21 09:14:50 +08:00
groot
a6a3b69d91
Report bulk load state (#16555)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-21 21:37:42 +08:00
jaime
ed3c29eae7
Support Kafka (#16149)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-12 19:47:33 +08:00
edward.zeng
086e8968ef
Upgrade minio version to RELEASE.2022-03-17T06-34-49Z (#16393)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-04-06 15:47:32 +08:00
edward.zeng
de9ee84bbb
Upgrade pulsar image for apple silicon (#15591)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-02-16 19:13:49 +08:00
edward.zeng
d032c55622
Upgrade pulsar from 2.7.3 to 2.8.2 (#15588)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-02-16 09:19:49 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
edward.zeng
a1e243b2d0
[skip e2e] Fix etcd data directory for dev docker compose (#15334)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-01-21 14:09:37 +08:00
yukun
4138d32af7
Change pulsar retentionSizeInMB to 8192(8GB) (#11643)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-11 17:00:44 +08:00
edward.zeng
a60a303aec
[skip ci] Use volume for dev docker compose (#11134)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-03 10:56:11 +08:00
XuanYang-cn
8d636b8082
[skip-ci]Fix pulsar retention configuration (#7385)
Resolves: #7384

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-31 18:41:59 +08:00
sunby
5fe96b9e19
Fix pulsar startup command (#7352)
issue: #7150
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-30 10:43:57 +08:00
Lari Hotari
32d41b176b
Improve docker-compose config for Pulsar (#7335)
- fix graceful shutdown by using "exec bin/pulsar" when starting in a shell script
  so that OS signals can get delivered to Pulsar process to fix graceful shutdown
- simplify and fix configuration issues
- disable Pulsar Functions worker and related key-value storage service so that
  resource usage is reduced
- upgrade to use Pulsar 2.7.3 since 2.6.x isn't actively maintained

Signed-off-by: Lari Hotari <lari@hotari.net>
2021-08-29 11:39:57 +08:00
quicksilver
76b92c3b69
Upgrade ETCD version to 3.5.0 (#7041)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-11 11:50:11 +08:00
quicksilver
bcd9a254dc
[skip ci] Set pulsar defaultRetentionTimeInMinutes parameter to 10080 with docker compose (#6252)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-01 17:30:16 +08:00
quicksilver
aaf15ec0f3
Modified pulsar maxMessageSize with docker compose (#6240)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-07-01 10:30:17 +08:00
quicksilver
c468ff30cf
Update networks in docker-compose.yml (#6163)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-28 13:50:14 +08:00
quicksilver
ebb901c342
[skip ci] Organize deployments folder (#5889)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-06-19 11:46:23 +08:00