133 Commits

Author SHA1 Message Date
zhuwenxing
a2ac49f867
test: fix dependabot alerts (#44037)
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-08-26 09:05:51 +08:00
zhikunyao
716884c0bc
test: try to upload conan cache in master branch (#43852)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-08-13 16:24:39 +08:00
zhikunyao
37507e265a
test: mergify migrate to ci-v2 (#43140)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-07-04 14:32:44 +08:00
Zhen Ye
ecb24e7232
enhance: use multi-process framework in integration test (#42976)
issue: #41609

- add env `MILVUS_NODE_ID_FOR_TESTING` to set up a node id for milvus
process.
- add env `MILVUS_CONFIG_REFRESH_INTERVAL` to set up the refresh
interval of paramtable.
- Init paramtable when calling `paramtable.Get()`.
- add new multi process framework for integration test.
- change all integration test into multi process.
- merge some test case into one suite to speed up it.
- modify some test, which need to wait for issue #42966, #42685.
- remove the waittssync for delete collection to fix issue: #42989

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2025-06-30 14:22:43 +08:00
SimFG
047254665d
feat: support to replicate import msg (#39171)
- issue: #39849

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2025-02-16 00:08:13 +08:00
congqixia
36e5b545b5
enhance: [skip e2e] Bump actions/download-artifact to v4.1.3 fixing security issue (#39891)
Related to https://github.com/milvus-io/milvus/security/dependabot/110

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-14 15:30:15 +08:00
zhikunyao
d14bb67c62
enhance: update workflow action upload-artifact to v4 (#39391)
Signed-off-by: Zhikun Yao <zhikun.yao@zilliz.com>
2025-01-17 15:47:01 +08:00
congqixia
0f514708ff
enhance: Accelerate Build stage by skipping cpp ut compilation (#37530)
Since master branch run cpp unittest in jenken, the cpp unit test
building could be skipped since the output is not needed in github
runner.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-08 14:06:26 +08:00
yellow-shine
139f4e5ab5
enhance: [codecov]split code coverage into components (#37137)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-25 17:42:14 +08:00
yellow-shine
8902e2220e
enhance: enable asan for cpp unittest (#37041)
https://github.com/milvus-io/milvus/issues/35854

Signed-off-by: chyezh <chyezh@outlook.com>
Co-authored-by: chyezh <chyezh@outlook.com>
2024-10-23 17:21:27 +08:00
Rijin-N
a05a37a583
enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214)
Native support for Google cloud storage using the Google Cloud Storage
libraries. Authentication is performed using GCS service account
credentials JSON.

Currently, Milvus supports Google Cloud Storage using S3-compatible APIs
via the AWS SDK. This approach has the following limitations:

1. Overhead: Translating requests between S3-compatible APIs and GCS can
introduce additional overhead.
2. Compatibility Limitations: Some features of the original S3 API may
not fully translate or work as expected with GCS.

To address these limitations, This enhancement is needed.

Related Issue: #36212
2024-09-30 13:23:32 +08:00
yellow-shine
e373687a07
enhance: turnoff USE_ASAN in ci (#35721)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-27 14:01:11 +08:00
yellow-shine
241c71fdde
enhance: use docker compose instead of docker-compose (#35208)
https://github.com/milvus-io/milvus/issues/35209

---------

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-02 19:32:32 +08:00
yellow-shine
e62f6b2f4e
enhance: [skip e2e] enlarge timeout of UT for go up to 90 mins (#35035)
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-29 15:51:49 +08:00
yellow-shine
1f55061717
feat: [skip e2e] effective way to use cache (#34774)
issue: https://github.com/milvus-io/milvus/issues/34876
1. try best to download cache
2. upload cache if it is not pull request

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-07-23 10:49:51 +08:00
sammy.huang
ac2840243a
enhance: revert dead try on uploading codecov (#34130)
This reverts commit 19936d9994b11bde6d417944c7b699107a93e0c7.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 11:51:30 +08:00
sammy.huang
2cc9df5c50
[automated] Update cpu Builder image changes (#34078)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-25 10:56:10 +08:00
sammy.huang
19936d9994
fix:[skip e2e] make more retries on codecov uploader (#33683)
fix #32235

inspired by
https://github.com/Kong/kubernetes-testing-framework/blob/main/.github/workflows/tests.yaml#L53-L69

### What is changing:
Introducing the
[wretry.action](https://github.com/Wandalen/wretry.action) to
automatically retry the
[codecov-action](https://github.com/codecov/codecov-action) in our CI/CD
pipeline. This change is intended to enhance the robustness of our
workflow by mitigating transient failures in the codecov-action.

### Follow-up changes needed:
This retry mechanism will be removed once the issue
[codecov/codecov-action#926](https://github.com/codecov/codecov-action/issues/926)
is resolved or if GitHub Actions provides a built-in retry feature for
actions.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-06-07 10:33:52 +08:00
congqixia
244d2c04f6
feat: Add milvusclient package and migrate GoSDK (#32907)
Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-05-10 18:01:30 +08:00
congqixia
29d3c576a3
enhance: [skip e2e] Enlarge integration test timeout to 90min (#32686)
The running time of integration is above 50 minutes and may surpass 60
and timeout in some cases. This PR enlarge timeout first.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-29 11:33:25 +08:00
sammy.huang
2a4dfde2de
enhance: revert [skip e2e] use pull_request_target event instead (#32426)
This reverts commit ab6ddf6929a18ee3dce3844521db8e55414fe812.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 17:15:37 +08:00
sammy.huang
66fae53cd2
enhance: hotfix HOME variable (#32411)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 14:49:26 +08:00
sammy.huang
70beec3e47
enhance: hotfix HOME variable (#32405)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-18 13:08:32 +08:00
sammy.huang
ab6ddf6929
enhance: [skip e2e] use pull_request_target event instead (#32236)
issue: #32235

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-13 21:17:17 +08:00
congqixia
a938951eea
enhance: [skip e2e] fix upload code cov if syntax (#32128)
The re-upload step is always true since the syntax is wrong

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-11 10:05:19 +08:00
sammy.huang
2aa6f3d3ec
enhance: bump codecod-action to v4 (#31984)
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-08 16:57:17 +08:00
congqixia
f399416b92
enhance: Use gotestsum to run go unit test (#31622)
See also #31490

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-27 15:29:10 +08:00
congqixia
4da8b6607d
enhance: Add scripts to use gotestsum to execute integration test (#31490)
See also #31489

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-22 10:29:06 +08:00
sammy.huang
d097d558b6
enhance: Maximize build space at the begin (#30540)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-06 10:29:40 +08:00
sammy.huang
32914a3ddf
enhance: [skip e2e]cleanup unnecessary part in the github action (#30425)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 14:39:04 +08:00
sammy.huang
265453f400
enhance: [skip e2e]revert back to original way to archive, upload and download (#30248)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-02-01 10:15:04 +08:00
sammy.huang
ae4f62ab4b
enhance: [skip e2e]Revert changes from pr 29890 (#29957)
Revert changes from pr #29890

This reverts commit 61acda49488a5fb0fd6872a604ed6d94bbffc157.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-22 10:00:55 +08:00
congqixia
2dacca7b84
enhance: [skip e2e] use checkout action to get ".git" for codecov (#30014)
Ignoring .git may result "unusable report" in codecov. Use checkout
action to get .git information in upload codecov step

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-16 13:56:53 +08:00
sammy.huang
61acda4948
enhance: [skip e2e]debug why no configuration file when docker-compose up (#29890)
#29889

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-12 10:38:51 +08:00
sammy.huang
0b3b753ef6
enhance: clean .github/workflow/main.yaml (#29524)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-11 18:20:52 +08:00
congqixia
93f87417fd
enhance: remove .git folder for unit test workflow (#29833)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-10 16:46:49 +08:00
sammy.huang
24495bd16f
enhance: [skip e2e]We aim to cancel the previously initiated job or workflow ex… (#29797)
enhance: We aim to cancel the previously initiated job or workflow
exclusively during the Pull Request (PR) stage

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2024-01-09 18:28:48 +08:00
sammy.huang
497ced9588
enhance: allow github actions runner run on ubuntu-latest os (#29525)
since milvus's build procedure is in the responding docker enviornment,
this procedure does not bind with particular host os, in turn it allows
milvus build on any os , including latest ubuntu os

background:
our self hosted runner is only using ubuntu-latest os

benefit:
make this github workflow obtain the resource from the self-hosted
runner

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 15:48:48 +08:00
sammy.huang
44ed0dff6a
enhance: [skip e2e]use native way from upload-artifact plugin to archive (#29539)
use upload-artifact plugin to archive instead of zip

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-28 09:46:45 +08:00
sammy.huang
afd87e0c5f
enhance: [skip e2e]bump tj-actions/changed-files to latest stable version (#29512)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:58:47 +08:00
sammy.huang
d750dd95e6
enhance: [skip e2e]extract cache stuff into a independent composite action (#29499)
fix: #29510

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-27 11:56:57 +08:00
sammy.huang
3e5bc2e517
enhance: [skip e2e]conan lock issue (#29442)
not allow to upload cache when job failure

this PR is to fix issue like below:

openblas/0.3.23@milvus/dev is locked by another concurrent conan
process, wait... If not the case, quit, and do 'conan remove --locks'
Error: The operation was canceled.

Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-25 16:34:46 +08:00
sre-ci-robot
bd640754ac
enhance: [skip e2e] skip maximize build space plugin if it is self-hosted runner (#29214)
Signed-off-by: Sammy Huang <sammy.huang@zilliz.com>
Co-authored-by: Sammy Huang <sammy.huang@zilliz.com>
2023-12-14 17:44:39 +08:00
Jiquan Long
f79c6146bd
enhance: [skip-e2e] auto cancel stale workflows (#29145)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-14 11:30:38 +08:00
Jiquan Long
02621e131c
enhance: [skip-e2e] enlarge disk space of action runner (#29077)
/kind improvement

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2023-12-08 16:14:07 +08:00
yah01
fd3ae4c4b8
enhance: improve the compile speed (#28444)
improve the CI compile speed with mold

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-15 15:08:18 +08:00
Enwei Jiao
8ae9c947ae
Use OpenDAL to access object store (#25642)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-11-01 09:00:14 +08:00
Enwei Jiao
0f2f4a0a75
Remove useless parameters for Makefile (#27622)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-10-11 20:45:35 +08:00
PowderLi
4feb3fa7c6
support azure (#26398)
Signed-off-by: PowderLi <min.li@zilliz.com>
2023-09-19 10:01:23 +08:00
congqixia
96d07edbfb
Add coverage report for integration test (#24428)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-05-26 13:45:26 +08:00