sangheee bed94fc061

feat: support grpc tokenizer (#41994) ...

relate: https://github.com/milvus-io/milvus/issues/41035

This PR adds support for a gRPC-based tokenizer.

- The protobuf definition was added in
[milvus-proto#445](https://github.com/milvus-io/milvus-proto/pull/445).
- Based on this, the corresponding Rust client code was generated and
added under `tantivi-binding`.
  - The generated file is `milvus.proto.tokenizer.rs`.

I'm not very experienced with Rust, so there might be parts of the code
that could be improved.
I’d appreciate any suggestions or improvements.

---------

Signed-off-by: park.sanghee <park.sanghee@navercorp.com>

2025-09-19 17:40:01 +08:00

..

canalyzer

feat: support grpc tokenizer (#41994)

2025-09-19 17:40:01 +08:00

interfaces

enhance: package analyzer code in Go and fix named analyzer as tokenizer (#43694)

2025-08-27 10:59:52 +08:00

analyzer.go

enhance: package analyzer code in Go and fix named analyzer as tokenizer (#43694)

2025-08-27 10:59:52 +08:00