[Bug]: Milvus Backup Restore Failed: no binlog for field:id when bulk insert (segment 463164218295959239)

[ZHFlys]

Milvus-Backup Version

0.5.9

Can you reproduce this issue on the latest version?

Yes, it also happens on the latest version

Current Behavior

In a Milvus 2.6.7 environment, restoring a backed-up collection using the official milvus-backup tool failed with the core error no binlog for field:id (specifically for the auto-increment primary key field). The error points to the segment 463164218295959239, where the binlog file for the id field could not be recognized, leading to a bulk insert data failure.

Expected Behavior

No response

Steps To Reproduce

1. Create Backup (Successful)
./milvus-backup create -c TestVector.test_v3 -n test_v3_backup_20251229_020002

  [2025/12/29 02:01:44.773 +08:00] [INFO] [backup/task.go:115] ["backup all collections successfully"] [backup_id=08b6321d-e417-11f0-b8a8-00163e2c86f3]
  [2025/12/29 02:01:44.773 +08:00] [INFO] [backup/task.go:119] ["skip backup rbac"] [backup_id=08b6321d-e417-11f0-b8a8-00163e2c86f3]
  [2025/12/29 02:01:44.773 +08:00] [INFO] [backup/task.go:123] ["start backup rpc channel pos"] [backup_id=08b6321d-e417-11f0-b8a8-00163e2c86f3]
  [2025/12/29 02:01:44.773 +08:00] [INFO] [backup/task.go:353] ["try to get rpc channel pos"] [backup_id=08b6321d-e417-11f0-b8a8-00163e2c86f3] [rpc_channel=by-dev-replicate-msg]
  [2025/12/29 02:01:44.775 +08:00] [WARN] [backup/task.go:123] ["Failed to back up RPC channel position. This won't cause the backup to fail, but may lead to inconsistency when reconnecting to CDC for incremental data replication."] [backup_id=08b6321d-e417-11f0-b8a8-00163e2c86f3] [error="backup: call replicate message failed: client: replicate message failed: client: operation failed: error_code:UnexpectedError reason:\"service unavailable: not supported in streaming mode\" code:2 retriable:true detail:\"service unavailable: not supported in streaming mode\""]
  [2025/12/29 02:01:44.775 +08:00] [INFO] [backup/task.go:95] ["backup successfully"] [backup_id=08b6321d-e417-11f0-b8a8-00163e2c86f3]
  [2025/12/29 02:01:44.775 +08:00] [INFO] [runtime/asm_amd64.s:1700] ["stop renewal pause gc lease"] [component=gc-pauser]
  [2025/12/29 02:01:44.782 +08:00] [INFO] [backup/task.go:126] ["resume gc done"] [component=gc-pauser] [resp="{\"msg\": \"OK\"}"]

2.Restore Backup (Failed)
./milvus-backup restore -c TestVector.test_v3 -n test_backup_20251229_020002 -s _bak

Environment

Anything else?

No response

[huanghaoyuanhhy]

Please use ./milvus-backup check to verify that the configuration is correct.

[ZHFlys]

I switched to a smaller table with only two fields, but the error still persists.

[stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).RestoreBackup\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:114\ngithub.com/zilliztech/milvus-backup/cmd/restore.(*options).run\n\t/home/runner/work/milvus-backup/milvus-backup/cmd/restore/restore.go:133\ngithub.com/zilliztech/milvus-backup/cmd/restore.NewCmd.func1\n\t/home/runner/work/milvus-backup/milvus-backup/cmd/restore/restore.go:161\ngithub.com/spf13/cobra.(*Command).execute\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1015\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1148\ngithub.com/spf13/cobra.(*Command).Execute\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.9.1/command.go:1071\ngithub.com/zilliztech/milvus-backup/cmd.Execute\n\t/home/runner/work/milvus-backup/milvus-backup/cmd/cmd.go:37\nmain.main\n\t/home/runner/work/milvus-backup/milvus-backup/main.go:20\nruntime.main\n\t/opt/hostedtoolcache/go/1.24.4/x64/src/runtime/proc.go:283"]
Error: restore backup failed: backup: restore backup task execute fail, err: restore: execute restore: run collection task restore: wait collection worker pool restore: restore collection restore_collection: restore data: restore_collection: restore data v1: restore_collection: restore partition data v1: restore_collection: restore not L0 groups: restore_collection: restore not L0 segment v1: restore_collection: bulk insert failed: error: no binlog for Timestamp field: importing data failed, file: id:463164218851478286 paths:"restore-temp-restore_2026_01_08_10_14_55_5206008-YVector-test_bak/book_name_vector_backup_20260108_020003/binlogs/insert_log/463164218398120458/463164218398120459/463164218401589051/463164218401589051/" paths:"restore-temp-restore_2026_01_08_10_14_55_5206008-YVector-test_bak/book_name_vector_backup_20260108_020003/binlogs/delta_log/463164218398120458/463164218398120459/463164218401589051/463164218401589051/"

[ZHFlys]

[ZHFlys]

./milvus-backup check
0.5.7 (Built on 2025-07-08T04:36:41Z from Git SHA 8d327c5 by go1.24.4)
config: backup.yaml
[2026/01/08 18:21:56.846 +08:00] [INFO] [logutil/logutil.go:165] ["Log directory"] [configDir=]
[2026/01/08 18:21:56.847 +08:00] [INFO] [logutil/logutil.go:166] ["Set log file to "] [path=/mnt/milvus-backup/logs]
[2026/01/08 18:21:56.849 +08:00] [INFO] [core/backup_context.go:59] ["New milvus grpc client"] [component=grpc-client] [host=172.24.59.4:19530]
[2026/01/08 18:21:56.849 +08:00] [WARN] [grpclog/grpclog.go:155] ["[core]Adjusting keepalive ping interval to minimum period of 10s"]
[2026/01/08 18:21:56.858 +08:00] [INFO] [milvus/grpc.go:290] ["connect to server"] [component=grpc-client] [server=2.6.7]
[2026/01/08 18:21:56.865 +08:00] [INFO] [storage/factory.go:95] ["create milvus storage client"] [endpoint=172.24.59.4:31073] [bucket=my-release]
[2026/01/08 18:21:56.896 +08:00] [INFO] [storage/factory.go:42] ["create backup storage client"] [endpoint=172.24.59.4:31073] [bucket=milvus-bucket]
[2026/01/08 18:21:57.190 +08:00] [INFO] [core/backup_context.go:557] ["start copy prefix"] [src=files/milvus_backup_check_src_1767867717] [dest=backup/milvus_backup_check_dst_1767867717]
Succeed to connect to milvus and storage.
Milvus version: 2.6.7
Storage:
milvus-bucket: my-release
milvus-rootpath: files
backup-bucket: milvus-bucket
backup-rootpath: backup