FastDFS同一组内的文件不同步

Question

我在 5 台服务器上部署了一个 fastdfs 文件集群，分配如下：

tracker1：117.48.231.77
tracker2：117.48.231.99

[group1]
117.48.231.94
117.48.231.88

[group2]
117.48.231.84

可以上传文件到两个group的storage里。
但现在的问题是，如果传文件到[group1]，集群只会把文件传到117.48.231.88，而117.48.231.94的文件不会同步，集群也不会传文件到117.48.231.94。但按照 fastdfs 上传文件的机制，[group1]中的storage应该都有机会被选中，而文件上传后两台存储的文件应该自动同步。

相关的日志如下：

[2018-07-13 09:09:53] DEBUG - base_path=/fastdfs/storage, connect_timeout=30, network_timeout=60, tracker_server_count=2, anti_steal_token=0, anti_steal_secret_key length=0, use_connection_pool=0, g_connection_pool_max_idle_time=3600s, use_storage_id=0, storage server id count: 0

server_count=2, server_index=0

tracker server is 117.48.231.77:22122

group count: 2

Group 1:
group name = group1
disk total space = 40252 MB
disk free space = 36654 MB
trunk free space = 0 MB
storage server count = 2
active server count = 2
storage server port = 23000
storage HTTP port = 8888
store path count = 1
subdir count per path = 256
current write server index = 0
current trunk file id = 0

    Storage 1:
        id = 117.48.231.88
        ip_addr = 117.48.231.88  ACTIVE
        http domain = 
        version = 5.05
        join time = 2018-07-12 14:33:29
        up time = 2018-07-13 08:40:09
        total storage = 40252 MB
        free storage = 36654 MB
        upload priority = 10
        store_path_count = 1
        subdir_count_per_path = 256
        storage_port = 23000
        storage_http_port = 8888
        current_write_path = 0
        source storage id = 
        if_trunk_server = 0
        connection.alloc_count = 256
        connection.current_count = 2
        connection.max_count = 2
        total_upload_count = 9
        success_upload_count = 9
        total_append_count = 0
        success_append_count = 0
        total_modify_count = 0
        success_modify_count = 0
        total_truncate_count = 0
        success_truncate_count = 0
        total_set_meta_count = 0
        success_set_meta_count = 0
        total_delete_count = 0
        success_delete_count = 0
        total_download_count = 0
        success_download_count = 0
        total_get_meta_count = 0
        success_get_meta_count = 0
        total_create_link_count = 0
        success_create_link_count = 0
        total_delete_link_count = 0
        success_delete_link_count = 0
        total_upload_bytes = 1478178
        success_upload_bytes = 1478178
        total_append_bytes = 0
        success_append_bytes = 0
        total_modify_bytes = 0
        success_modify_bytes = 0
        stotal_download_bytes = 0
        success_download_bytes = 0
        total_sync_in_bytes = 165052
        success_sync_in_bytes = 0
        total_sync_out_bytes = 0
        success_sync_out_bytes = 0
        total_file_open_count = 9
        success_file_open_count = 9
        total_file_read_count = 0
        success_file_read_count = 0
        total_file_write_count = 9
        success_file_write_count = 9
        last_heart_beat_time = 2018-07-13 09:09:24
        last_source_update = 2018-07-12 17:01:48
        last_sync_update = 2018-07-12 17:01:53
        last_synced_timestamp = 1970-01-01 08:00:00 
    Storage 2:
        id = 117.48.231.94
        ip_addr = 117.48.231.94  ACTIVE
        http domain = 
        version = 5.05
        join time = 2018-07-12 17:23:33
        up time = 2018-07-13 08:40:09
        total storage = 40252 MB
        free storage = 36656 MB
        upload priority = 10
        store_path_count = 1
        subdir_count_per_path = 256
        storage_port = 23000
        storage_http_port = 8888
        current_write_path = 0
        source storage id = 117.48.231.88
        if_trunk_server = 0
        connection.alloc_count = 256
        connection.current_count = 2
        connection.max_count = 2
        total_upload_count = 0
        success_upload_count = 0
        total_append_count = 0
        success_append_count = 0
        total_modify_count = 0
        success_modify_count = 0
        total_truncate_count = 0
        success_truncate_count = 0
        total_set_meta_count = 0
        success_set_meta_count = 0
        total_delete_count = 0
        success_delete_count = 0
        total_download_count = 0
        success_download_count = 0
        total_get_meta_count = 0
        success_get_meta_count = 0
        total_create_link_count = 0
        success_create_link_count = 0
        total_delete_link_count = 0
        success_delete_link_count = 0
        total_upload_bytes = 0
        success_upload_bytes = 0
        total_append_bytes = 0
        success_append_bytes = 0
        total_modify_bytes = 0
        success_modify_bytes = 0
        stotal_download_bytes = 0
        success_download_bytes = 0
        total_sync_in_bytes = 0
        success_sync_in_bytes = 0
        total_sync_out_bytes = 0
        success_sync_out_bytes = 0
        total_file_open_count = 0
        success_file_open_count = 0
        total_file_read_count = 0
        success_file_read_count = 0
        total_file_write_count = 0
        success_file_write_count = 0
        last_heart_beat_time = 2018-07-13 09:09:26
        last_source_update = 1970-01-01 08:00:00
        last_sync_update = 1970-01-01 08:00:00
        last_synced_timestamp = 1970-01-01 08:00:00 (never synced)

Group 2:
group name = group2
disk total space = 40252 MB
disk free space = 36603 MB
trunk free space = 0 MB
storage server count = 1
active server count = 1
storage server port = 23000
storage HTTP port = 8888
store path count = 1
subdir count per path = 256
current write server index = 0
current trunk file id = 0

    Storage 1:
        id = 117.48.231.84
        ip_addr = 117.48.231.84  ACTIVE
        http domain = 
        version = 5.05
        join time = 2018-07-12 14:33:30
        up time = 2018-07-13 08:40:09
        total storage = 40252 MB
        free storage = 36603 MB
        upload priority = 10
        store_path_count = 1
        subdir_count_per_path = 256
        storage_port = 23000
        storage_http_port = 8888
        current_write_path = 0
        source storage id = 
        if_trunk_server = 0
        connection.alloc_count = 256
        connection.current_count = 1
        connection.max_count = 1
        total_upload_count = 8
        success_upload_count = 8
        total_append_count = 0
        success_append_count = 0
        total_modify_count = 0
        success_modify_count = 0
        total_truncate_count = 0
        success_truncate_count = 0
        total_set_meta_count = 0
        success_set_meta_count = 0
        total_delete_count = 0
        success_delete_count = 0
        total_download_count = 0
        success_download_count = 0
        total_get_meta_count = 0
        success_get_meta_count = 0
        total_create_link_count = 0
        success_create_link_count = 0
        total_delete_link_count = 0
        success_delete_link_count = 0
        total_upload_bytes = 1313936
        success_upload_bytes = 1313936
        total_append_bytes = 0
        success_append_bytes = 0
        total_modify_bytes = 0
        success_modify_bytes = 0
        stotal_download_bytes = 0
        success_download_bytes = 0
        total_sync_in_bytes = 164962
        success_sync_in_bytes = 0
        total_sync_out_bytes = 0
        success_sync_out_bytes = 0
        total_file_open_count = 8
        success_file_open_count = 8
        total_file_read_count = 0
        success_file_read_count = 0
        total_file_write_count = 8
        success_file_write_count = 8
        last_heart_beat_time = 2018-07-13 09:09:24
        last_source_update = 2018-07-12 17:01:49
        last_sync_update = 2018-07-12 17:01:53
        last_synced_timestamp = 1970-01-01 08:00:00 

group1 两台存储器的日志：

[2018-07-13 08:48:09] ERROR - file: storage_ip_changed_dealer.c, line: 180, connect to tracker server 117.48.231.99:22122 fail, errno: 111, error info: Connection refused
[2018-07-13 08:48:24] INFO - file: storage_param_getter.c, line: 191, use_storage_id=0, id_type_in_filename=ip, storage_ip_changed_auto_adjust=1, store_path=0, reserved_storage_space=10.00%, use_trunk_file=0, slot_min_size=256, slot_max_size=16 MB, trunk_file_size=64 MB, trunk_create_file_advance=0, trunk_create_file_time_base=02:00, trunk_create_file_interval=86400, trunk_create_file_space_threshold=20 GB, trunk_init_check_occupying=0, trunk_init_reload_from_binlog=0, trunk_compress_binlog_min_interval=0, store_slave_file_use_link=0
[2018-07-13 08:48:24] INFO - file: storage_func.c, line: 254, tracker_client_ip: 192.168.0.3, my_server_id_str: 192.168.0.3, g_server_id_in_filename: 50374848
[2018-07-13 08:48:24] ERROR - file: tracker_proto.c, line: 48, server: 117.48.231.77:22122, response status 2 != 0
[2018-07-13 08:48:24] ERROR - file: tracker_proto.c, line: 48, server: 117.48.231.99:22122, response status 2 != 0
[2018-07-13 08:48:24] INFO - local_host_ip_count: 2,  127.0.0.1  192.168.0.3
[2018-07-13 08:48:24] INFO - file: tracker_client_thread.c, line: 310, successfully connect to tracker server 117.48.231.77:22122, as a tracker client, my ip is 192.168.0.3
[2018-07-13 08:48:24] INFO - file: tracker_client_thread.c, line: 310, successfully connect to tracker server 117.48.231.99:22122, as a tracker client, my ip is 192.168.0.3
[2018-07-13 08:48:24] INFO - file: storage_sync.c, line: 2698, successfully connect to storage server 117.48.231.88:23000
[2018-07-13 08:48:24] INFO - file: storage_sync.c, line: 2698, successfully connect to storage server 117.48.231.94:23000

[2018-07-13 08:48:09] ERROR - file: storage_ip_changed_dealer.c, line: 180, connect to tracker server 117.48.231.99:22122 fail, errno: 111, error info: Connection refused
[2018-07-13 08:48:24] INFO - file: storage_param_getter.c, line: 191, use_storage_id=0, id_type_in_filename=ip, storage_ip_changed_auto_adjust=1, store_path=0, reserved_storage_space=10.00%, use_trunk_file=0, slot_min_size=256, slot_max_size=16 MB, trunk_file_size=64 MB, trunk_create_file_advance=0, trunk_create_file_time_base=02:00, trunk_create_file_interval=86400, trunk_create_file_space_threshold=20 GB, trunk_init_check_occupying=0, trunk_init_reload_from_binlog=0, trunk_compress_binlog_min_interval=0, store_slave_file_use_link=0
[2018-07-13 08:48:24] INFO - file: storage_func.c, line: 254, tracker_client_ip: 192.168.0.3, my_server_id_str: 192.168.0.3, g_server_id_in_filename: 50374848
[2018-07-13 08:48:24] ERROR - file: tracker_proto.c, line: 48, server: 117.48.231.77:22122, response status 2 != 0
[2018-07-13 08:48:24] ERROR - file: tracker_proto.c, line: 48, server: 117.48.231.99:22122, response status 2 != 0
[2018-07-13 08:48:24] INFO - local_host_ip_count: 2,  127.0.0.1  192.168.0.3
[2018-07-13 08:48:24] INFO - file: tracker_client_thread.c, line: 310, successfully connect to tracker server 117.48.231.77:22122, as a tracker client, my ip is 192.168.0.3
[2018-07-13 08:48:24] INFO - file: tracker_client_thread.c, line: 310, successfully connect to tracker server 117.48.231.99:22122, as a tracker client, my ip is 192.168.0.3
[2018-07-13 08:48:24] INFO - file: storage_sync.c, line: 2698, successfully connect to storage server 117.48.231.88:23000
[2018-07-13 08:48:55] INFO - file: storage_sync.c, line: 2698, successfully connect to storage server 117.48.231.94:23000

两台 tracker 的日志

[2018-07-13 09:14:37] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:14:41] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:14:44] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:14:48] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:14:52] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:14:53] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:15:01] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:15:11] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:15:14] INFO - file: tracker_relationship.c, line: 383, selecting leader...
[2018-07-13 09:15:19] INFO - file: tracker_relationship.c, line: 383, selecting leader...

Answer 1

遇到了同样的问题，没有找到合适的解决办法