7TB文件夹上的aws s3同步永远挂起

时间:2018-06-01 18:08:39

标签: amazon-s3 synchronization aws-cli frozen

我正在尝试将7TB从非EC2实例同步到S3。 所以我已经设法在3小时内同步一个500GB的文件夹。这是非常好的。

但是,我现在正在尝试同步一个7TB文件夹,它只是卡住了。它现在已经过了1小时,调试日志就停留在这里:

2018-06-01 18:05:05,983 - MainThread - botocore.args - DEBUG - The s3 config key is not a dictionary type, ignoring its value of: None
2018-06-01 18:05:05,987 - MainThread - botocore.endpoint - DEBUG - Setting s3 timeout as (60, 60)
2018-06-01 18:05:05,989 - MainThread - botocore.client - DEBUG - Registering retry handlers for service: s3
2018-06-01 18:05:05,989 - MainThread - botocore.client - DEBUG - Defaulting to S3 virtual host style addressing with path style addressing fallback.
2018-06-01 18:05:05,990 - MainThread - awscli.customizations.s3.s3handler - DEBUG - Using a multipart threshold of 8388608 and a part size of 8388608
2018-06-01 18:05:05,990 - MainThread - botocore.hooks - DEBUG - Event choosing-s3-sync-strategy: calling handler <bound method SizeOnlySync.use_sync_strategy of <awscli.customizations.s3.syncstrategy.sizeonly.SizeOnlySync object at 0x7f5f42a9acd0>>
2018-06-01 18:05:05,990 - MainThread - botocore.hooks - DEBUG - Event choosing-s3-sync-strategy: calling handler <bound method ExactTimestampsSync.use_sync_strategy of <awscli.customizations.s3.syncstrategy.exacttimestamps.ExactTimestampsSync object at 0x7f5f42a9a790>>
2018-06-01 18:05:05,990 - MainThread - botocore.hooks - DEBUG - Event choosing-s3-sync-strategy: calling handler <bound method DeleteSync.use_sync_strategy of <awscli.customizations.s3.syncstrategy.delete.DeleteSync object at 0x7f5f42a9aa50>>

cli是否无法列出所有文件并死掉?

0 个答案:

没有答案