Azure - AzCopy学习
使用 AzCopy 将本地数据迁移到云存储空间
-
azcopy login
- 创建存储账号
./azcopy login --tenant-id 40242385-c249-4746-95dc-4a0b64d49dc5- 这里的—tenant-id 在下面的地方查看:目录 ID;需要拥有Storage Blob Data Owner 的权限
- 账号下可能会有很多目录(tenant),所以在 login 的时候带上 —tenant-id

-
使用 azcopy copy 上传
azcopy copy 20230509_144654178_iOS.jpg https://eastorageaccountpg.blob.core.windows.net/private-pg修改文件名和 endpoint 即可。
如果使用 az 命令也可以打到效果
az storage blob upload -f 20230509_144654178_iOS.jpg -c blog-pg -n 20230509_144654178_iOS.jpg
AzCopy Sync 使用

1. azcopy sync,Client local Dir → EU:Blob/container/dir- Client未登录 Azure- blob 的 container 生成共享访问令牌,注意权限选择

Client 执行 azcopy sync 命令with SAS
root@ubuntu0:~# azcopy sync "./blog/" "https://eustoragesacc0.blob.core.windows.net/eucontainer?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D"INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob e08f5117-f8b7-314d-5aa3-3f22b0fdf82b has startedLog file is located at: /root/.azcopy/e08f5117-f8b7-314d-5aa3-3f22b0fdf82b.log100.0 %, 2 Done, 0 Failed, 0 Pending, 2 Total, 2-sec Throughput (Mb/s): 0.6465Job e08f5117-f8b7-314d-5aa3-3f22b0fdf82b SummaryFiles Scanned at Source: 2Files Scanned at Destination: 0Elapsed Time (Minutes): 0.0667Number of Copy Transfers for Files: 2Number of Copy Transfers for Folder Properties: 0 Total Number Of Copy Transfers: 2Number of Copy Transfers Completed: 2Number of Copy Transfers Failed: 0Number of Deletions at Destination: 0Total Number of Bytes Transferred: 423810Total Number of Bytes Enumerated: 423810Final Job Status: Completed
查看 Blob 情况

-
EA:blob/container/dir → EU:blob/container/dir
-
ea 源生成 SAS,注意权限

-
Client 执行 azcopy sync 命令with SAS
root@ubuntu0:~# azcopy sync "https://eastorageacc0.blob.core.windows.net/eacontainer/sync/?sp=rle&st=2023-07-21T12:42:42Z&se=2023-07-21T20:42:42Z&spr=https&sv=2022-11-02&sr=c&sig=%2FZzdp1B5dpZzTGT3PlwhssFKnipWkgp%2BBpOIqo9t1mY%3D" "https://eustoragesacc0.blob.core.windows.net/eucontainer/sync/?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D" INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 747202e5-1afc-b846-4388-9e2e4eee6c58 has started Log file is located at: /root/.azcopy/747202e5-1afc-b846-4388-9e2e4eee6c58.log100.0 %, 3 Done, 0 Failed, 0 Pending, 3 Total, 2-sec Throughput (Mb/s): 0 Job 747202e5-1afc-b846-4388-9e2e4eee6c58 Summary Files Scanned at Source: 3 Files Scanned at Destination: 0 Elapsed Time (Minutes): 0.1 Number of Copy Transfers for Files: 3 Number of Copy Transfers for Folder Properties: 0 Total Number Of Copy Transfers: 3 Number of Copy Transfers Completed: 3 Number of Copy Transfers Failed: 0 Number of Deletions at Destination: 0 Total Number of Bytes Transferred: 847620 Total Number of Bytes Enumerated: 847620 Final Job Status: Completed -
查看 Blob 情况

-
-
AzCopy copy 示例
azcopy copy "https://eascc20230728.blob.core.windows.net/local/1.txt?sp=racwli&st=2023-07-31T03:54:41Z&se=2023-08-31T11:54:41Z&spr=https&sv=2022-11-02&sr=c&sig=hRxFYgG3chofx1WUwlb0ji5wPuI%2BgA31DxUNZlPjAW4%3D" ./1.txt- 加上 token 要使用“”
- https://eascc20230728.blob.core.windows.net/local/1.txt 具体的 blob 还是目录要指定清楚
Blob bw Regions test

| 序号 | 说明 | 测试 1 | 测试 2 | 测试 3 | 平均值 |
|---|---|---|---|---|---|
| 1 | EA client → SA Container | 0.2334 | 0.2334 | ||
| 2 | SA Container → EU client | 1.0263 | 1.2675 | 1.0148 | 1.10286667 |
| 3 | SA Container → EU client @ peer created | 1.1209 | 1.2449 | 1.1483 | 1.17136667 |
| 4 | SA Container → EU Container | 4.1681 | 4.335 | 4.6351 | 4.3794 |
| 2 Hours Later | 1.4338 | 1.8673 | 1.65055 | ||
| 5 | EU Contaner → SA Container | 1.0003 | 0.9336 | 0.96695 | |
| 6 | EU client → EU Container | 0.767 | 0.7669 | 0.767 | 0.76696667 |
| 7 | EU Container → EU Client, VM disk iops limited | 0.8814 | 0.8814 | ||
| 8 | EA client →EU Container | 0.5335 | 0.7002 | 0.61685 | |
| 9 | EU container → EA container | 0.4001 | 0.4001 |
结论:
1. Client 跨Region 获取 Container 中文件,在 Blog 选择微软内网优先的情况下,Region间是否使用 Peer 对等对传输效率基本无影响;
2. Container 的文件直接跨 Region 传输效率与选择的 Region以及时机/方向 有关,一段时间保持稳定;
3. 同 Region 传输效率高;
原始数据
1. EA client → SA Containerroot@ubuntu0:/home/zyi# azcopy copy 1.zip https://sastorageac0.blob.core.windows.net/sacontainerINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob f631ebf2-8060-6b47-7164-58044ee0c43c has startedLog file is located at: /root/.azcopy/f631ebf2-8060-6b47-7164-58044ee0c43c.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job f631ebf2-8060-6b47-7164-58044ee0c43c summaryElapsed Time (Minutes): 0.2334Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed2. SA Container → EU clientroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob bf9d0ff0-6066-2140-4cb9-8716e4272028 has startedLog file is located at: /root/.azcopy/bf9d0ff0-6066-2140-4cb9-8716e4272028.log0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):6.2 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):11.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)15.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)20.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)24.6 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)29.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)33.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)38.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)42.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)46.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)51.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)55.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)59.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)64.4 %, 0 68.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1710.624 (Disk may be l73.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1845.0545 (77.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1440.6049 82.5 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job bf9d0ff0-6066-2140-4cb9-8716e4272028 summaryElapsed Time (Minutes): 1.0263Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#download 2root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 732e37c9-9e99-364a-4a4e-fa7484fac927 has startedLog file is located at: /root/.azcopy/732e37c9-9e99-364a-4a4e-fa7484fac927.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 732e37c9-9e99-364a-4a4e-fa7484fac927 summaryElapsed Time (Minutes): 1.2675Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#download 3^[[Aroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 05c9210a-e503-c046-6f9b-853d6c9a3c4e has startedLog file is located at: /root/.azcopy/05c9210a-e503-c046-6f9b-853d6c9a3c4e.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 05c9210a-e503-c046-6f9b-853d6c9a3c4e summaryElapsed Time (Minutes): 1.0148Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```3. SA Container → EU client @ peer created```powershellroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f has startedLog file is located at: /root/.azcopy/b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f summaryElapsed Time (Minutes): 1.1209Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#2root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob b646e5c1-af07-6c41-7a0c-641ecfd5d1cd has startedLog file is located at: /root/.azcopy/b646e5c1-af07-6c41-7a0c-641ecfd5d1cd.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job b646e5c1-af07-6c41-7a0c-641ecfd5d1cd summaryElapsed Time (Minutes): 1.2449Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completedroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 30f70c4e-fdd1-9a4b-6e89-c5e7406970de has startedLog file is located at: /root/.azcopy/30f70c4e-fdd1-9a4b-6e89-c5e7406970de.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 30f70c4e-fdd1-9a4b-6e89-c5e7406970de summaryElapsed Time (Minutes): 1.1483Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```1. SA Container → EU Container```powershellroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 9168f92f-2da4-6742-6862-8e5696b52a41 has startedLog file is located at: /root/.azcopy/9168f92f-2da4-6742-6862-8e5696b52a41.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 9168f92f-2da4-6742-6862-8e5696b52a41 summaryElapsed Time (Minutes): 4.1681Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completedroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zip INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 7cca86e8-11b6-164d-7b33-887d9cf10183 has startedLog file is located at: /root/.azcopy/7cca86e8-11b6-164d-7b33-887d9cf10183.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 7cca86e8-11b6-164d-7b33-887d9cf10183 summaryElapsed Time (Minutes): 4.335Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#3root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob c4366598-5822-b946-45b9-6ee9d6f6df15 has startedLog file is located at: /root/.azcopy/c4366598-5822-b946-45b9-6ee9d6f6df15.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job c4366598-5822-b946-45b9-6ee9d6f6df15 summaryElapsed Time (Minutes): 4.6351Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#4root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zipINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 15fe8cca-78c3-3d40-4a55-e90d11495258 has startedLog file is located at: /root/.azcopy/15fe8cca-78c3-3d40-4a55-e90d11495258.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 15fe8cca-78c3-3d40-4a55-e90d11495258 summaryElapsed Time (Minutes): 1.4338Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#5root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zipINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 2ac14c6f-f943-9c4b-7477-6947fd59ab31 has startedLog file is located at: /root/.azcopy/2ac14c6f-f943-9c4b-7477-6947fd59ab31.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 2ac14c6f-f943-9c4b-7477-6947fd59ab31 summaryElapsed Time (Minutes): 1.8673Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```2. EU Contaner → SA Container```powershellroot@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainerINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 8b6f339f-e23b-2f4e-755c-8bd336942b40 has startedLog file is located at: /root/.azcopy/8b6f339f-e23b-2f4e-755c-8bd336942b40.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 8b6f339f-e23b-2f4e-755c-8bd336942b40 summaryElapsed Time (Minutes): 1.0003Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#2root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainer/1.zipINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 0c1039f0-7a9f-0e44-6a42-079c03708fb8 has startedLog file is located at: /root/.azcopy/0c1039f0-7a9f-0e44-6a42-079c03708fb8.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 0c1039f0-7a9f-0e44-6a42-079c03708fb8 summaryElapsed Time (Minutes): 0.9336Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```1. EU client → EU Container```powershellroot@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob d3bdc10a-4142-8b41-7f9a-752c840c5f36 has startedLog file is located at: /root/.azcopy/d3bdc10a-4142-8b41-7f9a-752c840c5f36.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 623.3303Job d3bdc10a-4142-8b41-7f9a-752c840c5f36 summaryElapsed Time (Minutes): 0.767Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#2root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 3018151c-c777-ca42-4054-7f980de47650 has startedLog file is located at: /root/.azcopy/3018151c-c777-ca42-4054-7f980de47650.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 598.946 Job 3018151c-c777-ca42-4054-7f980de47650 summaryElapsed Time (Minutes): 0.7669Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#3root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip INFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 has startedLog file is located at: /root/.azcopy/33cf320d-94a5-aa48-5a35-b94d34cf5cc1.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 579.6335Job 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 summaryElapsed Time (Minutes): 0.767Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```2. EU Container → EU Client, VM disk iops limited```powershellroot@eu-ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 10.zipINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 038b5c4a-7376-094d-4e7c-c958e15378f8 has startedLog file is located at: /root/.azcopy/038b5c4a-7376-094d-4e7c-c958e15378f8.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 038b5c4a-7376-094d-4e7c-c958e15378f8 summaryElapsed Time (Minutes): 0.8814Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```1. EA client →EU Container```powershellroot@ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainerINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob e197a453-cd7d-9042-53bc-de6c0e26246c has startedLog file is located at: /root/.azcopy/e197a453-cd7d-9042-53bc-de6c0e26246c.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job e197a453-cd7d-9042-53bc-de6c0e26246c summaryElapsed Time (Minutes): 0.5335Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed#2root@ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zipINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 6b1b50a2-3c6c-9c45-5165-085514255e76 has startedLog file is located at: /root/.azcopy/6b1b50a2-3c6c-9c45-5165-085514255e76.log100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 6b1b50a2-3c6c-9c45-5165-085514255e76 summaryElapsed Time (Minutes): 0.7002Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```2. EU container → EA container```powershellroot@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://eastorageaccountpg.blob.core.windows.net/blog-pgINFO: Scanning...INFO: Autologin not specified.INFO: Authenticating to destination using Azure ADINFO: Authenticating to source using Azure ADINFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 04a69131-382f-3741-4263-c81b6e28c27e has startedLog file is located at: /root/.azcopy/04a69131-382f-3741-4263-c81b6e28c27e.logINFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, Job 04a69131-382f-3741-4263-c81b6e28c27e summaryElapsed Time (Minutes): 0.4001Number of File Transfers: 1Number of Folder Property Transfers: 0Number of Symlink Transfers: 0Total Number of Transfers: 1Number of File Transfers Completed: 1Number of Folder Transfers Completed: 0Number of File Transfers Failed: 0Number of Folder Transfers Failed: 0Number of File Transfers Skipped: 0Number of Folder Transfers Skipped: 0TotalBytesTransferred: 10519930170Final Job Status: Completed```
相关文章:
Azure - AzCopy学习
使用 AzCopy 将本地数据迁移到云存储空间 azcopy login 创建存储账号 ./azcopy login --tenant-id 40242385-c249-4746-95dc-4a0b64d49dc5这里的—tenant-id 在下面的地方查看:目录 ID;需要拥有Storage Blob Data Owner 的权限账号下可能会有很多目录&am…...
解决无法远程连接MySQL服务的问题
① 设置MySQL中root用户的权限: [rootnginx-dev etc]# mysql -uroot -pRoot123 mysql> use mysql; mysql> GRANT ALL PRIVILEGES ON *.* TO root% IDENTIFIED BY Root123 WITH GRANT OPTION; mysql> select host,user,authentication_string from user; -…...
mybatiplus代码生成器
目录 1.pom文件引入 2.引入模板引擎 3.注意 新版本,老版本配置和用法都不太一样,此处暂不展示;另外也可以尝试一下MyBatis-Flex 总之mybatisplus有的或者收费的,它都有MyBatis-Flex 是什么 - MyBatis-Flex 官方网站 1.pom文件…...
leetcode分类刷题:哈希表(Hash Table)(三、循环存在问题)
1、当需要快速判断某元素是否出现在序列中时,就要用到哈希表了。 2、本文针对的总结题型为给定的序列或需要构造的序列中是否存在循环,与 160. 相交链表、 141. 环形链表、142. 环形链表 II的题型一样。 202. 快乐数 这道题还考察如何对正整数求解各个位…...
43、基于 springboot 自动配置的 spring mvc 错误处理,就是演示项目报错后,跳转到自定义的错误页面
Spring MVC 的错误处理:基于 SpringBoot 自动配置之后的 Spring MVC 错误处理。 就是访问方法时出错,然后弄个自定义的错误页面进行显示。 ★ 两种错误处理方式 方式一: 基于Spring Boot自动配置的错误处理方式,只要通过属性文件…...
干货分享,现代列式数据库系统如何设计与实现? | StoneData 论文选读
作者:袁洋 | StoneData 技术架构师 审核:王博 论文链接:columnstoresfntdbs.pdf (harvard.edu) 列存四先驱和 MIT 知名教授 Samuel Madden 于 2013 年在某期刊上写的一篇当时列存相关技术的综述。文章还挺全面也很经典,通过剖析三…...
说说构建流批一体准实时数仓
分析&回答 基于 Hive 的离线数仓往往是企业大数据生产系统中不可缺少的一环。Hive 数仓有很高的成熟度和稳定性,但由于它是离线的,延时很大。在一些对延时要求比较高的场景,需要另外搭建基于 Flink 的实时数仓,将链路延时降低…...
北京筑龙受邀出席中物联“采购供应链中国行—走进雄安”活动
日前,“采购供应链中国行—走进雄安”活动在河北雄安新区成功举办,来自30家相关单位的50余名领导和代表参加了本次活动。活动由中国物流与采购联合会公共采购分会主办,中国物流与采购联合会采购委、中国雄安集团有限公司、河北雄安新区招标投…...
【Tkinter界面:练习-01】窗口-部件-布局
一、说明 python在用户界面开发中,其中有QT5,和Tkinter;对于实际项目,界面需要高大上,因此用QT5,对于开发人员的演示程序,或简单程序中,不建议QT5;用Tkinter已经足够。本…...
LeetCode每日一题:823. 带因子的二叉树(2023.8.29 C++)
目录 823. 带因子的二叉树 题目描述: 实现代码与解析: dp hash 原理思路: 823. 带因子的二叉树 题目描述: 给出一个含有不重复整数元素的数组 arr ,每个整数 arr[i] 均大于 1。 用这些整数来构建二叉树&#x…...
【教学类-35-01】学号+姓名+班级(描字帖)A4一页
背景说明: 本学期我带机动班,其中大4班去的频率比较高,与是我用大四班的名单做了一份 “描字帖”,在9月1日第一天见面时,孩子们用记号笔描字帖时,我也可以对这些孩子初步混个眼熟(聪明的&#x…...
UE5 里的一些常用的了解
# ACharacter、APawn的继承关系 ACharacter -继承自-> APawn -继承自-> AActor和 INavAgentInterface AActor -继承自-> UObject -继承自->UObjectBaseUtility -继承自-> UObjectBase(一个独立的类)INavAgentInterface是一个独立的类 #…...
【网络安全带你练爬虫-100练】第19练:使用python打开exe文件
目录 一、目标1:调用exe文件 二、目标2:调用exe打开文件 一、目标1:调用exe文件 1、subprocess 模块允许在 Python 中启动一个新的进程,并与其进行交互 2、subprocess.run() 函数来启动exe文件 3、subprocess.run(["文件路…...
【2D/3D RRT* 算法】使用快速探索随机树进行最佳路径规划(Matlab代码实现)
💥💥💞💞欢迎来到本博客❤️❤️💥💥 🏆博主优势:🌞🌞🌞博客内容尽量做到思维缜密,逻辑清晰,为了方便读者。 ⛳️座右铭&a…...
用反射实现自定义Java对象转化为json工具类
传入一个object类型的对象获取该对象的class类getFields方法获取该类的所有属性对属性进行遍历,并且拼接成Json格式的字符串,注意:通过属性名来推断方法名获取Method实例通过invoke方法调用 public static String objectToJsonUtil(Object o…...
rk3568 nvme硬盘分区,格式化,挂载测试
前言 环境介绍: 1.编译环境 Ubuntu 18.04.5 LTS 2.SDK rk356x_linux 3.单板 迅为itop-3568开发板 自制底板 一、查看硬盘 插上硬盘上电,进入系统后通过命令lspci查看nvme硬盘识别情况 [rootRK356X:/]# lspci -k 21:00.0 Class 0108: 1e4b:1202…...
Failed to load ApplicationContext解决办法,spring版本问题
有如下报错: "D:\Program Files\Java\jdk-13.0.1\bin\java.exe" -agentlib:jdwptransportdt_socket,address127.0.0.1:7325,suspendy,servern -ea -Didea.test.cyclic.buffer.size1048576 -Dfile.encodingUTF-8 -classpath "D:\Program Files\JetBr…...
Is f(z)=1/z truly an analytic function
https://math.stackexchange.com/questions/755566/is-fz-1-z-truly-an-analytic-function...
代理模式 静态代理和动态代理(jdk、cglib)——Java入职第十一天
一、代理模式 一个类代表另一个类去完成扩展功能,在主体类的基础上,新增一个代理类,扩展主体类功能,不影响主体,完成额外功能。比如买车票,可以去代理点买,不用去火车站,主要包括静态代理和动态代理两种模式。 代理类中包含了主体类 二、静态代理 无法根据业务扩展,…...
Remmina在ubuntu22.04中无法连接Windows
Remmina在ubuntu22.04中无法连接Windows 问题 提示为: 无法通过TLS到RDP服务器… 分析 原因是Remmina需要使用openssl通过RDP加密与Windows计算机连接,而ubuntu22.04系统中OpenSSL版本为3.0,Openssl3 将 tls<1.2 和 sha1 的默认安全级别…...
别再硬啃旧SDK了!用Unity 2021.3 + OpenXR搞定Vive Pro Eye眼动数据采集(附避坑指南)
现代VR眼动追踪开发指南:Unity 2021.3与OpenXR实战 在VR技术快速迭代的今天,眼动追踪已成为提升沉浸感的关键技术。Vive Pro Eye作为行业标杆设备,其开发方式正经历从私有SDK到开放标准的重大转变。本文将带你跨越技术代沟,掌握基…...
C++lambda表达式深入解析
Clambda表达式深入解析lambda表达式是C11引入的匿名函数特性,它提供了一种简洁的方式来定义内联函数对象,特别适合用于STL算法和回调函数。lambda表达式的基本语法包括捕获列表、参数列表、返回类型和函数体。#include #include #include #includevoid b…...
软件测试行业的技术创新:有哪些新兴技术将影响测试行业
一、AI驱动的智能测试:从辅助工具到核心引擎在2026年的软件测试领域,人工智能已经从概念验证阶段全面迈入深度落地期,成为驱动测试效能提升的核心引擎。AI驱动的智能测试正在从多个维度重构传统测试范式。(一)自动化测…...
仅剩47套!2024巴洛克风格LoRA微调模型包(附11种教堂穹顶材质映射参数表)
更多请点击: https://kaifayun.com 第一章:巴洛克美学的数字重生:LoRA微调模型包发布宣言 当黄金比例遇见梯度下降,当繁复雕花邂逅低秩矩阵分解——巴洛克精神在AI时代迎来一场静默而磅礴的复兴。本次发布的 LoRA 微调模型包并非…...
Python EXE逆向工程完全指南:使用python-exe-unpacker快速反编译打包程序
Python EXE逆向工程完全指南:使用python-exe-unpacker快速反编译打包程序 【免费下载链接】python-exe-unpacker A helper script for unpacking and decompiling EXEs compiled from python code. 项目地址: https://gitcode.com/gh_mirrors/py/python-exe-unpa…...
RUST编程学习.2语法
目录 前言 一、思维导图 二、Rust语法专属 1.迭代器 2.生命周期 总结 前言 在进行编译器下载后,就可以写代码进行编译调试了,在这之前就是要学习rust语法,在学习的过程中我整理了一版思维导图,最直观的感觉就是rust的语法很…...
都在喊难,它却狂赚!深度扒开长鑫科技底牌:什么才是决定生死的产业势?
2026年的商业世界,正在经历一场冰火两重天的考验。 一边,是无数传统企业在需求萎缩、价格内卷的泥潭里苦苦挣扎,老板们每天为了几毛钱的利润拼得头破血流;而另一边,一份堪称“核弹级”的财报,直接炸翻了整个…...
Linux内核调试利器:/proc/sysrq-trigger原理与实战指南
1. 内核调试的“后门”:/proc/sysrq-trigger 深度解析在Linux内核开发和系统调试的深水区,当系统完全无响应、键盘鼠标失灵,甚至SSH连接都彻底中断时,常规的调试手段往往束手无策。这时,一个隐藏在/proc文件系统中的特…...
突破内存瓶颈:HBM、CXL与GPU新部署策略
训练生成式AI模型本身已是一项成本高昂、能耗巨大的工作。随着超大规模数据中心和前沿研究机构竞相扩展边缘推理与智能体AI能力,GPU的部署正变得愈加复杂,尤其是在内存层面。在数据中心中,对先进内存配置的需求日益迫切。不断增多的AI处理器正…...
2026 最新 Web 安全入门教程 零基础全面吃透 Web 攻防
“未知攻,焉知防”——真正的安全始于理解攻击者的思维 在日益数字化的世界中,Web安全工程师已成为企业防护体系的“数字盾牌”。本文将提供一条清晰的进阶路径,助你在2025年的网络安全领域脱颖而出。 一、认知篇:理解安全本质 …...
