Ceph与Bacula运维实战：数据迁移与备份配置优化指南

#作者：猎人

1ceph数据迁移&&bacula配置调整

1.1ceph数据迁移&&bacula配置调整

为了规避因单个OSD利用率达90%而导致整个集群错误无法访问，ceph集群现已在原ceph块设备的基础上建立了cephfs文件系统用于存储数据，需要把原备份到块设备上的设备迁移到新建的cephfs上，迁移完毕后把ceph rbd回收，后续所有的备份数据直接写到cephfs。

• rbd分配的指定空间满了之后需要新创建，cephpfs的空间可以横向扩容，也可以避免单个OSD引起集群故障

1.2在备份服务器的ceph-client上mount cephfs文件系统

• T机房（1xx.xxx.xxx.x3）：ceph-fuse -m 1x.xxx.xx.x9:6789 -r /tt_bacula /cephfs/
• Y机房（1x.xxx.xx.x1）：ceph-fuse -m 1x.xxx.xx.51:6789 /cephfs/

1.2.1迁移数据

• T：/data1/backup_disk0*/下的数全部数据迁移到/cephfs/tt_bacula/backup_disk0*/
• Y：/data1/backup_disk0*/下的数全部数据迁移到/cephfs/yz_bacula/backup_disk0*/
  特别注意：在做数据恢复的时候需要把数据还原到原/data1/backup_disk0*/下才能恢复数据

1.2.2调整bacula-sd配置

1.2.2.1T机房:
bacula-sd.conf中添加7个Device FileChgr8/9/10/11/12/13/14分别指向/cephfs/tt_bacula/下的7个目录
bacula-sd.conf新加配置如下：

Autochanger {Name = FileChgr8Device = FileChgr8-Dev1, FileChgr8-Dev2Changer Command = ""Changer Device = /dev/null
}
Device {Name = FileChgr8-Dev1Media Type = File8Archive Device = /cephfs/tt_bacula/backup_disk03/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
Device {Name = FileChgr8-Dev2Media Type = File8Archive Device = /cephfs/tt_bacula/backup_disk03/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}Autochanger {Name = FileChgr9Device = FileChgr9-Dev1, FileChgr9-Dev2Changer Command = ""Changer Device = /dev/null
}
Device {Name = FileChgr9-Dev1Media Type = File9Archive Device = /cephfs/tt_bacula/backup_disk01/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
Device {Name = FileChgr9-Dev2Media Type = File9Archive Device = /cephfs/tt_bacula/backup_disk01/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}Autochanger {Name = FileChgr10Device = FileChgr10-Dev1, FileChgr10-Dev2Changer Command = ""Changer Device = /dev/null
}
Device {Name = FileChgr10-Dev1Media Type = File10Archive Device = /cephfs/tt_bacula/backup_disk02/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
Device {Name = FileChgr10-Dev2Media Type = File10Archive Device = /cephfs/tt_bacula/backup_disk02/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}Autochanger {Name = FileChgr11Device = FileChgr11-Dev1, FileChgr11-Dev2Changer Command = ""Changer Device = /dev/null
}
Device {Name = FileChgr11-Dev1Media Type = File11Archive Device = /cephfs/tt_bacula/backup_disk04/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
Device {Name = FileChgr11-Dev2Media Type = File11Archive Device = /cephfs/tt_bacula/backup_disk04/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}Autochanger {Name = FileChgr12Device = FileChgr12-Dev1, FileChgr12-Dev2Changer Command = ""Changer Device = /dev/null
}
Device {Name = FileChgr12-Dev1Media Type = File12Archive Device = /cephfs/tt_bacula/backup_disk05/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
Device {Name = FileChgr12-Dev2Media Type = File12Archive Device = /cephfs/tt_bacula/backup_disk05/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}Autochanger {Name = FileChgr13Device = FileChgr13-Dev1, FileChgr13-Dev2Changer Command = ""Changer Device = /dev/null
}
Device {Name = FileChgr13-Dev1Media Type = File13Archive Device = /cephfs/tt_bacula/backup_disk06/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
Device {Name = FileChgr13-Dev2Media Type = File13Archive Device = /cephfs/tt_bacula/backup_disk06/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}Autochanger {Name = FileChgr14Device = FileChgr14-Dev1, FileChgr14-Dev2Changer Command = ""Changer Device = /dev/null
}
Device {Name = FileChgr14-Dev1Media Type = File14Archive Device = /cephfs/tt_bacula/backup_disk07/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
Device {Name = FileChgr14-Dev2Media Type = File14Archive Device = /cephfs/tt_bacula/backup_disk07/LabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 10
}
1.2.2.2Y机房:
bacula-sd.conf中添加1个Device FileChgr3分别指向/cephfs/yz_bacula/目录
bacula-sd.conf新加配置如下：
Autochanger {Name = FileChgr3Device = FileChgr3-Dev1, FileChgr3-Dev2Changer Command = ""Changer Device = /dev/null
}Device {Name = FileChgr3-Dev1Media Type = File3Archive Device = /cephfs/yz_baculaLabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 5
}Device {Name = FileChgr3-Dev2Media Type = File3Archive Device = /cephfs/yz_baculaLabelMedia = yes;                   # lets Bacula label unlabeled mediaRandom Access = Yes;AutomaticMount = yes;               # when device opened, read itRemovableMedia = no;AlwaysOpen = no;Maximum Concurrent Jobs = 5
}

1.2.2.3调整bacula-dir配置

1. 把前面新添加的7个SD加到bacula-dir.conf中
2. T机房：把原来Job中的 Storage 都换成对应新建的Storage，例如原Storage = tiantan-ceph-sd7（/data1/backup_disk07/）替换成现在Storage = tiantan-ceph-sd14（/cephfs/tt_bacula/backup_disk07/）
3. Y机房：把原来Job中的 Storage 都换成对应新建的Storage = yizhuang-ceph-sd3（亦庄把yizhuang-ceph-sd1和yizhuang-ceph-sd2在此做一个合并，合并到yizhuang-ceph-sd3）
   bacula-dir.conf新加配置如下：

Storage {Maximum Concurrent Jobs = 10Name = tiantan-ceph-sd8SDPort = 9103Address = xxxxxxxxDevice = FileChgr8Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File8
}
Storage {Maximum Concurrent Jobs = 10Name = tiantan-ceph-sd9SDPort = 9103Address = xxxxxxxxDevice = FileChgr9Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File9
}
Storage {Maximum Concurrent Jobs = 10Name = tiantan-ceph-sd10SDPort = 9103Address = xxxxxxxxDevice = FileChgr10Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File10
}
Storage {Maximum Concurrent Jobs = 10Name = tiantan-ceph-sd11SDPort = 9103Address = xxxxxxxxDevice = FileChgr11Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File11
}
Storage {Maximum Concurrent Jobs = 10Name = tiantan-ceph-sd12SDPort = 9103Address = xxxxxxxxDevice = FileChgr12Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File12
}
Storage {Maximum Concurrent Jobs = 10Name = tiantan-ceph-sd13SDPort = 9103Address = xxxxxxxxDevice = FileChgr13Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File13
}
Storage {Maximum Concurrent Jobs = 10Name = tiantan-ceph-sd14SDPort = 9103Address = xxxxxxxxDevice = FileChgr14Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File14
}
Storage {Maximum Concurrent Jobs = 10Name = yizhuang-ceph-sd3SDPort = 9103Address = xxxDevice = FileChgr3Password = "TFDkggO6cIG/PL6P4mRYHjlBvAjckn2eOd7f5l5Zn32o"Media Type = File3
}