[Adminsysters] TECH INFRA - PREP UpGRADE - issue [mur.at #12287] backup

[mara]

Hi Ralf

we have started the adele backup but we are using the port 12347 as the 
one assigned for adele (12346) is not working.
can we have a new port opened for jean then? thank you!

mara on behalf of systerserver


On 2024-10-09 14:46, Ralph Wozelka via RT wrote:
> it looks like the transfers broke off pretty early in the process!
> 
>> murmin at hamster/backup/images/adelejean »ll
>> total 1,1G
>> -rw-rw-r-- 1 murmin murmin    0 Okt  3 17:53 adele01.img.lz4
>> -rw-rw-r-- 1 murmin murmin  350 Okt  4 23:40 jean01.img.lz4
>> -rw-rw-r-- 1 murmin murmin 1,1G Okt  3 15:32 test.img.lz4
>> murmin at hamster/backup/images/adelejean »
> 
> I will write a script which will loop back and restart the receiving
> server-side process!
> It will *keep* all files from previous attempts so that nothing can go
> amiss :-)
> it will name the backup files like "adele01.img.lz4.202410091415", ...
> and "jean01.img.lz4.202410091415", ...
> each new attempt will create a separate file! :-)
> 
> use the lines as before again to commence transfer:
> (I added -N for netcat so it will terminate after the end of file is
> reached. I noticed it just keeps going wailting for more input 
> otherwise)
> 
> for adele, port 12346: dd if=/dev/<your-dev-on-adele> | lz4 | pv | nc
> -N  hamster.mur.at 12346
> for jean, port 12347: dd if=/dev/<your-dev-on-jean> | lz4 | pv | nc -N
> hamster.mur.at 12347
> 
> 
> let me know how it goes!
> 
> so long,
> r
> 
> If the connection breaks it will restart the listening servers on the
> same tcp ports ready for transfar
> On 03.10.24 17:59, Ralph Wozelka | NOC - mur.at wrote:
>> 
>> I'll prepare for 2 separate transfers now!
>> install lz4 and pv on your servers.
>> 
>> try some transfer locally to make sure the tools work.
>> 
>> then you should run this line:
>> 
>> dd if=/dev/<your-dev-on-adele> | lz4 | pv | nc hamster.mur.at 12346
>> dd if=/dev/<your-dev-on-jean> | lz4 | pv | nc hamster.mur.at 12347
>> 
>> and I start 2 corresponding server on hamster *now*, which will store
>> the streams to local files there:
>> 
>> /backup/images/adelejean »nc -l -p 12346 | cat > adele01.img.lz4
>> /backup/images/adelejean »nc -l -p 12347 | cat > jean01.img.lz4
>> 
>> 
>> --> the server side is up and running *from now on* and you can start
>> your transfer whenever you're ready.
>> 
>> *note:*  the server processes will exit after your client terminates.
>> so if some error occurs on your side, I will need to restart the
>> server-side processes.
>> 
>> it is the fastest way of transferring the data via the local network
>> (it is not encrypted - so only good for our local network. it would be
>> a rather poor choice for across the public internet)
>> 
>> so long,
>> r
>> 
>> On 01.10.24 23:43, info at ooooo.be via RT wrote:
>>> Tue Oct 01 23:43:50 2024: Request 12287 was acted upon.
>>> Transaction: Correspondence added byinfo at ooooo.be
>>>         Queue: noc
>>>       Subject: TECH INFRA - PREP UpGRADE - issue [mur.at #12287] 
>>> backup
>>>         Owner: rwoz
>>>    Requestors:info at ooooo.be,mara at multiplace.org
>>>        Status: open
>>>   Ticket <URL:https://rt.mur.at/Ticket/Display.html?id=12287  >
>>> 
>>> 
>>> Hi  great for the enthousiasm.
>>> Is raw  disk spaec around 500 gig
>>> 
>>> $ df -h
>>> *adele */dev/md0p2      876G  167G  665G  21% /
>>> *jean* /dev/mapper/jean-data 875G  357G  474G  43% /
>>> 
>>> and do you have a little more explanation what you expect from us ?
>>> "/netcat socket on hamster"
>>> 
>>> 
>>> xm
>>> 
>>> sounds good
>>> On 30/09/2024 17:10, Ralph Wozelka via RT wrote:
>>>> hey systers!
>>>> 
>>>> how big are the disk(s)?
>>>> we could do it with netcat!
>>>> I'd open a netcat listening socket on hamster, our backup server, 
>>>> and
>>>> you could pipe the whole block device there via netcat...
>>>> 
>>>> so long,
>>>> r
>>>> 
>>>> On 16.09.24 18:20,info at ooooo.be   via RT wrote:
>>>>> Mon Sep 16 18:20:09 2024: Request 12287 was acted upon.
>>>>> Transaction: Ticket createdbyinfo at ooooo.be
>>>>>           Queue: noc
>>>>>         Subject: backup
>>>>>           Owner: Nobody
>>>>>      Requestors:info at ooooo.be
>>>>>          Status: new
>>>>>     Ticket<URL:https://rt.mur.at/Ticket/Display.html?id=12287 >
>>>>> 
>>>>> 
>>>>> hello mur.
>>>>> we write you / the technical support -
>>>>> cc Andreas
>>>>> to see if you can follow up our request?
>>>>> 
>>>>> on 12/09 we wrote ANdreas --
>>>>> 
>>>>> -------------------
>>>>> 
>>>>> Dear Andreas
>>>>> 
>>>>> hope you are doing well.
>>>>> We want to upgrade adele server, but our backup server has some 
>>>>> issues
>>>>> so we are wondering if mur could make a full disk backup for us?
>>>>> 
>>>>> -------------------
>>>>> 
>>>>> thanks for taking it in consideration
>>>>> xm
>>>>> 
>>>>> 
>>>>> 
>>>>> thanks xm
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>> --
>>     / NOC - mur.at
>>    / Network Operation Center / Systemadministration
>>   / +43 (0)681 816 45 308
>> / Di-Fr 12:00-14:00 (Support)