Sync: Difference between revisions

From Traxel Wiki
Jump to navigation Jump to search
 
(3 intermediate revisions by the same user not shown)
Line 4: Line 4:
<pre>
<pre>
rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/
rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/
7766956 ./discussion
</pre>
ls discussion/lifeprotips/2023-09/| wc -l
 
139
<pre>
bob@2020gamer:/opt/cypherpunk/data/reddit/json$ du discussion/lifeprotips/2023-09/
cd /opt/cypherpunk/data/reddit/json
6804 discussion/lifeprotips/2023-09/
find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1"/ ./"$1"/"}'
find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1" ./"$1}'
</pre>
</pre>


Line 17: Line 16:
aws s3 sync /path/to/remote/directory/ s3://your-s3-bucket-name/path/in/bucket/ --delete --size-only
aws s3 sync /path/to/remote/directory/ s3://your-s3-bucket-name/path/in/bucket/ --delete --size-only
</pre>
</pre>
= Backup Drives =
<pre>
rsync -navz --size-only --delete /media/bob/Seagate\ Backup\ Plus\ Drive/Media/ /media/bob/Seagate\ Portable\ Drive/Media/
</pre>
Remove -n for live fire.

Latest revision as of 16:03, 10 November 2023

Rsync

From there to here

rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/
cd /opt/cypherpunk/data/reddit/json
find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1"/ ./"$1"/"}'

AWS S3 Sync

From here to there, with delete

aws s3 sync /path/to/remote/directory/ s3://your-s3-bucket-name/path/in/bucket/ --delete --size-only

Backup Drives

rsync -navz --size-only --delete /media/bob/Seagate\ Backup\ Plus\ Drive/Media/ /media/bob/Seagate\ Portable\ Drive/Media/

Remove -n for live fire.