Sync: Difference between revisions
Jump to navigation
Jump to search
| Line 4: | Line 4: | ||
<pre> | <pre> | ||
rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/ | rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/ | ||
</pre> | |||
<pre> | |||
cd /opt/cypherpunk/data/reddit/json | |||
find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1"/ ./"$1"/"}' | find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1"/ ./"$1"/"}' | ||
</pre> | </pre> | ||
Revision as of 23:02, 25 September 2023
Rsync
From there to here
rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/
cd /opt/cypherpunk/data/reddit/json
find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1"/ ./"$1"/"}'
AWS S3 Sync
From here to there, with delete
aws s3 sync /path/to/remote/directory/ s3://your-s3-bucket-name/path/in/bucket/ --delete --size-only