Sync

From Traxel Wiki
Jump to navigation Jump to search

Rsync

From there to here

rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/
7766956	./discussion
ls discussion/lifeprotips/2023-09/| wc -l
139
bob@2020gamer:/opt/cypherpunk/data/reddit/json$ du discussion/lifeprotips/2023-09/
6804	discussion/lifeprotips/2023-09/
find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1" ./"$1}'

AWS S3 Sync

From here to there, with delete

aws s3 sync /path/to/remote/directory/ s3://your-s3-bucket-name/path/in/bucket/ --delete --size-only