Sync

Rsync

From there to here

rsync -avz --size-only --delete user@remote_host:/path/to/remote/directory/ /path/to/local/directory/

cd /opt/cypherpunk/data/reddit/json
find discussion -name '2023-09' -type d | awk '{print "rsync -avz --size-only --delete www.iterativechaos.com:/opt/cypherpunk/data/reddit/json/"$1"/ ./"$1"/"}'

AWS S3 Sync

From here to there, with delete

aws s3 sync /path/to/remote/directory/ s3://your-s3-bucket-name/path/in/bucket/ --delete --size-only