Strfry: Difference between revisions
Jump to navigation
Jump to search
Line 36: | Line 36: | ||
cd strfry | cd strfry | ||
bzip2 -dc ../data/nostr-wellorder-early-500k-v1.jsonl.bz2 | ./strfry import | bzip2 -dc ../data/nostr-wellorder-early-500k-v1.jsonl.bz2 | ./strfry import | ||
</pre> | |||
Appears successful in 245 seconds: | |||
<pre> | |||
2023-10-08 03:28:56.082 ( 245.368s) [Writer ]INFO| Committed 5587. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups | |||
2023-10-08 03:28:56.082 ( 245.368s) [main thread ]INFO| Done. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups | |||
2023-10-08 03:28:56.086 ( 245.372s) [main thread ]INFO| atexit | |||
</pre> | </pre> |
Revision as of 03:29, 8 October 2023
Install
Base Server
ssh admin@52.11.172.130 sudo apt update && sudo apt dist-upgrade -y sudo apt install -y emacs-nox
Install
sudo apt install -y git build-essential libsecp256k1-dev libzstd-dev sudo apt install -y libyaml-perl libtemplate-perl libregexp-grammars-perl sudo apt install -y libssl-dev zlib1g-dev liblmdb-dev libflatbuffers-dev mkdir -p projects/nostr cd projects/nostr git clone https://github.com/hoytech/strfry.git cd strfry git submodule update --init make setup-golpe make -j4
Testing
Fetch the test data:
mkdir /home/admin/projects/nostr/data/ curl https://assets.wellorder.net/nostr/nostr-wellorder-early-500k-v1.jsonl.bz2 -o /home/admin/projects/nostr/data/nostr-wellorder-early-500k-v1.jsonl.bz2
Make a backup copy of Strfry
cd /home/admin/projects/nostr/ cp -r strfry bak.2023-10-07.01.strfry
Load the data into the live instance of Strfry
cd strfry bzip2 -dc ../data/nostr-wellorder-early-500k-v1.jsonl.bz2 | ./strfry import
Appears successful in 245 seconds:
2023-10-08 03:28:56.082 ( 245.368s) [Writer ]INFO| Committed 5587. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups 2023-10-08 03:28:56.082 ( 245.368s) [main thread ]INFO| Done. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups 2023-10-08 03:28:56.086 ( 245.372s) [main thread ]INFO| atexit