Strfry: Difference between revisions

From Traxel Wiki
Jump to navigation Jump to search
Line 36: Line 36:
cd strfry
cd strfry
bzip2 -dc ../data/nostr-wellorder-early-500k-v1.jsonl.bz2 | ./strfry import
bzip2 -dc ../data/nostr-wellorder-early-500k-v1.jsonl.bz2 | ./strfry import
</pre>
Appears successful in 245 seconds:
<pre>
2023-10-08 03:28:56.082 ( 245.368s) [Writer          ]INFO| Committed 5587. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups
2023-10-08 03:28:56.082 ( 245.368s) [main thread    ]INFO| Done. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups
2023-10-08 03:28:56.086 ( 245.372s) [main thread    ]INFO| atexit
</pre>
</pre>

Revision as of 03:29, 8 October 2023

Install

Base Server

ssh admin@52.11.172.130
sudo apt update && sudo apt dist-upgrade -y
sudo apt install -y emacs-nox

Install

sudo apt install -y git build-essential libsecp256k1-dev libzstd-dev
sudo apt install -y libyaml-perl libtemplate-perl libregexp-grammars-perl
sudo apt install -y libssl-dev zlib1g-dev liblmdb-dev libflatbuffers-dev
mkdir -p projects/nostr
cd projects/nostr
git clone https://github.com/hoytech/strfry.git
cd strfry
git submodule update --init
make setup-golpe
make -j4

Testing

Fetch the test data:

mkdir /home/admin/projects/nostr/data/
curl https://assets.wellorder.net/nostr/nostr-wellorder-early-500k-v1.jsonl.bz2 -o /home/admin/projects/nostr/data/nostr-wellorder-early-500k-v1.jsonl.bz2

Make a backup copy of Strfry

cd /home/admin/projects/nostr/
cp -r strfry bak.2023-10-07.01.strfry

Load the data into the live instance of Strfry

cd strfry
bzip2 -dc ../data/nostr-wellorder-early-500k-v1.jsonl.bz2 | ./strfry import

Appears successful in 245 seconds:

2023-10-08 03:28:56.082 ( 245.368s) [Writer          ]INFO| Committed 5587. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups
2023-10-08 03:28:56.082 ( 245.368s) [main thread     ]INFO| Done. Processed 500000 lines. 495122 added, 4878 rejected, 0 dups
2023-10-08 03:28:56.086 ( 245.372s) [main thread     ]INFO| atexit