Firehawk52-backup/Myrient-Search-Engine
28
0
Fork 0
mirror of https://github.com/alexankitty/Myrient-Search-Engine.git synced 2026-01-15 16:33:15 -03:00
Code Issues Packages Projects Releases Wiki Activity

Added settings to allow for memory efficiency

Browse Source
This commit is contained in:
Alexandra
2024-10-23 02:11:40 -06:00
parent 840ff31431
commit f58eca20c7
5 changed files with 156 additions and 121 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
.env
View File

@@ -1,5 +1,11 @@
PORT=8062
BIND_ADDRESS=0.0.0.0
FORCE_FILE_REBUILD=0
FORCE_FILE_REBUILD=1
DEBUG=0
NODE_ENV=production
NODE_ENV=production
# Memory Impacting Settings - Trades for threading efficiency. Much slower, but should be useful for limited memory environments like VPS
# May also decrease 504 failure rates
# Changes the maximum number of jobs the crawler can queue. Setting it too high will cause a call stack overflow
MAX_JOB_QUEUE=1000
# Changes the maximum number of pages that can be fetched for parsing. Has a massive impact on memory usage. Setting to 12 results in about 1.1GiB memory usage
MAX_FETCH_JOBS=1000