Myrient Search Engine

It is finally here. There is now a way to search all of Myrient's offerings. Myrient Search can be accessed by clicking the link.

Resource Requirements

• Requires at least 1.1GB worth of memory to complete the crawl
• Requires roughly 2.1GB worth of memory to complete indexing. Once done idle memory usage is about 1.1GB. Consider using swap in a low memory environment.

Self-Hosting

Docker Method (Recommended)

Requirements

• Docker
• Docker Compose

Instructions

1. Download the docker-compose.yml file
2. Start the server with docker-compose up -d

Manual Method (Development)

Requirements

• nodejs
• npm

Instructions

1. Clone the repository. git clone https://github.com/alexankitty/Myrient-Search-Engine
2. Install dependencies. npm i
3. Start the server. node server.js

HTTPS Encryption

Use something like nginx and add a site to sites-available called myrient-search in /etc/ngix/sites-available. Link the site to the sites-enabled folder. ln -sf /etc/nginx/sites-available/myrient-search /etc/nginx/sites-enabled/myrient-search

nginx Site Template

server {
    listen 80;
    listen [::]:80;

    server_name server address.tld
    root /usr/share/nginx
    access_log on;
}

#server {

    listen 443 ssl http2;
    listen [::]:443 ssl http2;

    server_name serveraddress.tld;
    access_log on;

    root /usr/share/nginx;

    location / {
        add_header Cache-Control no-cache;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-Proto $scheme;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header Host $http_host;
        proxy_pass http://127.0.0.1:8062/;
    }

}

SSL Certificate

For the SSL certificate you can use certbot via the certbot -d servername.tld command and adding it to your crontab. Additional Information for Certbot Setup

Contributing

You know the usual fluff. Is there a missing category or string association? lib/categories.json and lib/searchalikes.json can both updated to include these. If you do update/improve these, please put in a pull request so that it can be added to the public hosted server, as well.