Enabling Crawler on LiteSpeed

Create a configuration file at /etc/apache2/vhosts-resources/<site_name>/crawler.conf with the following contents:

<IfModule LiteSpeed>
  CacheEngine on crawler
</IfModule>

Once the file is created, restart LiteSpeed web server:

service lshttpd restart