Preferences
The Preferences dialog allows you to configure basic settings of the application.
- URL queue limit
-
Due to the nature of the Internet, it is possible for an unrestricted search to run forever, which would inevitably lead to exhausting the systems resources.
To help prevent this, the URL queue limit allows you to set a maximum number of URLs to hold in queue, waiting to be scanned.
As soon as Email Grabber reaches this limit it will stop accepting all new URLs if they would cause the queue size to exceed this value.
- Number of retries
-
This value controls how many times Email Grabber should retry connecting to a URL that is failing to respond.
- Timeout
-
This value determines the number of seconds Email Grabber should wait for a web site to respond before giving up on that specific request.
- Server overload protection
-
This setting actually slows down your search on purpose.
It does it to prevent Email Grabber from making an excessive number of connections to the same web server.
It determines the number of seconds Email Grabber should wait before making two consecutive requests to the same web server.
You can remove the setting by setting it to 0, but we do not recommend it.
Keep in mind that you must respect the terms and conditions of any web site you scan and making an excessive number of connections to a web site is often considered a violation of the terms and conditions.
- Maximum file size (KB)
-
This setting allows you to prevent Email Grabber from downloading files with excessive size and possibly irrelevant content.
Although Email Grabber should only try to scan text or HTML files, it is possible in some specific cases for the software to download files listed on web sites.
This setting will make Email Grabber stop scanning any URL that exceeds this configured size, in KB.
- Basic javascript processing
-
Some obfuscation methods use javascript to dynamically write the email address on the appropriate place.
Using this option, Email Grabber will process inline blocks of javascript in an attempt to decode obfuscated email addresses.
This option may increase the processing effort for each URL slightly.
- User Agent
-
When software fetches a page from a web server, it should send a special header called the User Agent which is used to identify the software making the request.
Sometimes servers use this information as a method to detect which browser the user is using and can send different content based on this value.
Using this option, you can tell Email Grabber what User Agent to use on the requests it makes.
The default value is a good one so change it only if you have a good reason to do so.