ixRobotsPermissionGrantedFullURL -- Returns whether a directory or web page is indexable or not.
BooleanT ixRobotsPermissionGrantedFullURL(RobotsTxtParserT Parser, char *URL)
Parser -- A robots.txt parser with a robots.txt file loaded.
URL -- The directory and file specified in the URL.
BooleanTrue if the file is traversable and BooleanFalse otherwise.
ixRobotsPermissionGrantedFullURL will tell you whether you have permission from the web site administrator to download a web page or whether a directory is traversable. ixRobotsPermissionGrantedFullURL expects to receive the full URL including the host name, http://, etc. not simply the directory and file. For example, it expects as the URL argument something along the lines of "http://www.my.company.com/netresources/files/index.html" and not "/netresources/files/index.html". (Use ixRobotsPermissionGranted() to get permission for only a directory or filename). ixRobotsPermissionGrantedFullURL() returns BooleanTrue if you have permission to download a web page and BooleanFalse otherwise.
ixCreateRobotsTxtParser, ixDeleteRobotsTxtParser, ixSetRobotName, ixParseRobotsTxt, ixOutputCompactRobotsTxt, ixRobotsPermissionGranted, ixRobotsTxtLength