R/tools.R
rt_list_rtxt.Rd
list robots.txt files saved along with the package: these functions ar very handy for testing (not used otherwise)
rt_list_rtxt()