Skip to contents

Extract HTTP useragents from robots.txt

Source: R/rt_get_useragent.R
rt_get_useragent.Rd

Extract HTTP useragents from robots.txt

Usage

rt_get_useragent(txt)

Arguments

txt

content of the robots.txt file