Skip to contents

Authors

  • Pedro Baltazar. Contributor.

  • Jordan Bradford. Maintainer.

  • Peter Meissner. Author.

  • Kun Ren. Author, copyright holder.
    Author and copyright holder of list_merge.R.

  • Oliver Keys. Contributor.
    original release code review

  • Rich Fitz John. Contributor.
    original release code review

Citation

Source: DESCRIPTION

Meissner P, Ren K (2024). robotstxt: A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker. R package version 0.7.15.9000, https://github.com/ropensci/robotstxt, https://docs.ropensci.org/robotstxt/.

@Manual{,
  title = {robotstxt: A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker},
  author = {Peter Meissner and Kun Ren},
  year = {2024},
  note = {R package version 0.7.15.9000, https://github.com/ropensci/robotstxt},
  url = {https://docs.ropensci.org/robotstxt/},
}