jobstatus lets you pass live progress, status, and other information between functions and processes in R, so that you can keep an eye on how complex and long-running jobs are progressing. jobstatus uses the future package so you can even get live progress information back from jobs running in parallel.

How it works

jobstatus passes status information between functions and processes in R so you can monitor what’s happening and how much progress the code has made. There are three main functions in jobstatus:

  • jobstatus creates a jobstatus object, which lets you record your progress on a single task
  • with_jobstatus runs a chunk of code that runs other jobs, and keeps track of the status information
  • subjob_future is a wrapper function for future::future that lets you write code that can be executed either in sequence or in parallel.

with_jobstatus can also be used to display the progress information, for example with a progress bar.

A jobstatus set up might look something like this:

Extensions

This is very much a work in progress and the current implementation is quite limited (and probably quite buggy). Ideally, we’d like it to support various different parallel backends and interfaces, handle other types of job status information, and provide different types of progress bars and displays.

This prototype was developed over two days at the 2018 rOpenSci unconference and the maintainers won’t have much time to extend and improve the package. We’d love to have help, so if you’re keen please let us know in the issues tracker!

Installation

You can install the development version from GitHub with: