nodbi 0.10.2
CRAN release: 2024-02-24
nodbi 0.10.1
CRAN release: 2024-02-04
Bug fix
- make
docdb_get()work again forsrc_sqlite()by castingJSONBback toJSON
nodbi 0.10.0
CRAN release: 2024-01-21
Deprecated
- empty parameter
querynow triggers a warning as it should be a valid JSON string; changequery = ""intoquery = "{}"
Changes
- adapted to use new, faster
JSONBfunctions inSQLite3.45.0 (RSQLite>= 2.3.4.9005) - refactored parts of
docdb_create()to speed up handling large data frames and lists - made Elasticsearch to immediately refresh index after
docdb_create()and other functions -
docdb_update()now reports which records failed to update and then continues -
docdb_delete()now returns harmonised success logical value across backends
Potentially breaking change
docdb_query() reimplementation to have the same functionality across all databases (DuckDB, SQLite, PostgreSQL, MongoDB, Elasticsearch, CouchDB); even though the API and unit tests remained, user provisions may break e.g. to handle return values of databases that previously were incompletely implemented (in particular Elasticsearch and CouchDB). Details:
-
querycan now be complex (nested, various operators) and is digested with a Javascript helper -
fieldscan now be nested fields (e.g.,friends.name) to directly return values lifted from the nested field -
listfieldsparameter newly implemented to return dot paths for all fields of all or selected documents in collection - expanded use of
jqviajqrfor mangling parameters, selecting documents, filtering fields and lifting nested field values - if no data are found, returns
NULL(previously some backends returned an empty data frame) -
docdb_query(src, key, query = "{}", fields = "{}")now delegates todocdb_get(src, key) -
_idis always returned, unless specified with"_id": 0in parameterfields - for
scr_postgres, only fewer than 50 fields if any can be specified infields - for
src_sqlite, minimise the use of the time-costlyjson_tree - workaround for path collisions of MongoDB
- some acceleration of
docdb_query() - factored out common code
- expanded testing
- updated docs
nodbi 0.9.7
CRAN release: 2023-09-17
Changes
- changed
docdb_update()to directly use NDJSON from file for duckdb - cleaned up unnecessary code in
docdb_create() - no more using transactions with
src_duckdb()
Bug fixes
- regression error from not specifying top-level jq script
- corrected and improve field selection in
docdb_query() - corrected test exceptions for mongodb, updated GitHub Actions, expanded tests
nodbi 0.9.6
CRAN release: 2023-08-07
Bug fixes
- corrected marginal case in
docdb_query.src_duckdb() - corrected minimum R version
- replaced in tests
httpbinwithwebfakes - removed explicit UTF-8 encoding reference
- speed up in
docdb_query() - switched to v2 GitHub r-lib/action for R CMD check
nodbi 0.9.3
CRAN release: 2023-04-23
Changes
-
docdb_update()now can do bulk updates when _id’s are invalue(for SQLite, DuckDB, PostgreSQL, MongoDB; not yet for CouchDB and Elastic)
nodbi 0.9.2
CRAN release: 2023-03-26
Bug fixes
-
src_duckdb()handles when json_type returns NULL for non-existing path -
src_sqlite()handles when text includes double quotation marks
Changes
- added warning if DuckDB’s JSON extension is not available; improve instructions; see also issue #45
- minor simplification of
docdb_exists()forsrc_mongo(), and ofdocdb_query()for SQL databases
nodbi 0.9.1
CRAN release: 2022-11-20
Changes
- corrected closing connections to SQL database backends upon session restart
- improved provisions for parallel write access and corresponding tests
- capture marginal case of no rows in
docdb_query()
nodbi 0.7.1
CRAN release: 2022-05-04
Bug fixes
- fixed
docdb_query()to account for change in SQLite 3.38.3 adding quotation of labels (closes issue #44), test added - made
docdb_query()work for PostgreSQL when a string used with the$inoperator has a comma(s), test added
nodbi 0.7.0
CRAN release: 2022-01-04
Improvements
-
docdb_create()now supports file names and http urls as argumentvaluefor importing data -
docdb_create()(and thusdocdb_update()) now supports quantifiers (e.g., ‘[a-z]{2,3}’) in regular expressions
Bug fixes
- for SQLite, return
FALSElike other backends when usingdocdb_delete()for a non-existing container (table, in the case of SQLite) - better handle special characters and encodings under Windows
nodbi 0.5.0
CRAN release: 2021-11-21
Improvements
- identical API for
docdb_*()functions so thatqueryandfieldsparameters can be used across database backends - identical return values across database backends
- re-factored recently added functions for RSQLite
- re-factored most functions to provide identical API
- performance (timing and memory use) profiled and optimised as far as possible
- testing now uses the same test file across databases
- currently, no more support for redis (no way was found to query and update specific documents in a container)
-
docdb_list()added as function to list container in database
nodbi 0.4.4
Improvements
- made remaining
docdb_*()functions return a logical indicating the success of the function (docdb_create,docdb_delete), or a data frame (docdb_get,docdb_query), or the number of documents affected by the function (docdb_update) - change testing approach
Bug fixes
-
docdb_get()to not return ’_id’ field forsrc_{sqlite,mongo}since already used for row names
nodbi 0.4.3
CRAN release: 2021-07-23
Improvements
-
docdb_query.src_sqlite()now handles JSON objects, returning nested lists (#40) -
src_sqlite()now uses transactions for relevant functions (#39) -
docdb_update.src_mongo()now returns the number of upserted or matched documents, irrespective of whether they were updated or not
Bug fixes
-
docdb_get()to not return ’_id’ field forsrc_{sqlite,mongo}since already used for row names
nodbi 0.4.2
CRAN release: 2021-01-14
Bug fixes
- fix for
src_couchdb(): we were not setting user and password correctly internally, was causing issues in CouchDB v3 (#35) thanks to @drtagkim for the pull request
nodbi 0.4.0
CRAN release: 2019-11-11
Improvements
- in
docdb_query()anddocdb_get(), for sqlite source, use a connection instead of a regular file path to avoid certain errors on Windows (#33) work by @rfhb - in
docdb_query()anddocdb_create()for sqlite source, fix to handle mixed values of different types (#34) work by @rfhb - some Sys.sleep’s added to Elasticserch eg’s to make sure data is available after creation, and before a data request
nodbi 0.3.0
CRAN release: 2019-09-18
New features
- new author Ralf Herold, with contribution of new functions for working with SQLite/json1. new functions:
src_sqlite,print.src_sqlite,docdb_create.src_sqlite,docdb_delete.src_sqlite,docdb_exists.src_sqlite,docdb_get.src_sqlite,docdb_query.src_sqlite, anddocdb_update.src_sqlite. includes new datasetcontacts(#25) (#27) (#28) (#29) (#30) (#31) -
docdb_updategains method for working with MongoDB, via (#27)
Improvements
- added
.githubfiles in the source repository to facilitate contributions -
src_mongochanges, improved behavior, via (#27)
Defunct
-
etcd(via theetseedpackage) integration has been removed from this package as etcd doesn’t really fit the main goal of the pkg. functions now defunct are:src_etcd,docdb_create.src_etcd,docdb_delete.src_etcd,docdb_exists.src_etcd,docdb_get.src_etcd, andprint.src_etcd(#26)
nodbi 0.2.0
CRAN release: 2019-04-13
New features
-
docdb_get()gainslimitparameter to do pagination, for CouchDB, Elasticsearch and MongoDB only (#17) (#23) - gains function
docdb_query()to send queries to each backend (#18) (#22) - gains function
docdb_exists()to check if a database or equivalent exists (#21) (#22)
Improvements
- Updated package for new version of
elastic, which has slightly different setup for connecting to the Elasticsearch instance (#20)