Short on time? Here’s the gist: DuckDB parallelizes query execution and never guarantees row order unless you explicitly ask for it. If any step in your pipeline is order-sensitive, row_number(), cumsum(), lag(), distinct(.keep_all = TRUE), inequality joins, you are silently producing non-deterministic results. This post shows the four patterns that bite you and how to fix each one. The Setup: ...

Buckle up, we’re talking about security… While developing the Signature.py application, ThinkR recently faced a security issue – in Python – that deserves our full attention. Versioned on Github, the Signature.py code is analyzed by Dependabot. This is a robot that automatically scans projects for obsolete or vulnerable dependencies and can potentially suggest corrective measures. Dependabot alerted us to a ...

PostGIS extends capabilities of PostgreSQL database to deal with spatial data. Using PostGIS, your database supports geographic queries to be run directly in SQL. In this blog post, we will connect and interact with a PostGIS database from R, using {DBI} and {sf}. Package {sf} and PostGIS are friends Package {sf} is similar to PostGIS database in multiple ways: R ...

Our diligent readers already know how important having well formatted data is for efficient statistical analyses. Here we gathered some advice on how to make a well structured database, in order to perform accurate analyses, and avoid driving your fellow analysts crazy. We are very grateful to Marion Louveaux, bio-image analyst for this translation of french version “Une base de ...