u/chrisnuernbergerin r/Clojure • Recommends
TMD 7.000 - The Long Beta Is Over
We have released version 7.000 of tech.ml.dataset - our in-memory column-major data processing engine!
This release contains a lot of bugfixes, performance improvements, API improvements, and the results of quite a lot of painstaking research into how the JVM works and fast reduction pathways for complex systems.
Specifically the engine was very carefully built from a perspective of making reductions as fast as possible leading to improvements in several areas. Ideally this version is a drop-in replacement with better performance than version 6 (or pandas or dplyr).
An example of one specific improvement out of many that we now to kernel combining in th…