Skip to content
Hallway
0:00 / 0:00

#clojure#datomic#kafka

Clojure vs Sepsis: path to real time enterprise data science - Igor Ges + Gerardo Castro

ClojureTV

111K subscribers • 159 videos on Hallway

YouTube
  • Recommended by 2 people: 2 in engineering communities.
  • Presented by Igor Ges and Gerardo Castro

Intermediate. Assumes working knowledge.

2.9K views7 years ago2 recommendations

Distributed systemsDatabases and dataLisp and ClojureKafka and stream processingData engineering and warehouses

Igor Ges and Gerardo Castro share how they used Clojure and Datomic to deploy a real-time sepsis prevention system across 165 hospitals.

After being tasked with bringing data science to HCA, the largest hospital chain in the United States, we recognized the need for a large scale, life-saving project to demonstrate value and pave the way for getting the infrastructure and support that a meaningful data science operation would require. This is the story of how we used Clojure and Datomic to successfully deploy SPOT (Sepsis Prevention and Optimization of Therapy) in 165 hospitals all across the US. In this talk we will discuss the design of a real-time streaming clinical system, our experience using Datomic for a medical data science application, as well as challenges that we had to overcome (both technical and organizational) to deploy and operate SPOT at this scale.

Why it's here

2 people recommend this

What people say. Recommended as a real-world case study of using Clojure, Datomic, and Kafka for large-scale streaming and data analysis.

Moments people linked to

u/fingertoe11in r/Clojure • Recommends

On “New Clojurians: Ask Anything”

You can use it for nearly anything. I see it gaining a lot of ground where you have disparate sets of data that need unified. (Datomic is good for this) Some examples: * [video HCA hospitals use it to monitor for Sepsis prevention * [video Parker Institute is using it to unify cancer research data from lots of disparate sources into a common usable set The other main use seems to be stream processing... Clojure plays really nice with Kafka and similar tech * Walmart uses it to track all of it's receipts: http://blog.cognitect.com/blog/2015/6/30/walmart-runs-clojure-at-scale * Hotel search engine and booking seems to be a popular use. (Roomkey * Netflix uses it to monitor 2…
12View on Reddit

u/fingertoe11in r/Clojure • Recommends

On “What sort of projects would you use Clojure for?”

…s architected around it. https://cognitect.com/nubank-case-study.html King games used it to write the Defold IDE they use to create their games. https://king.com/ko/jobs/king-hub/posts/how-we-use-clojure-at-king-to-write-a-game-engine-editor One of the major hospital chains (HCA) uses it to watch for Sepsis risks amongst all of their patients. link to this video Roomkey tracks a massive amount of hotel availabilty and bookings. https://venturebeat.com/2013/09/10/room-key-cloudbeat/ Clojure monitors the engines in the 737.. link to this video Metabase is written in Clojure. https://metabase.com/ Generally I think it tends to find it's big fortune 500 users where a lot of concurrency is useful. Clojur…
11View on Reddit

u/joinrin r/Clojure • Recommends

On “Data Analysis with Datomic”

My naïve thought is to coerce a datomic pull into something spark can digest and process, or publish kafka topics that stream to .... something. HCData had a good presentation at the 2018 Conj on something similar, except their use-case for kafka was real-time streaming data into datomic, followed by various analyses. They were originally using spark (developed the neat, and apparently now no longer developed powderkeg library for interacting with spark (there's other options like sparkling though), but ditched it (per the presentation). It's unclear what the size and frequency of your data is (is your problem trivial enough to rip data from Datomic, jam it into a delimited txt file or…
4View on Reddit