Skip to content
0:00 / 0:00

#libpython-clj#panthera#pandas

Libpython-clj with Chris Nuernberger and Panthera with Alan Marazzi - Scicloj meeting 4

Sci Cloj

1.4K subscribers • 6 videos on Hallway

YouTube
  • Recommended by 2 people: 2 in engineering communities.
  • Presented by Chris Nuernberger and Alan Marazzi
  • May be out of date. Uploaded 7 years ago, in an area where tools change fast.

Intermediate. Assumes working knowledge.

1.4K views7 years ago2 recommendations

Programming languagesAI and machine learningLisp and ClojurePythonData engineering and warehouses

Chris Nuernberger and Alan Marazzi present libpython-clj and Panthera, demonstrating how to use Python libraries and Pandas from Clojure.

This was the forth meeting of the Scicloj community, on July 18th, 2019, 5pm UTC -- an open online gathering of the Clojure data science community. Chris Nuernberger discussed using Python from Clojure using Libpython-clj, and Alan Marazzi discussed using Pandas from Clojure using Panthera. More details here: twitter.com/scicloj/status/1147921086832619520 Chris Nuernberger's slides: tinyurl.com/yyaxupk3 Alan Marazzi's slides: tinyurl.com/yygu5zmt Text chat of the meeting: tinyurl.com/y6ct99ny [The first few minutes of the meeting were not recorded, due to an error. Then, we restarted from scratch.]

Why it's here

2 people recommend this

What people say. Recommended for understanding how Clojure's Python interop works, including its zero-copy API.

u/dasluin r/Clojure • Recommends

Python interop -- Scicloj meeting video, and ways to get involved Hi. Just realized that, somehow, the video of the Scicloj meeting about Python interop has not been shared here. So, here it is. To me, it was fascinating. Probably, anyone who is interested in bridges across technologies would find that discussion helpful. Even though our next web meetings will be mostly about other topics, we keep discussing Python interop on other channels, and it will surely be central to a lot of what we plan for the following few months. In my opinion, there is a beautiful opportunity here -- a lot of stuff has become feasible. As Carin Meier recently twitted, many conversations have changed from "N…

u/joinrin r/Clojure • Recommends

On “panthera is here!”

> I haven't checked exactly how libpython-clj works There is a recent web meeting where they explain all that, to include zero-copy API (or minimal marshaling by default). I think the library readme talks about it as well, although the author goes into detail and rationale during the vid. >The overhead will be too big. What is the empirical overhead for dispatching through a python interpreter to a C-library to execute a foreign call from JNI? Maybe there are contexts (perhaps many) where this is trivial. If that interpreter is bound as a long-running resource....then the overhead for starting the interpreter (vs. a naive start-one-every-call) seems like another non-issue. Now you'…