Emacs + org-mode + python in reproducible research; SciPy 2013 Presentation
Enthought5 HN recommenders · recommended in 6 months, 2014–2018
talk · intermediate · evergreen · 2014–2018 on HN
John Kitchin shows how Emacs org-mode with Python lets researchers combine narrative, math, figures and executable code in one document. It exports to LaTeX, HTML and PDF, and he used it for papers and e-books.
Repeatedly recommended as the canonical demo of org-mode for literate programming and reproducible research.
Up next
14 mo on HNBut what is a neural network? | Deep learning chapter 1
3Blue1Brown
16 HN recommender · 2017–2025
5 mo on HNHow Big is Graham's Number? (feat Ron Graham)
Numberphile
4 HN recommender · 2014–2024
2 mo on HNThe Drive Home - ShaderToy
The Art of Code
2 HN recommender · 2017–2022
2 mo on HN50TH ANNIVERSARY OF THE COMPUTER SCIENCE DEPARTMENT AT THE UNIVERSITY OF UTAH
University of Utah
2 HN recommender · 2023–2024
3 mo on HNScientific Studies: Last Week Tonight with John Oliver (HBO)
LastWeekTonight
3 HN recommender · 2016–2019
10 mo on HNJavaScript: The Good Parts
Google TechTalks
11 HN recommender · 2009–2020
2 mo on HNLecture 1 | Introduction to Convolutional Neural Networks for Visual Recognition
Stanford University School of Engineering
2 HN recommender · 2018–2025
7 mo on HNThe world's worst video card?
Ben Eater
8 HN recommender · 2019–2024
15 mo on HNRailsConf 2014 - All the Little Things by Sandi Metz
Confreaks
15 HN recommender · 2015–2025
11 mo on HN"Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson
Strange Loop Conference
12 HN recommender · 2014–2024
11 mo on HN🚀 TDD, Where Did It All Go Wrong (Ian Cooper)
DevTernity Conference
11 HN recommender · 2018–2024
11 mo on HNBret Victor - Inventing on Principle
Rui Oliveira
12 HN recommender · 2013–2025
11 comments from Hacker News
A lot of people are starting to use org-mode for that kind of thing. Fully reproducible research in a single file. To check the work, just export the file to pdf/html/etc., or "C-c C-c" the code blocks as you read through in org-mode. It's fantastic. For python specifically, this video is a must watch: ▶ this video
I Agree with all those points. I've used org mode for a few things, but not for python notebooks. I remember seeing a great video a few years back on using python in org mode to make a research notebook. It really made me want to try org mode for literate / notebook style programming. I think it was this one: ▶ this video It sounds like org mode does not store images inline, since you don't like the b64 images in Jupyter? I imagine that could go both ways depending on what you want. Even for diffing, you might like to see that the image changed (though I generally agree that diffing images is not ideal). If you have to package images separately when sharing, then wouldn't inline images score a point for easier sharing? > use other languages that python Agreed, and that is powerful, but this also goes to my point. Jupyter is made for python and org mode isn't. Jupyter comes with python and libraries, where with Emacs you're on your own to figure out how to install and use different languages, and setup your environment so Emacs can see them. You're on your own to bring in images and plots, where Jupyter already understands commands that output images. > Plus, you get to use a proper text editor instead of editing on a browser textarea. Yes, but the editor is Emacs. :) For a lot of people the browser textarea is a bonus because it's the same thing you use everywhere. It's uncomplicated and non-technical and utterly consistent, even if lacking any power.
This SciPy presentation (Kitchin, John Carnegie Mellon University) on Emacs + org-mode + python in reproducible research is worth a watch: ▶ this video
Do check out org-mode, then. It is surprising how far that tool has been extended. Many of these features are actually under the label "reproducible research" nowdays. There was a really good talk given on this at a pypy convention a couple of years ago.[1] [1] ▶ this video
Seriously, try emacs. You want to see what color you have put in a css field?[1] Want to see the image you are referencing in a repl?[2] More amazingly, want to combine TeX, lisp, a markdown like language, and python/whatever in a single document? Try org-mode.[3][4] [1] link [2] link [3] link [4] ▶ this video
I know it gets said a lot, but have you considered emacs and org-mode. Because, it goes a very long way for this. See this great talk showing its use with python. ▶ this video
The Orgmode extension to Emacs has quite an elegant, flexible, and powerful way of doing what you want. Can be hard to wrap your mind around at the beginning but has good payoff once you're up to speed. Here's a video showing how one guy uses it with Python (though it integrates with multitude of languages, including R): ▶ this video Here's paper (itself from LaTeX generated by Orgmode) describing use of Orgmode for this kind of "reproducible research": link
I like to use org mode for cleaning up my hard drives... a little script to pipe du into something that sums the files in a directory and adds asterisks, and viola, you have a UI for finding all the large and delete-able files & directories. I haven't used org mode for all the other cool things it can do, but I remember watching a great video about someone who uses it a lot like a Jupyter notebook. ▶ this video
The workflow proposed in the first link looks quite interesting: Emacs + org-mode + python in reproducible research; SciPy 2013 ▶ this video And here are some more reviews, opinions, advices and experiences I just stumbled upon: link link
I hate to be one of those that harps on "why the downvotes," but I really would appreciate tips on how folks would plan on testing these claims. Just imagining that we could do better than some good pieces of software doesn't really do much to say that we can. For example, people have been imagining faster than light travel for a long time. I realize these don't compare directly, as we have reasons to believe upper bounds on speed. So, I am curious if we have reasons to believe that the upper bounds on editors and such is really that much higher. For inspiration, consider [1]. Same for typesetting. Take a look at most of the papers at [2] and tell me whether translating these to new languages is really necessary. (Though, note that I am not arguing against this. Just asking how we plan to know that "things are better now.") [1] ▶ this video [2] link
If you use emacs org-mode, check out org-drill link . It uses the same algorithms, allows you to tweak everything, and you can keep your flashcards alongside the relevant notes/code/files/issues/ToDos/bookmarks/contacts/feeds/calendar-entry/emails/thesis/spreadsheets/journals/diagrams/pictures/evernotes/etc. ▶ this video , rather than in a totally separate program.