Emacs + org-mode + python in reproducible research; SciPy 2013 Presentation
Enthought5 HN recommenders · recommended in 6 months, 2014-2018
50K views · 13 years ago · talk · evergreen
John Kitchin shows how Emacs org-mode with Python lets researchers combine narrative, math, figures and executable code in one document. It exports to LaTeX, HTML and PDF, and he used it for papers and e-books.
Repeatedly recommended as the canonical demo of org-mode for literate programming and reproducible research.
22:43Consistent Technical Documents Using Emacs and Org Mode
spudlyo
74K views • 6 years ago
56:21Getting Started With Org Mode
thoughtbot
293K views • 10 years ago
28:36Literate Devops with Emacs
Howard Abrams
105K views • 11 years ago
46:57Emacs Org-mode - a system for note-taking and project planning
Google TechTalks
331K views • 18 years ago
1:01:04Introduction to Julia - Part 1 | SciPy 2014 | David Sanders
Enthought
80K views • 12 years ago
1:01:06Emacs For Writers
thoughtbot
153K views • 11 years ago
40:45Jake Vanderplas - Statistics for Hackers - PyCon 2016.mp4
PyCon 2016
93K views • 10 years ago
57:05Keynote: Begin...End?
David Beazley
9K views • 5 years ago
49:54The Clean Architecture in Python
Next Day Video
114K views • 12 years ago
49:09Debugging with the Scientific Method - Stuart Halloway
ClojureTV
25K views • 10 years ago
40:02Evil Mode: Or, How I Learned to Stop Worrying and Love Emacs
thoughtbot
563K views • 11 years ago
31:38Cory Benfield - Building Protocol Libraries The Right Way - PyCon 2016
PyCon 2016
15K views • 10 years ago
42:44Armin Ronacher - A Python for Future Generations
EuroPython Conference
6K views • 9 years ago
56:55Q&A with Guido van Rossum, Inventor of Python
Microsoft Reactor
28K views • 5 years ago
8:12PTVS 2.0 Beta: Mixed-Mode Python/C/C++ Debugging overview
python tools
8K views • 13 years ago
45:11Stevey's Tech Talk E39 -- A guided tour of Emacs
Steve Yegge
13K views • 4 years ago
12:22Is Most Published Research Wrong?
Veritasium
6.2M views • 10 years ago
4:51VisiData Lightning Demo at PyCascades 2018
Saul Pwanson
41K views • 8 years ago
40:01Keynote - Preventing, Finding, and Fixing Bugs On a Time Budget | Raymond Hettinger @ PyBay2018
SF Python
27K views • 8 years ago
11:48John Rauser keynote: "Statistics Without the Agonizing Pain" -- Strata + Hadoop 2014
O'Reilly
61K views • 12 years ago
11 comments from Hacker News
I like to use org mode for cleaning up my hard drives... a little script to pipe du into something that sums the files in a directory and adds asterisks, and viola, you have a UI for finding all the large and delete-able files & directories. I haven't used org mode for all the other cool things it can do, but I remember watching a great video about someone who uses it a lot like a Jupyter notebook. ▶ this video
I Agree with all those points. I've used org mode for a few things, but not for python notebooks. I remember seeing a great video a few years back on using python in org mode to make a research notebook. It really made me want to try org mode for literate / notebook style programming. I think it was this one: ▶ this video It sounds like org mode does not store images inline, since you don't like the b64 images in Jupyter? I imagine that could go both ways depending on what you want. Even for diffing, you might like to see that the image changed (though I generally agree that diffing images is not ideal). If you have to package images separately when sharing, then wouldn't inline images score a point for easier sharing? > use other languages that python Agreed, and that is powerful, but this also goes to my point. Jupyter is made for python and org mode isn't. Jupyter comes with python and libraries, where with Emacs you're on your own to figure out how to install and use different languages, and setup your environment so Emacs can see them. You're on your own to bring in images and plots, where Jupyter already understands commands that output images. > Plus, you get to use a proper text editor instead of editing on a browser textarea. Yes, but the editor is Emacs. :) For a lot of people the browser textarea is a bonus because it's the same thing you use everywhere. It's uncomplicated and non-technical and utterly consistent, even if lacking any power.
This SciPy presentation (Kitchin, John Carnegie Mellon University) on Emacs + org-mode + python in reproducible research is worth a watch: ▶ this video
The workflow proposed in the first link looks quite interesting: Emacs + org-mode + python in reproducible research; SciPy 2013 ▶ this video And here are some more reviews, opinions, advices and experiences I just stumbled upon: link link
Seriously, try emacs. You want to see what color you have put in a css field?[1] Want to see the image you are referencing in a repl?[2] More amazingly, want to combine TeX, lisp, a markdown like language, and python/whatever in a single document? Try org-mode.[3][4] [1] link [2] link [3] link [4] ▶ this video
Do check out org-mode, then. It is surprising how far that tool has been extended. Many of these features are actually under the label "reproducible research" nowdays. There was a really good talk given on this at a pypy convention a couple of years ago.[1] [1] ▶ this video
I hate to be one of those that harps on "why the downvotes," but I really would appreciate tips on how folks would plan on testing these claims. Just imagining that we could do better than some good pieces of software doesn't really do much to say that we can. For example, people have been imagining faster than light travel for a long time. I realize these don't compare directly, as we have reasons to believe upper bounds on speed. So, I am curious if we have reasons to believe that the upper bounds on editors and such is really that much higher. For inspiration, consider [1]. Same for typesetting. Take a look at most of the papers at [2] and tell me whether translating these to new languages is really necessary. (Though, note that I am not arguing against this. Just asking how we plan to know that "things are better now.") [1] ▶ this video [2] link
I know it gets said a lot, but have you considered emacs and org-mode. Because, it goes a very long way for this. See this great talk showing its use with python. ▶ this video
If you use emacs org-mode, check out org-drill link . It uses the same algorithms, allows you to tweak everything, and you can keep your flashcards alongside the relevant notes/code/files/issues/ToDos/bookmarks/contacts/feeds/calendar-entry/emails/thesis/spreadsheets/journals/diagrams/pictures/evernotes/etc. ▶ this video , rather than in a totally separate program.
A lot of people are starting to use org-mode for that kind of thing. Fully reproducible research in a single file. To check the work, just export the file to pdf/html/etc., or "C-c C-c" the code blocks as you read through in org-mode. It's fantastic. For python specifically, this video is a must watch: ▶ this video
The Orgmode extension to Emacs has quite an elegant, flexible, and powerful way of doing what you want. Can be hard to wrap your mind around at the beginning but has good payoff once you're up to speed. Here's a video showing how one guy uses it with Python (though it integrates with multitude of languages, including R): ▶ this video Here's paper (itself from LaTeX generated by Orgmode) describing use of Orgmode for this kind of "reproducible research": link