HackerTube
HomeLongsLikedHistoryWatch laterCategoriesPlaylistsSettings

Emacs + org-mode + python in reproducible research; SciPy 2013 Presentation

Enthought5 HN recommenders · recommended in 6 months, 2014-2018
YouTube
50K views · 13 years ago · talk · evergreen

John Kitchin shows how Emacs org-mode with Python lets researchers combine narrative, math, figures and executable code in one document. It exports to LaTeX, HTML and PDF, and he used it for papers and e-books.

Repeatedly recommended as the canonical demo of org-mode for literate programming and reproducible research.

Testing, debugging & developer toolsData science & statisticsPython, Ruby & scripting languages#org-mode#emacs#python#literateprogramming#scipy

11 comments from Hacker News

@dahart2018 · in “The Many Uses of Org Mode”

I like to use org mode for cleaning up my hard drives... a little script to pipe du into something that sums the files in a directory and adds asterisks, and viola, you have a UI for finding all the large and delete-able files & directories. I haven't used org mode for all the other cool things it can do, but I remember watching a great video about someone who uses it a lot like a Jupyter notebook. ▶ this video

CitesView on HN
@dahart2018 · in “Jupyter, Mathematica, and the Future of the Research Paper”

I Agree with all those points. I've used org mode for a few things, but not for python notebooks. I remember seeing a great video a few years back on using python in org mode to make a research notebook. It really made me want to try org mode for literate / notebook style programming. I think it was this one: ▶ this video It sounds like org mode does not store images inline, since you don't like the b64 images in Jupyter? I imagine that could go both ways depending on what you want. Even for diffing, you might like to see that the image changed (though I generally agree that diffing images is not ideal). If you have to package images separately when sharing, then wouldn't inline images score a point for easier sharing? > use other languages that python Agreed, and that is powerful, but this also goes to my point. Jupyter is made for python and org mode isn't. Jupyter comes with python and libraries, where with Emacs you're on your own to figure out how to install and use different languages, and setup your environment so Emacs can see them. You're on your own to bring in images and plots, where Jupyter already understands commands that output images. > Plus, you get to use a proper text editor instead of editing on a browser textarea. Yes, but the editor is Emacs. :) For a lot of people the browser textarea is a bonus because it's the same thing you use everywhere. It's uncomplicated and non-technical and utterly consistent, even if lacking any power.

RecommendsView on HN
@rndn2015 · in “Emacs for Data Science”

This SciPy presentation (Kitchin, John Carnegie Mellon University) on Emacs + org-mode + python in reproducible research is worth a watch: ▶ this video

RecommendsView on HN
@fensterbrett2014 · in “Designing a Personal Knowledgebase”

The workflow proposed in the first link looks quite interesting: Emacs + org-mode + python in reproducible research; SciPy 2013 ▶ this video And here are some more reviews, opinions, advices and experiences I just stumbled upon: link link

CitesView on HN
@taeric2014 · in “Typographic Programming Language”

Seriously, try emacs. You want to see what color you have put in a css field?[1] Want to see the image you are referencing in a repl?[2] More amazingly, want to combine TeX, lisp, a markdown like language, and python/whatever in a single document? Try org-mode.[3][4] [1] link [2] link [3] link [4] ▶ this video

RecommendsView on HN
@taeric2014 · in “Show HN: Lit – a modern literate programming tool”

Do check out org-mode, then. It is surprising how far that tool has been extended. Many of these features are actually under the label "reproducible research" nowdays. There was a really good talk given on this at a pypy convention a couple of years ago.[1] [1] ▶ this video

RecommendsView on HN
@taeric2014 · in “Patoline: A modern digital typesetting system”

I hate to be one of those that harps on "why the downvotes," but I really would appreciate tips on how folks would plan on testing these claims. Just imagining that we could do better than some good pieces of software doesn't really do much to say that we can. For example, people have been imagining faster than light travel for a long time. I realize these don't compare directly, as we have reasons to believe upper bounds on speed. So, I am curious if we have reasons to believe that the upper bounds on editors and such is really that much higher. For inspiration, consider [1]. Same for typesetting. Take a look at most of the papers at [2] and tell me whether translating these to new languages is really necessary. (Though, note that I am not arguing against this. Just asking how we plan to know that "things are better now.") [1] ▶ this video [2] link

CitesView on HN
@taeric2014 · in “Patoline: A modern digital typesetting system”

I know it gets said a lot, but have you considered emacs and org-mode. Because, it goes a very long way for this. See this great talk showing its use with python. ▶ this video

RecommendsView on HN
@cube_yellow2014 · in “Anki – Powerful, intelligent flashcards”

If you use emacs org-mode, check out org-drill link . It uses the same algorithms, allows you to tweak everything, and you can keep your flashcards alongside the relevant notes/code/files/issues/ToDos/bookmarks/contacts/feeds/calendar-entry/emails/thesis/spreadsheets/journals/diagrams/pictures/evernotes/etc. ▶ this video , rather than in a totally separate program.

CitesView on HN
@cube_yellow2014 · in “Let’s Make a Bubble Map”

A lot of people are starting to use org-mode for that kind of thing. Fully reproducible research in a single file. To check the work, just export the file to pdf/html/etc., or "C-c C-c" the code blocks as you read through in org-mode. It's fantastic. For python specifically, this video is a must watch: ▶ this video

Strongly recommendsView on HN
@hsitz2014 · in “IPython: Beginners’ Guide”

The Orgmode extension to Emacs has quite an elegant, flexible, and powerful way of doing what you want. Can be hard to wrap your mind around at the beginning but has good payoff once you're up to speed. Here's a video showing how one guy uses it with Python (though it integrates with multitude of languages, including R): ▶ this video Here's paper (itself from LaTeX generated by Orgmode) describing use of Orgmode for this kind of "reproducible research": link

RecommendsView on HN
Consistent Technical Documents Using Emacs and Org Mode22:43

Consistent Technical Documents Using Emacs and Org Mode

spudlyo
74K views • 6 years ago
Getting Started With Org Mode56:21

Getting Started With Org Mode

thoughtbot
293K views • 10 years ago
Literate Devops with Emacs28:36

Literate Devops with Emacs

Howard Abrams
105K views • 11 years ago
Emacs Org-mode - a system for note-taking and project planning46:57

Emacs Org-mode - a system for note-taking and project planning

Google TechTalks
331K views • 18 years ago
Introduction to Julia - Part 1 | SciPy 2014 | David Sanders1:01:04

Introduction to Julia - Part 1 | SciPy 2014 | David Sanders

Enthought
80K views • 12 years ago
Emacs For Writers1:01:06

Emacs For Writers

thoughtbot
153K views • 11 years ago
Jake Vanderplas - Statistics for Hackers - PyCon 2016.mp440:45

Jake Vanderplas - Statistics for Hackers - PyCon 2016.mp4

PyCon 2016
93K views • 10 years ago
Keynote: Begin...End?57:05

Keynote: Begin...End?

David Beazley
9K views • 5 years ago
The Clean Architecture in Python49:54

The Clean Architecture in Python

Next Day Video
114K views • 12 years ago
Debugging with the Scientific Method - Stuart Halloway49:09

Debugging with the Scientific Method - Stuart Halloway

ClojureTV
25K views • 10 years ago
Evil Mode: Or, How I Learned to Stop Worrying and Love Emacs40:02

Evil Mode: Or, How I Learned to Stop Worrying and Love Emacs

thoughtbot
563K views • 11 years ago
Cory Benfield - Building Protocol Libraries The Right Way - PyCon 201631:38

Cory Benfield - Building Protocol Libraries The Right Way - PyCon 2016

PyCon 2016
15K views • 10 years ago
Armin Ronacher - A Python for Future Generations42:44

Armin Ronacher - A Python for Future Generations

EuroPython Conference
6K views • 9 years ago
Q&A with Guido van Rossum, Inventor of Python56:55

Q&A with Guido van Rossum, Inventor of Python

Microsoft Reactor
28K views • 5 years ago
PTVS 2.0 Beta: Mixed-Mode Python/C/C++ Debugging overview8:12

PTVS 2.0 Beta: Mixed-Mode Python/C/C++ Debugging overview

python tools
8K views • 13 years ago
Stevey's Tech Talk E39 -- A guided tour of Emacs45:11

Stevey's Tech Talk E39 -- A guided tour of Emacs

Steve Yegge
13K views • 4 years ago
Is Most Published Research Wrong?12:22

Is Most Published Research Wrong?

Veritasium
6.2M views • 10 years ago
VisiData Lightning Demo at PyCascades 20184:51

VisiData Lightning Demo at PyCascades 2018

Saul Pwanson
41K views • 8 years ago
Keynote - Preventing, Finding, and Fixing Bugs On a Time Budget | Raymond Hettinger @ PyBay201840:01

Keynote - Preventing, Finding, and Fixing Bugs On a Time Budget | Raymond Hettinger @ PyBay2018

SF Python
27K views • 8 years ago
John Rauser keynote: "Statistics Without the Agonizing Pain" -- Strata + Hadoop 201411:48

John Rauser keynote: "Statistics Without the Agonizing Pain" -- Strata + Hadoop 2014

O'Reilly
61K views • 12 years ago