Skip to content
0:00 / 0:00

#talonvoice#voiceprogramming#rsi

"Voice Driven Development: Who needs a keyboard anyway?" by Emily Shea

Strange Loop Conference

88K subscribers • 114 videos on Hallway • Conference channel

YouTube
  • Recommended by 5 people: 5 on Hacker News.
  • Presented by Emily Shea, software engineer

Intermediate. Assumes working knowledge.

34K views7 years ago5 recommendations

Tools and practiceProgramming languagesDeveloper productivityVim, Emacs and editors

Emily Shea demonstrates how she uses speech recognition and Talon to program productively and pain-free after suffering from repetitive strain injury.

As a programmer, being unable to use a keyboard can seem like a career-ending limitation. I was facing that reality a year ago due to Repetitive Strain Injury, when every productive day was a step back for my health. In a futile, last-ditch effort at saving my career, I turned to speech recognition. Unexpectedly, not only was I able to return to pain-free productivity, but I found voice-driven development to be enjoyable, efficient, and a source of renewed excitement for programming. Speech recognition isn't exactly known in software development circles as a workable approach to programming, but it's better than you (probably) think! Far from imposing a tedious workflow with a specialized set of commands, speech can enable flexibility and optimizations that are difficult to achieve with a keyboard, and does not get in the way when adapting to new technologies, tools, or languages. This practical, demo-driven talk presents the approach and tools that have allowed me to continue on with my career. I'll present real world experience with speech-related topics like disambiguating homophones on the fly and teaching the voice engine new technical vocabulary. Beyond technical aspects, I will share my experience guiding a team to support this working style, and challenges to adding a microphone into an open office environment. Speech not only removes the compromise between health and career when an injury is present, but can also augment and improve the workflow for a wider audience. Emily Shea Fastly, Inc. @yomilly Emily is a Senior Software Engineer at Fastly, where she works on the platform for delivering core CDN configurations, and develops in Perl using speech recognition. In a past life, she worked in HR at mobile gaming companies. Emily holds a BA in Architecture from UC Berkeley, and in her spare time likes to hang out in parks with her dog, named Chicken.

Why it's here

5 people recommend this

What people say. Engineers point to this talk as the premier demonstration of highly efficient, hands-free voice programming to combat RSI.

tbabejon Hacker News • Recommends

On “Ask HN: Is there any work being done in speech-to-code with deep learning?”

While (likely) not using directly deep learning, I found the following talk 1 by Emily Shea on her code dictation setup (based on Talon Voice) both insightful and impressive. EDIT: Actual demo with coding starts at 18.00: link to this video 1 link to this video

glenjaminon Hacker News • Recommends

On “Hey, GitHub – Waiting list signup”

There was an excellent talk at Strange Loop a few years ago by Emily Shea about how she'd learnt to code vim using her voice to combat RSI. link to this video The demos are in Ruby, but I could imagine that languages with strong type-aware auto-completion could be easier to do.

cube2222on Hacker News • Recommends

On “Numen: Voice Control for Handsfree Computing”

It's worth mentioning Talon0 here, which is a system for offline voice control as well, with great python-based scripting (and also supports eye tracking, though I haven't used it myself). Using your computer or programming with it works like a charm, with some interesting and impressive projects based on it coming out as well, like Cursorless1. There's a great strangeloop talk2 demonstrating talon and the actual state of voice coding, which is how I discovered it (hint: it's much better than you'd expect, and straightforward to learn at that). 0: link 1: link 2: link to this video Disclaimer: not affiliated, just a happy occasional user

cube2222on Hacker News • Recommends

On “Squeezebox Keyboard”

Check out voice programming with Talon0, I've recently been playing around with it (to be less reliant on my hands), and it actually takes little work to get started and fairly productive. The state of voice programming is much better than most people would imagine. Here's a nice talk on strangeloop by a person who switched to it permanently: link to this video 0: link

58x14on Hacker News • Recommends

On “Spatial Keyboard Navigation”

I think you'll find this presentation by Emily Shea on voice driven development to be intriguing. link to this video aside, novel HIDs are IMO a huge market gap that I'd really like to invest time in if anyone wants to chat.

kbensonon Hacker News • Recommends

On “Ask HN: Why is there no high quality method for voice control of a PC?”

For anyone interested in this topic, you might be interested in this tech talk1 from Emily Shea. In it she demos a tech stack similar to what's mentioned here, to fairly good effect. It does appear that required a lot of tweaking on her part and is optimized for the writing of code, and I'm not sure how well it functions for more general contexts. 1: link to this video

u/fullouterjoinin r/ProgrammingLanguages • Mentions

On “I started working on a speakable programming language: Have a look at the initial prototype”

This is cool! Not trying to detract from your accomplishment, just trying to link related material since this is such a niche topic. Using Python to Code by Voice link to this video https://www.felienne.com/wp-content/uploads/2018/03/TUD-SERG-2018-001.pdf Coding by Voice with Dragonfly link to this video Emily Shea - Code by Voice link to this video link to this video

lunixbochson Hacker News • Mentions

On “Typing, RSI, and what I do differently”

My project, Talon, is free and cross platform. It might have some options that can help you: link Some blog posts: - link - link - link Some talks: - link - link to this video - link

b2gillson Hacker News • Mentions

On “Try APL”

You can if you put in the work to set it up. There are two (nearly identical) talks by Emily Shea - Perl Out Loud link - Voice Driven Development: Who needs a keyboard anyway? link to this video

m463on Hacker News • Mentions

On “I designed my own keyboard layout. Was it worth it?”

> Soon we will be talking to our LLM's a lot People have been saying this for decades. I think of "dragon naturally speaking" and similar. It still doesn't seem mainstream. (maybe it is but not visible to me?) that said, I still remember this video: link to this video