Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
Shell Execution in Ruby
# Ways to execute a shell script in Ruby
# Example Script - Joseph Pecoraro
cmd = "echo 'hi'" # Sample string that can be used
# 1. Kernel#` - commonly called backticks - `cmd`
# This is like many other languages, including bash, PHP, and Perl
# Synchronous (blocking)
# Returns the output of the shell command
# Docs: http://ruby-doc.org/core/classes/Kernel.html#M001111
value = `echo 'hi'` # or uglier but valid => Kernel.`("echo 'hi'")
value = `#{cmd}` # or uglier but valid => Kernel.`("#{cmd}")
# 2. Built-in syntax, %x( cmd )
# Following the ``x'' character is a delimiter, which can be any character.
# If the delimiter is one of the characters ``('', ``['', ``{'', or ``<'',
# the literal consists of the characters up to the matching closing delimiter,
# taking account of nested delimiter pairs. For all other delimiters, the
# literal comprises the characters up to the next occurrence of the
# delimiter character. String interpolation #{ ... } is allowed.
# Synchronous (blocking)
# Returns the output of the shell command, just like the backticks
# Docs: http://www.ruby-doc.org/docs/ProgrammingRuby/html/language.html
value = %x( echo 'hi' )
value = %x[ #{cmd} ]
# 3. Kernel#system
# Executes the given command in a subshell
# Synchronous (blocking)
# Return: true if the command was found and ran successfully, false otherwise
# Docs: http://ruby-doc.org/core/classes/Kernel.html#M002992
wasGood = system( "echo 'hi'" )
wasGood = system( cmd )
# 4. Kernel#exec
# Replaces the current process by running the given external command.
# Synchronous (never returns)
# Return: none, the current process is replaced and never continues
# Docs: http://ruby-doc.org/core/classes/Kernel.html#M002992
exec( "echo 'hi'" )
exec( cmd ) # Note: this will never be reached beacuse of the line above
# 5. IO.popen
# Runs the specified command as a subprocess; the subprocess's standard
# input and output will be connected to the returned IO object. This
# allows you to provide STDIN input and get STDOUT output easily.
# Asynchronous (IO objects)
# Return: IO object, (IO#pid, IO#read)
# Docs: https://www.rubydoc.info/stdlib/core/IO.popen
io = IO.popen("echo 'hi'") # Or IO.popen(["echo", "hi"])
io = IO.popen(cmd)
IO.popen(["echo", "'hi'"]) do |io|
# ...
end
# 6. open3
# Runs the specified command as a subprocess; the subprocess's standard
# input, stdout, and stderr IO objects are available. There is also
# an "open4" gem to more easily get the PID of the child process.
# Synchronous (get strings) or Asynchronous (IO objects)
# Return: Strings (capture*) or IO objects (popen*)
# Docs: https://docs.ruby-lang.org/en/2.5.0/Open3.html#method-c-popen3
require 'open3'
stdin_io, stdout_io, stderr_io, process_waiter = Open3::popen3(cmd)
stdout_str, stderr_str, process_info = Open3::capture3(cmd)
require 'open4'
pid, stdin, stdout, stderr = Open4::popen4(cmd);
# Extra Advice - Exit Code
# $? which is the same as $CHILD_STATUS (if you require 'english')
# Accesses the status of the last system executed command if
# you use the backticks, system() or %x{}.
# You can then access the ``exitstatus'' and ``pid'' properties
# Docs: https://ruby-doc.org/core-2.7.1/Process/Status.html#method-i-exitstatus
$?.exitstatus
# Extra Advice - Escaping
# When running shell commands, it is often important to escape
# characters that would have special meanings (quotes, $, spaces, etc).
# Ruby makes this simple with the Shellwords module.
# Docs: https://ruby-doc.org/stdlib-2.5.3/libdoc/shellwords/rdoc/Shellwords.html#method-c-shellescape
require 'shellwords'
path = "/path/to a/file" # This has a space that should be escaped properly.
%x{ cat #{Shellwords.escape(path)} }
# Extra Advice - String#chomp
# Shell commands typically end with a newline which you will often want
# to get rid of. Ruby makes this simple with `chomp`.
# Docs: https://ruby-doc.org/core-2.7.2/String.html#method-i-chomp
str = `echo 42` # => "42\n"
str = `echo 42`.chomp # => "42"
# More Reading
# https://stackoverflow.com/questions/2232/how-to-call-shell-commands-from-ruby/2280#2280
# http://www.elctech.com/blog/i-m-in-ur-commandline-executin-ma-commands
# http://blog.jayfields.com/2006/06/ruby-kernel-system-exec-and-x.html
# http://tech.natemurray.com/2007/03/ruby-shell-commands.html
@starkcoffee

This comment has been minimized.

Copy link

@starkcoffee starkcoffee commented Jun 14, 2012

awesome summary - thanks!

@JosephPecoraro

This comment has been minimized.

Copy link
Owner Author

@JosephPecoraro JosephPecoraro commented Jun 14, 2012

@sivakumar-kailasam

This comment has been minimized.

Copy link

@sivakumar-kailasam sivakumar-kailasam commented Jun 17, 2012

Liked the extra advice :)

@devilankur18

This comment has been minimized.

Copy link

@devilankur18 devilankur18 commented Aug 24, 2012

Just Awsesome

@marksliva

This comment has been minimized.

Copy link

@marksliva marksliva commented Sep 18, 2013

Thank you!

@cizixs

This comment has been minimized.

Copy link

@cizixs cizixs commented Nov 15, 2013

Very useful , Thx!

@NeWbLt123

This comment has been minimized.

Copy link

@NeWbLt123 NeWbLt123 commented Mar 21, 2014

Thanks, very helpful !

@mx4492

This comment has been minimized.

Copy link

@mx4492 mx4492 commented Apr 14, 2014

In case you need to drop the ball when the command fails, https://github.com/mx4492/simple_cmd

@chrishough

This comment has been minimized.

Copy link

@chrishough chrishough commented Jun 5, 2014

thanks man!

@barbolo

This comment has been minimized.

Copy link

@barbolo barbolo commented Jun 12, 2015

I'd suggest you to check https://github.com/rtomayko/posix-spawn if you are having memory/latency issues when executing shell commands.

@yanbit

This comment has been minimized.

Copy link

@yanbit yanbit commented Aug 14, 2015

thanks man!

@kassane

This comment has been minimized.

Copy link

@kassane kassane commented Aug 29, 2015

Awesome man!

@dminca

This comment has been minimized.

Copy link

@dminca dminca commented Sep 18, 2015

Thanks man, very interesting and useful 👍

@mika-cn

This comment has been minimized.

Copy link

@mika-cn mika-cn commented Dec 25, 2015

Awesome man! thanks

@mkows

This comment has been minimized.

Copy link

@mkows mkows commented Jan 19, 2016

@JosephPecoraro thanks for sharing that! Any idea how to get rid of trailing "\n"?

$ cd /tmp
tmp$ irb
irb(main):001:0> `pwd`
=> "/tmp\n"
irb(main):002:0>  %x( pwd )
=> "/tmp\n"

One way to achieve this is:

`pwd`[0..-2]
=> "/tmp"

But I am wondering if there's nicer way to do it.

@jerry-tao

This comment has been minimized.

Copy link

@jerry-tao jerry-tao commented Feb 10, 2016

@mkowaliszyn The backticks just simple redirect the stdout to the result. With the default way of backticks it won't get rid of \n for you.

You can just call strip to trim the \n.

Say

 `pwd`.strip.

With more than 1 line result you can:

`ls`.split("\n")
@JosephPecoraro

This comment has been minimized.

Copy link
Owner Author

@JosephPecoraro JosephPecoraro commented Aug 12, 2016

@mkows late reply, but yes! String#chomp is a convenient method that exists for just such cases! It removes all trailing newlines from the string:

irb(main):001:0> `pwd`
=> "/tmp\n"
irb(main):002:0> `pwd`.chomp
=> "/tmp"

Very similar to strip / rstrip mention above.

@wellavelino

This comment has been minimized.

Copy link

@wellavelino wellavelino commented Nov 30, 2016

Thaaanks!

@diboanches

This comment has been minimized.

Copy link

@diboanches diboanches commented Apr 25, 2017

OSOM! Спасибо!

@ayubatif

This comment has been minimized.

Copy link

@ayubatif ayubatif commented Sep 3, 2017

Awesome stuff!

@Skalnark

This comment has been minimized.

Copy link

@Skalnark Skalnark commented Apr 7, 2018

Thanks!

@alopatindev

This comment has been minimized.

Copy link

@alopatindev alopatindev commented Sep 2, 2018

Is there something similar to %x[...] in standard library to handle paths with weird characters?

$ mkdir -p "path/with spaces, \"quotes\" and 'apostrophes'/"
$ irb
irb(main):001:0> path = "path/with spaces, \"quotes\" and 'apostrophes'/"
=> "path/with spaces, \"quotes\" and 'apostrophes'/"
irb(main):002:0> %x[ls #{path}]
ls: cannot access 'path/with': No such file or directory
ls: cannot access 'spaces,': No such file or directory
ls: cannot access 'quotes': No such file or directory
ls: cannot access 'and': No such file or directory
ls: cannot access 'apostrophes/': No such file or directory
=> ""
irb(main):003:0> %x[ls '#{path}']
ls: cannot access 'path/with spaces, "quotes" and apostrophes/': No such file or directory
=> ""
@lukas2

This comment has been minimized.

Copy link

@lukas2 lukas2 commented Jan 24, 2019

Useful thanks!

@VSPPedro

This comment has been minimized.

Copy link

@VSPPedro VSPPedro commented May 15, 2020

Nice tips! Thank you!

@JosephPecoraro

This comment has been minimized.

Copy link
Owner Author

@JosephPecoraro JosephPecoraro commented Oct 20, 2020

It has been >10 years so I've updated it.

  • IO.popen, open3, open4
  • Shell escaping
  • chomping
  • blocking / nonblocking
@MustafaErgul

This comment has been minimized.

Copy link

@MustafaErgul MustafaErgul commented May 7, 2021

Great summary!

@rmetzler

This comment has been minimized.

Copy link

@rmetzler rmetzler commented Jun 3, 2021

Thanks for the great list!
small typo: beacuse should be because

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment