README.md

Workless

This is an addon for delayed_job (> 2.0.0) http://github.com/collectiveidea/delayed_job
It is designed to be used when you're using Heroku as a host and have the need to do background work with delayed job but you don't want to leave the workers running all the time as it costs money.

By adding the gem to your project and configuring our Heroku app with some config variables workless should do the rest.

Updates

Version 1.2.2 includes after_commit fix by @collectiveip

Version 1.2.1 includes support for Rails 4 & DJ 4 by @florentmorin

Version 1.2.0 includes new support for Sequel by @davidakachaos

Version 1.1.3 includes changes by @radanskoric to reduce number of heroku api calls

Version 1.1.2 includes a change by @davidakachaos to scale workers using after_commit

Version 1.1.1 includes a fix from @filiptepper and @fixr to correctly scale workers

Version 1.1.0 has been released, this adds support for scaling using multiple workers thanks to @jaimeiniesta and @davidakachaos.

Version 1.0.0 has been released, this brings compatibility with delayed_job 3 and compatibility with Rails 2.3.x and up.

Compatibility

Workless should work correctly with Rubies 1.8.7, ree, 1.9.2 and 1.9.3. It is compatible with Delayed Job since version 2.0.7 up to the latest version 3.0.1, the table below shows tested compatibility with ruby, rails and delayed_job

Ruby

Rails

Delayed Job

1.8.7-ree

2.1.14

2.0.7

1.9.2

3.2

2.1.4

1.9.2

3.2

3.0.1

Installation

Add the workless gem and the delayed_job gem to your project Gemfile and update your bundle. Its is recommended to specify the gem version for delayed_job especially if you are using rails 2.3.x which doesn't work with the latest delayed_job

For rails 2.3.x the latest compatible delayed_job is 2.0.7

gem "delayed_job", "2.0.7"
gem "workless", "~> 1.1.3"

For rails 3.x with delayed_job 2.1.x

gem "delayed_job", "~> 2.1.4"
gem "workless", "~> 1.1.3"

For rails 3.x with latest delayed_job 3.x using active record

gem "delayed_job_active_record"
gem "workless", "~> 1.1.3"

If you don't specify delayed_job in your Gemfile workless will bring it in, most likely the latest version (3.0.1)

Failing Jobs

In the case of failed jobs Workless will only shut down the dj worker if all attempts have been tried. By default Delayed Job will try 25 times to process a job with ever increasing time delays between each unsucessful attempt. Because of this Workless configures Delayed Job to try failed jobs only 3 times to reduce the amount of time a worker can be running while trying to process them.

Configuration

Workless can be disabled by using the null scaler that will ignore the workers requests to scale up and down. In an environment file add this in the config block:

config.after_initialize do
Delayed::Job.scaler = :null
end

There are three other scalers included. Note that if you are running on the Aspen or Bamboo stacks on Heroku and you don't explicitly specify the scaler, the heroku scaler will be used automatically.

The local scaler uses @adamwiggins rush library http://github.com/adamwiggins/rush to start and stop workers on a local machine. The local scaler also relies on script/delayed_job (which in turn requires the daemon gem). If you have been using foreman to run your workers, go back and see the delayed_job setup instructions.

The heroku scaler works on the Aspen and Bamboo stacks while the heroku_cedar scaler only works on the new Cedar stack.

Scaling to multiple workers

As an experimental feature for the Cedar stack, Workless can scale to more than 1 worker based on the current work load. You just need to define these config variables on your app, setting the values you want: