mattyw

Monday, June 3, 2013

I was at GoSF last month (9th May) when Andrew Gerrand gave his talk on go 1.1. At the end of the talk a couple of questions came up on the subject of generics. You can see them on this video at 1:09:20 and 1:14:40. (The questions aren't audible, but the answers are)
If you don't want to watch the video (you should) the summary (and I'm paraphrasing alot here) was essentially that it's not that anyone is trying to keep generics out of go, but rather no one has found a nice way of putting them in. Andrew went on to mention that he didn't miss them at the moment as copying and pasting a few for loops and if statements was an ok alternative.
I nodded in agreement at the time, but last week I proved it to myself in code, so I thought I'd blog about it. I found myself wanting to add up the value of some things in a list, here's a very trivial substitute for the actual code:
It's nothing ground breaking, you could say I'm folding (or reducing) over the list, you could also just say I'm adding up the price of all the things. It would be nice to have a generic fold that I could use to explicitly say that I'm folding over the list, but what advantage would this give me?

I probably wouldn't just call fold by iteself, i'd probably still put fold inside the TotalPriceOfBasket function so that I can state the purpose more explicitly, and the reader would be left with a much simpler looking function, but - and here's my point. fold, map, filter should be recognisable as patterns. You should be able to look at a function and say "Of yeah, a fold, ok"

I'm not making any statements here about how useful generics are or aren't. or how useful a fold/map/filter function would be in go, all I'm saying is that I can live without them for now. Especially as the reason they're not currently in the language is that the core contributors haven't found a good way of implementing them. There's a lot to be said for that approach.

Thursday, May 23, 2013

I've just been reading Stavros' blog post about provisioning and deploying virtual machines using ansible:
An example of provisioning and deployment with Ansible.
It's worth a read, I've recently come round to the same way of thinking - keeping my development machine as clean as possible and using virtual box machines to install dependencies on, but there's another side to it. Sometimes I want a machine without having to divide my laptop's precious resources, using the cloud that type of thing is easy. But using ubuntu's juju it's even easier.
juju.ubuntu.com is ubuntu's answer to service orchestration. There's a good video of it in use at OSCON 2012. It's great at the large stuff but it's also great at small stuff - which is where this post comes in. I find it helpful to just think of juju as a way of installing charms on a cloud machine, and charms are just scripts. That way it sounds less scary.
I've got some very simple charms for you to get started here. The one I'm going to cover in this post is called devenv. The purpose of devenv is to setup a simple development environment in the cloud. Sometimes I need to make use of mysql, mongo or postgres, so it covers those as well
How to deploy devenv
After you've followed the intructions on http://juju.ubuntu.com/get-started to get setup with your cloud provider it's as simple
as running the deploy_devenv.sh script in my charm_collection repo. Here's what's going on under the covers:

With juju deploy we're expecting to see our charm in the charms/precise/devenv folder below the current directory. Juju then zips the charm up and deploys it on a machine of at least 8GB memory, which we specified with out mem=8G constraint.
Deploying our charm means running a couple of hooks. install and start. Hooks are just scripts which get run on the deployed machine.
Install looks like this:

There's nothing much going on here, make sure some packages are installed, copy some of my configuration files from github to the right places and set vi editing-mode in bash. I could, and probably will add to this by getting my install hook to clone the right repositories, install a few more languages and maybe copy around some of my ssh keys, but this is a good start.
Because all I want to do is install some applications and not run any services the start hook just echos that I'm now up and running.

#!/bin/sh
echo "Running"

The interesting part is the relationships with databases, sometimes I need to be able to use a database for my development work. This can be done by making use of juju's relationships. For convenience I've got 3 hooks that point to the same python file:

for this relationship all I want to do is write a config file to my home directory, so that I can make use of the db. The database charms set a number of key/value pair using the relation-set command. all I need to do is call the relation-get command when I want to get a particular value. Here's how it's done for mongo and mysql:

To start create a relationship you just need to tell juju to make one:

juju add-relation devenv mongodb

This will add a relation between my devenv machine and a machine running mongo (which I would have deployed previously)
From here, I have a cloud machine up and running with all the tools I need, and a mongo db ready to use.

1 PC (I'm using linux, it should work equally well on osx, not sure about windows.)

How can I edit files on my raspberry pi using an editor on my pc?

Create an empty folder on your PC:

mkdir ~/pi

Then use sshfs to mount it

sshfs pi@192.168.1.82: ~/pi/

Where pi is my user name and 192.168.1.82 is the ip address of the pi.
Now, on my pc if I cd to ~/pi I can see the files in the home directory of my pi, which means I can open them on my pc using my editor of choice

How can I run minecraft on a raspberry pi with a screen connected but without a mouse and keyboard connected?

From your pc ssh into the pi specifying -X

ssh -X pi@192.168.1.82

This turns on X11 forwarding - you don't need to know what that means for now, just start minecraft from inside ssh. You should see an empty minecraft window appear
Now take a look at your monitor, you should see minecraft there and be able to use your laptop's mouse and keyboard to move yourself around
As a bonus, you should be able to drag the window around on your pc, and have the window move around on your pi as well

I've got two solutions to this problem. I would love to know of better ways.

SolutionA: map and type assert

If we tell json to unmarshal into a map we can get it to deal with the parts we know
about, and the rest of it will go into an interface{}. As we loop over the json
structures we use what we do know about the structures to pass the interface{} to
some helper functions what will create one of our structs and add it to our list.
Because the map we take in is a map[string]interface{} we will need to type assert our
values

With this struct we can then unmarshal our json string into a list of these mixed
types. As we loop over our Mixed structs we just need to examine each one to
work out which type it represents, and then build the right struct from it

These are just two ways I've used to solve these problems, I'd love to know how
others have done it.

SolutionC: json.RawMessage (Updated 18Jan13)

Thanks to Jordan's comment and zemo on reddit there is another solution.
Using the json.RawMessage structure in the json package we can delay unmarshalling the json structures in the list. We can then go through our list and unmarshal each of them into the correct type

Sunday, December 30, 2012

Lots of people like go and this year I began to find it unavoidable - I'm even ending the year with go being the main language that helps pay my bills!

One of the things that go lets you do is pass functions around.
I started the year talking about under from the j language. Which lets you 'bookend' some function with another function (a verb) and a function which undoes that function (obverse).
A great example is Pythagoras' theorem:

You perform some 'pre-processing' on each value (squaring)

You add all the values up

You square root the result

I started the year talking about under in clojure. Here it is implemented in go. Complete with functions being passed around, closures, and functions returning functions. Happy new year!

Monday, October 22, 2012

I've just tried following the instructions here to get juju running locally on my brand new Ubuntu 12.04 (desktop) system.
No matter what I tried my wordpress and mysql charms seemed stuck in agent-status pending and ip address null. Even waiting a couple of hours.

I needed to take to a couple of extra steps to get it working that didn't seem to be documented in one place. So I thought I'd put them both here.