Could this be the first computer to recognise and appreciate art?

This ambitious project is trying to create an artificial art blogger.

Shares

Tim Mara, Glass Jug: "A painting of a white wall with a tree or quite possibly black and white photograph of a plant in a wall. It is similar to a map hangs on a wall near a hat and a cane."

Computer vision is one of the trickier aspects of artificial intelligence; it's one of the things that we humans are really good at, but that machines have a lot of trouble with. If we see a duck then we can immediately identify it as a duck, no matter what angle we see it from, whether it's swimming or in flight, or if it's partially obscured.

Ian McKeever, Colour Etching: "A book with a digital camera with a few inside of it or I think there is a cell phone holder in front of it. I'm reminded of several different cell phones on a white surface."

For a computer such a feat of identification is near-impossible, but there are great advances being made with computer vision; for a demonstration of what a deep neural network can 'see', head over to this site and try uploading some photos. It's basic and prone to error, but it's heading in the right direction.

Robert Medley, A Tree Study: "There is a person holding a very large rock hill or rather some people being put on a small rock. It is similar to there may be a avalanche, lets grab some cocoa."

Identifying the subjects in a photo is all very well, but how does a computer cope when presented with art? Thankfully there's a site devoted to that very question. Novice Art Blogger is a project by artist and researcher Matthew Plummer-Fernandez, in which he's exposing a deep neural network to art for the first time.

Richard Long, Red Slate Circle: "A group of people sit on the beach with two bags but also a group of people are on the beach with blankets. Reminds me of people on a beach, walking and laying on blankets."

Using state-of-the-art deep learning algorithms, the system looks at each piece of art and then tries to describe what it sees, and the results are strangely fascinating; its attempts to try to make sense of an image and provide a literal breakdown of what's in it can be unintentionally hilarious, and often it'll see things hidden within noise that we'd never spot, or perhaps ask for some cocoa.

Julian Opie, There Are Hills in the Distance: "A picture of its side suspended on a wall but also a hand leaning against a wall that has a sign on it. That reminds me of a phone hanging from the side of a wall."

In its current state, Novice Art Blogger comes across a little like a toddler trying to explain artwork, and some of the comparisons it comes out with are delightfully daft and not a little surreal. As it learns, though, it should hopefully become a lot more adept at its task; could it become the first artificial art critic a few years down the line?