How windy is Wellington? – Using Power Query to gather wind data from web

Let’s take a whirlwind trip to coolest little capital – Wellington. It is a windy place, so hold on to your hats and spreadsheets.

Almost everyone who spends more than 2 days in Wellington would agree that it is a windy place. But how windy is Welly? In this two part series, we will use Power Query, Excel charts and coffee to answer that question.

But, first let’s start with a joke.

What happens when you throw a boomerang in Frank Kitts Park?

You will have to buy another one, coz you are not getting that one back.

Extracting the wind data

In order to understand how windy Wellington is, we need to get average wind speeds by day for last several days. Let’s get the data for last 2+ years (ie from 1 Jan 2016 to 21 Feb 2018).

There are many places where you can collect latest wind data. But when it comes to historical wind data, surprisingly few resources are available. We can use The National Climate database – CliFlo, to gather wind data. But the interface is confusing and I could only locate gust speeds, rather than average wind speeds over time.

We can use wunderground.com to fetch weather data for up to 13 months at a time.

But we need data for almost 26 months.

Very simple, we can query wunderground twice (or thrice), once per each year.

All we had to do is, change 2016to 2017 & 2018 to get respective data.

The actual data set will be a web page. But we can use power query to extract the portion of page that contains weather information.

On to Power Query – Building our Weather Data Extractor

Note: This is a slightly advanced tutorial on PQ. If you are a beginner, start with Introduction to Power Query and work thru examples on PQ tag page before reading any more.

Getting data from the web – building URL in parts

Open Excel and go to Data > New Query > From Other Sources > Web

For Power BI, this would be Edit Queries > New Source > Web

Switch to “Advanced” mode and enter the URL as parts like below. We will switch the 2016 part to parameters soon, so we could get data for any year easily.

In the navigation pane, select “Table 1” which is the weather table.

Set up a parameter for Year

How would we get data for 2017 or 2018? Simple, we use parameters. These are like variables which can be plugged in to any part of your Power Query process.

In Power Query Editor, go to Home > Manager Parameters > New Parameter and call it Year. Enter the default value as 2016.

Now, go back and edit the source settings for the query and replace 2016s with parameter Year.

Cleaning the weather table

Turns out the weather data table is not clean. Although there are 366 days in 2016 (leap year), Wunderground adds headers for each month. So we end up with 378 rows (excluding the header). Each header contains month name and repeat of all the column names. We can extract the month name & combine that with date and year parameter to create the date for each row.

Here is a quick illustration of what we need to do.

But first, rename the very first column

Notice the first column? It is called as 2016. This is ok if we are interested in just 1 year of data. But if we re-run this query with Parameter=2017, our column heading will change. If you have dabbled with Power Query a few times, you will quickly realize that PQ will get in to a nasty fit anytime column headers change and impact downstream steps.

Download Example Workbook

Please note that this workbook is designed in Excel 2016. It may not work in older versions of Power Query. You can replicate most of the steps. Try doing it so that you will learn more about Power Query.

In the next part – Wind in Wellington – few visualizations

In the next part of this tutorial, we will build some visualizations to understand how windy Wellington gets and what is the best time to enjoy the beautiful outdoors.

Stay tuned.

How are you using Power Query? Please post about your power query escapades in the comments section. Also tell me how you went about re-creating the steps in this tutorial. I am all ears.

Why there are no undercover cops in Wellington? Their cover was always getting blown. That is why.

Hello Awesome...

My name is Chandoo. Thanks for dropping by. My mission is to make you awesome in Excel & your work. I live in Wellington, New Zealand. When I am not F9ing my formulas, I cycle, cook or play lego with my kids. Know more about me.

hi chandoo,
i've tried using power query, however i face a rather weird problem. when i click on 'from web' option, the URL window does not show option for basic and advanced. thus i'm unable to form parameters in URL. how i can resolve this issue?

At Chandoo.org, I have one goal, "to make you awesome in excel and charting". This blog is started in 2007 and today has 1,000+ articles and tutorials on using excel, making better charts and workbooks. Read more.