AQ – what’s next?

For more background read this post and this one. 

Last weekend we hosted the second Aberdeen Air Quality hack weekend in recent months. Coming out it there are a number of tasks which we need to work on next. While some of these fall to the community to deliver, there are also significant opportunities for us to work with partners.

The Website

While the Air Aberdeen website is better, we still need to apply the styling that was created at the weekend.

draft web design
Draft web design

Humidity Measurement

We’ve established that the DHT022 chips which we use in the standard Luftdaten device model have challenges in working in our maritime climate. They get saturated and stop reporting meaningful values. There is a fix which is to use BME380 chips in their place. These will continue to give humidity and temperature readings, plus pressure,  but due to the different technology used will handle the humidity better. Knowing local humidity is important (see weather data below). So, we need to adapt the design of all new devices to use these chips, and retrofit the existing devices with the new chips. 

Placement of new devices

We launched in February with a target of 50 sensors by the end of June and 100 by the end of the year. So far attendees have built 55 devices of which 34 are currently, or have recently been, live. That leaves 21 in people’s hands that are still to be registered and turned on. We’re offering help to those hosts to make them live.

Further, with the generous sponsorship of Converged,  Codify, and now IFB we will shortly build 30 more devices, and that will take us to a total of 85. We’ve had an approach by a local company who may be able to sponsor another 40. So, it looks like we will soon exceed the 100 target. Where do we locate these new ones? We need to have a plan to strategically place those around the city where they would be most useful which is where the map, above, comes in.

Community plus council?

We really want to work with the local authority on several aspects of the project. It’s not them versus us. We all gain by working together. There are several areas that we could collaborate on, in addition to the strategic placement of future devices.

For example, we’ve been in discussions with the local authority’s education service with a view to siting a box on every one of the 60 schools in the city. That would take us to about 185 devices – far in excess of the target. Doing that needs funding, and while the technology challenge to get them on the network is trivial, ensuring that the devices survive on the exterior of the buildings might be a challenge.

Also, we’ve asked but had no response to our request to co-locate one of our devices on a roadside monitoring station which would allow us to check the correlation between the outputs of the two. We need to pursue that again.

Comparing our data suggests that we can more than fill in gaps in the local council’s data. The map of the central part of Aberdeen in the image above, shows all of the six official sensors (green) and 12 of the 24 community sensors that we have in the city (in red). You can also see great gaps where there are no sensors which again shows the need for strategic placement of the new ones.

We’ve calculated that with a hundred sensors we’d have 84,096,000 data observations per year for the city, all as open data. The local authority, with six sensors each publishing three items of data hourly, have 157,680 readings per annum – which is 0.18% of the community readings (and if we reach 185 devices then ACC’s data is about 0.10% or 1/1000th of the community data) and the latter of course, besides being properly open-licensed, has much greater granularity and geographic spread.

Weather data

We need to ensure that we gather historic and new weather data and use that to check if adjustments are needed to PM values. Given that the one-person team who was going to work on this at CTC16 disappeared, we need to first set up that weather data gathering, then apply some algorithms to adjust the data when needed, then make that data available.

Engagement with Academia

We need to get the two local universities aboard, particularly on the data science work. We have some academics and post-grads who attend our events, but how do we get the data used in classes and projects? How do we attract more students to work with us? And , again we need to get schools to only hosting the devices but the pupils using the data to understand their local environment?

The cool stuff

Finally, we when we have the data collected, cleaned, and curated, and APIs in place (from the green up through orange to red layers below) we can start to build some cool things (the blue layers).

AQA Data Layers
AQA Data Layers

These might include, but are not limited to:

  • data science-driven predictive models of forecast AQ in local areas,
  • public health alerts,
  • mobile apps to guide you where it is safe to walk, cycle, jog or suggest cleaner routes to school for children,
  • logging AQ over time and measuring changes,
  • correlating local AQ with admissions to hospital of cases of COPD and other health conditions
  • inform debate and the formulation of local government strategy and policy.

As we saw at CTC16, we could also provide the basis for people to innovate using the data. One great example was the hacked LED table-top lamp which changes colour depending on the AQ outside. Others want to develop personalised dashboards.

The possibilities, as they say, are endless.

Aberdeen Air Quality

Update: A write-up of this event which took place on 16-17th February 2019 is available on this page.

How much do you care about the quality of the air you breathe as you walk to work or university, take the kids to school, cycle or jog, or open your bedroom window?

How good is the air you are breathing? How do you know? What are the levels of particulates (PM2.5 or PM10) and why is this important?

pm25_comparison
pm25_comparison

When do these levels go up or down? What does that mean?

Who warns you? Where do they get their data, and how good is it?

Where do you get information, or alerts that you can trust?

We aim to sort this in Aberdeen

Partnering with community groups, Aberdeen University and 57 North Hacklab, we are working on a longterm project to build and deploy community-built, and hosted, sensors for PM2.5 and PM10. We aim to have fifty of these in place in the next few months, across Aberdeen. You can see some early ones in place and generating data here.

The first significant milestone of this will be the community workshop we are holding on 16-17 February 2019. If you want to be part of it, you can get a ticket here. But, be quick; they are going quickly.

Weekend activities

There are loads of things you can do if you attend.

Sensor Building

For a small cost, you can come along and build your own sensor with someone to help you, and take it home to plug into your home wifi. It will then contribute data for your part of the city.

But we will be doing much more than that.

Working with the data

If you have experience in data science or data analysis, or if you want to work with those who do, there are loads of options to work with the data from existing and future sensors.

These include

  • Allow historical reading to be analysed against the official government sensors for comparison
  • Use the data; wind speed, humidity… to build live maps of readings to identify sources of emissions.
  • Compensate readings from sensors against factors which affect pollution levels to attempt to understand the emissions of pollutants in a given area.
  • Build predictive models of future pollution
  • Fix a minor issue with the existing data Collected Data (see https://github.com/opendata-stuttgart/madavi-api/issues/8 )
  • Build an API for the access of the Luftdaten sensor data to allow querying of the sensor data

Software development

If you are a software developer or studying to be one, you could

  • Create alerts systems to warn of anticipated spikes in pollutants, perhaps using Twitter, or email.
  • Add to the code for the Luftdaten sensors to allow connection over LoRaWAN interface.
  • Create LoRaWAN server code to allow sensors to feed up to the Luftdaten website.
  • Security testing of the IoT Code used by the Luftdaten sensors.

Community Groups / Educators / Activists / Journalists

You don’t have to be a techie! If you are a concerned citizen, and community activist, a teacher, or a journalist there is so much you could do. For example:

  • How can you understand the data?
  • Identify how this could assist with local issues, campaigns, educational activities.
  • Help us capture the weekend by blogging, or creating digital content

Even if you just want to be part of the buzz and keep the coffees and teas flowing, that is a great contribution.

See you there!

Ian, Bruce, Andrew and Steve

Header image by Jaroslav Devia on Unsplash

2018 – A year in review

2018 has been a really busy year for us. Here are all the things that we delivered.

Open Data Camp

We hosted UK Open Data Camp’s first ever visit North of the border in November. Over a hundred people travelled to Aberdeen for two days of unconferencing where there were 44 sessions run on a variety of data-related topics. Some people went for an Aberdeen version of the Joy Diversion walk around old Aberdeen, and others discovered the pleasure of logging Open Benches. The feedback was overwhelmingly positive and there were loads of write-ups.

Code the City Hack Weekends

We had two great Code The City Events: CTC13 – Hacking our Relationship with Alcohol, and CTC14 – Archaeology. Both were well attended and produced some very interesting results. The first saw us tackling some interesting real-world problems, helping people to overcome problems, and build a machine learning model to predict whether a beer can design would be more likely to be perceived as alcoholic or not. A report of the weekend is being written as an academic paper for a forthcoming health conference!

 

The second weekend saw us scanning and creating 3D renders of six real skeletons with mobile phones. We also began to create a 3D model of the church in which the dig took place, and generate data from written logs to populate that.

Well done to all who participated. We got some great feedback on each event.

Data Meetups

Wearing our ODI hats, we launched the new monthly Data Meetups in April – and managed to squeeze in nine of them this year. These are really well attended, and saw over 300 people in total coming out on a Tuesday night to hear speakers from across the country on a diverse range of data topics. These ranged from Creating a Data Culture in your business, to public Open Data; from the data of Scottish Football to the use of blockchain in Oil and Gas; and from the use of IoT in Agriculture to extracting data from photos published on Flickr in order to assist conservation.

Open Data

We’ve also been lobbying the Scottish Government and the city council on Open Data, as Ian has been writing on our sister site. That is starting to bear fruit. Aberdeen City Council have soft-launched a new open data platform, and are recruiting a manager for their open data work. While this is good, it is not as impressive as Dundee and Perth‘s new platforms, yet. The Scottish Cities Alliance are recruiting a new programme manager, and Ian has been invited to be part of a round table discussion on the way forward for Open Data hosted by the Scottish Government next February. It sounds like things will start to move in the right direction in 2019!

Research

Ian and Andrew have worked with ODI HQ to run two local workshops, contributing to two national pieces of research: the first on the effects of Peer to Peer markets on accommodation, and a second on what barriers there are to the better use of Ordnance Survey data and services.

Here’s to an equally successful 2019! Have a great festive break folks!

Ian, Andrew, Steve, Bruce

 

An open letter to Aberdeen City Council

It has been well documented that there is a problem with Aberdeen City Council and their approach to Smart City and Open Data in particular. See these posts, these requests and this github page from a project at CTC11, where we tried to help fix things. Today, a Finnish researcher on Smart Cities posted this on Reddit!  International reputation? What international reputation!

Now it appears that in the relaunch last week of the Aberdeen City Council website, the council has ditched masses of content. This includes the city-wide What’s On which was until recently the most heavily-used part of the council website and which provided an extremely useful community resource.

More digging – well Googling of some popular terms for council website content  and functions – returns nothing but 404 errors. See the list below for some examples.

When, in 2006 when when the site last underwent a major update, the small team took just six months on the transition, beginning to end. No content was lost or broken, and with URL rewriting and redirects they ensured that everything worked on day one.

The council have been working on the current relaunch – on and off as managers were swapped around or were dispensed with – for two years! And the mess of the site, with massive holes in content and functionality,  far outweighs the much-improved look and feel.

So, what is the plan to restore content, much of which is a matter of public record?

We, as tax-payers, have paid for the creation of functionality and information which is of significant public use. So, where has it gone?

For example where is:

Don’t the citizens of Aberdeen deserve better than this?

Maybe someone would care to make an FOI request to the city council – to ask what data the decision-making on transfer of content and functionality was based on, and get a copy of the website stats for the last three months? I think they are fed up of me.

Ian

CodetheCity 11 – First project updates

A healthy turnout for Codethecity 11. Following a few introductions, seven project ideas were pitched to the group:

  • Aberdeen open data – where is it?
  • Plant watering wifi greenhouse guardian
  • Guide to Aberdeen
  • Idea gathering system
  • Computational model of a heart
  • IOT Edge video recognition using Rasp Pi
  • Robot theatre

Following the first hour of work, six teams had formed around these ideas. Just before lunch this is how the projects looked:

Aberdeen Guide

Working on data gathering and structure, form completed by more than 30 people already and team is working no adding structure to this.

Codipi

Working with a combination of Raspberry Pi and MS Cognitive Services to do interesting things with image feeds. Hello Pi is now working, and initial research around using the image processing API.

20171125_121742

PROD – Please Release Open Data

Team are working on pulling together a picture of the rate of open data progress in cities across the UK. Turning this into an infographic, while also working on data santa idea.

20171125_123730

Out of Storage

Arduino project to create an interactive robot theatre. It’s alive – and the team are adding sophistication to the number of aspects that can be controlled.

img_20171125_120837-1

Feed Me Now

The greenhouse management service is coming together. Sensors are dangling out of the windows of Fraser Noble Building confirming that it’s a little chilly out there. Ian is currently experimenting with http://www.blynk.cc/ as a shortcut for getting the boards talking to the internet. Working while tied by USB already.

img_20171125_130252

Heartshare

The team is working on a simulation of a human heart – starting with a sphere as a simplistic model, and building from that.

 

What can I do at Codethecity 11?

We’ve had loads of positive comments that CTC is returning on 25-26 Nov with a Christmas themed hack weekend.

Other than at our very first CTC weekend, we’ve tended to have a theme – health, culture, sport etc. Those themes have put some shape around the weekends’ activities and helped people to identify challenges to work on, projects to tackle and solutions to develop. Which is great.

Who should attend?

Anyone – despite our name, coding is a small bit of what we do. We’d be delighted to see you if

  • You are a service user, or service provider, who has a problem with service delivery, or sees an opportunity to do things better!
  • You have an interesting in service design,
  • You are someone who wants to do more with data but isn’t sure where to start
  • You are a student (of any discipline),
  • You are someone who wants to improve their local area, or use digital and skills to improve local services,
  • You are from the third sector or local government,
  • You are curious about learning new techniques and skills to use in your day job, and finally
  • Of course, if you are a developer, designer, UX expert, data wrangler, coders, or service designer.

What to expect

For many of our serial-attendees, they know what to expect and how we work. So they are happy to go with the flow. If you haven’t been to a CTC event before, having a look at those links above will give you an idea of how things go.

Some others have asked ‘why no theme this time?’ – perhaps expecting a more traditional service-type theme.

Well …… there is a theme: FUN.

If you come along, you can interpret that pretty much as you like!

Tell me more

Here are some examples, of some suggestions that we’ve heard. How much fun you consider them is a personal matter!

  • Bruce has been posting about how he would like to crowd-source a guide to fun things to do in Aberdeen.
  • Andrew has let it be known that he wants to work on his arduino-powered mini-theatre – and you would be welcome to work on it too.
  • Steve is threatening to take some robot-artist device for you to programme to sketch rude pictures with.
  • Ian has suggested that his classmates from RGU get stuck into a resurrected project to scrape FOI data.

There also have been mention of building a Raspberry Pi-powered hadoop cluster, citizen-science style home data scraping kits and a whole bunch more.

Maybe you want to create some software to write (and tweet?) its own cracker-style jokes. Or a platform to lobby councillors to provide better open data, or anything else [We said fun – Ed].

It is entirely up to you. But as you think up some ideas, you might want to consider two things:

  • Will you manage to pitch the idea at the opening session to others so that they will work with you on it? Building a project team is much more productive than working solo on something. To do the latter you could stay at home.
  • Would it impress Santa? If you want the funny old fellow to reward your efforts you need to impress him, spread a little happiness, or make something that improves lives.

And, finally …..

If you don’t have an idea to bring, that is cool too. We’ll start the Saturday with some pitch sessions, so listen to others and join a team to work on their project which inspires you.

Don’t delay, get a ticket now! Otherwise, you might be disappointed!

See you there.

Ian, Steve, Andrew, Bruce

CTC9 – Team Presentations

In this close-out post I shall hand over to the teams themselves to walk you through their CTC9 weekend. Check out the videos using the links below. Use the ‘ctc9’ tag to find all other blog posts about the amazing volunteering experience this weekend.

Team: Soul Cats

Team: The Professionals

Team: ALISS API