Category Archives: public policy

Government Procurement Failure: BC Ministry of Education Case Study

Apologies for the lack of posts. I’ve been in business mode – both helping a number of organizations I’m proud of and working on my own business.

For those interested in a frightening tale of inept procurement, poor judgement and downright dirty tactics when it comes to software procurement and government, there is a wonderfully sad and disturbing case study emerging in British Columbia that shows the lengths a government is willing to go to shut out open source alternatives and ensure that large, expensive suppliers win the day.

The story revolves around a pickle that the province of British Columbia found itself in after a previous procurement disaster. The province had bought a student record management system – software that records elementary and secondary students’ grades and other records. Sadly, the system never worked well. For example, student records generally all get entered at the end of the term, so any system must be prepared to manage significant episodic spikes in usage. The original British Columbia Electronic Student Information System (BCeSIS) was not up to the task and frequently crashed and/or locked out teachers.

To make matters worse, after spending $86M over 6 years it was ultimately determined that BCeSIS was unrecoverably flawed and, as the vendor was ending support, a new system needed to be created.

Interestingly, one of the Province’s school districts – the District of Saanich – decided it would self-fund an open source project to create an alternative to BCeSIS. Called OpenStudent, the system would have an open source license, would be created using locally paid open source developers, could be implemented in a decentralized way but still meet the requirements of the province and… would cost a fraction of that proposed by large government vendors.  The Times Colonist has a simple article that covers the launch of OpenStudent here.

Rather than engage Saanich, the province decided to take another swing at hiring a multinational to engage in a IT mega-project. An RFP was issued to which only companies with $100M in sales could apply. Fujitsu was awarded a 12 year contract with costs of up to $9.4M a year.

And here are the kickers:

So in other words, the province sprung some surprise requirements on the District of Saanich that forced it to kill an open source solution that could have saved tax payers millions and employed British Columbians, all while exempting a multinational from meeting the same requirements. It would appear that the province was essentially engaged in a strategy to kill OpenStudent, likely because any success it enjoyed would have created an ongoing PR challenge for the province and threatened its ongoing contract with Fujitsu.

While I don’t believe that any BC government official personally profited from this outcome, it is hard – very hard indeed – not to feel like the procurement system is deeply suspect or, at worst, corrupted. I have no idea if it is possible, but I do hope that these documents can serve as the basis for legal action by the District of Saanich against the Province of British Columbia to recapture some of their lost expenses. The province has clearly used its purchasing power to alter the marketplace and destroy competitors; whether this is in violation of a law, I don’t know. I do know, however, that it is in violation of good governance, effective procurement and general ethics. As a result, all BC tax payers have suffered.

Addendum: It has been suggested to me that that one reason the BC government may be so keen to support Fujitsu and destroy competing suppliers is because it needs to generate a certain amount of business for the company in order for it to maintain headcount in the province. Had OpenStudent proved viable and cheaper (it was estimated to cost $7-10 per student versus $20 for Fujistu’s service), Fujistu might have threatened to scale back operations which might have hurt service levels for other contracts. Unclear to me if this is true or not. To be clear I don’t hold Fujistu responsible for anything here – they are just a company trying to sell their product and offer the best service they can. The disaster described above has nothing to do with them (they may or may not offer amazing products, I don’t know); rather, it has everything to do with the province using its power to eliminate competition and choice.

Canada’s Opaque Transparency – An Open Data Failure

Yesterday, at the Prospectors and Developers Association of Canada’s (PDAC) Canada Minister of Natural Resource, Joe Oliver, announced with great fanfare a new initiative to compel mining companies to disclose payments of over $100,000’s to foreign and domestic governments.

On the surface this looks like a win for transparency, particularly for a sector that is of great importance to Canada: mining.

And this issue matters since not only do extractive industries represent an important part of Canada’s economy, but the sector has been dogged with controversy. Indeed the Toronto Star just uncovered today a report commissioned (and buried) by the Prospectors and Developers Association of Canada (PDAC) that showed Canadian mining companies have the worst record when it comes to environmental standard and human rights.

Forcing mining companies to account for their payments to foreign and domestic governments won’t solve every problem, but it can help curb corruption. Indeed the issue was seen as so important that at the last G8 summit, the leaders agreed that companies should be compelled to disclose these payments.

Happily, there is a legitimate global movement to make government payments by extractive industry companies more transparent. It is called the Extractive Industries Transparency Iniative (EITI). It has set a series of standards for disclosing such payments so that they are easier to track across borders. In fact EITI is seen as so important it is actually the only organization mentioned by name in the last G8 summit communique. This is the same EITI program about which last year the Minister’s press secretary boasted:

Since 2007 Canada has also been a supporting country of the Extractive Industries Transparency Initiative, and is now the second largest financial donor to the initiative, providing $12.65 million to the World Bank’s Extractive Industries Transparency Initiative Multi-donor Trust Fund…

Which brings us to Minister Oliver’s important announcement.

Did the government announce that it was joining 42 other countries, including its G8 partners the United States, the United Kingdom, France, Germany and Italy to join the standard it has been a major funder of?

No. It did not.

Apparently EITI is good enough to fund so that others can implement it. When it comes to actually doing what is effective… the government balked. Canada, apparently, is going to adhere to its own “unique” approach.

And it gets worse.

Read the Minister’s statement more closely, particularly this line:

“We want to make it as easy as possible, so we will not create a central database. Instead, we would require that reports be posted to company websites, with the government and public notified.”

So unlike EITI, which offers a centralized repository where records can quickly be downloaded and compared, Canada’s “compliance” will involve each company to maintain their own records “somewhere” and will require anyone interested if actually figuring out what is going on to go and track down each one individually.

We call this secrecy by obscurity. It makes a mockery of the notion of transparency.

We have a global infrastructure designed to make disclosure cheap, easy and effective. Infrastructure our own government has poured $12.7M into it. And we turn around and ignore it all.

Canada claims it wants to be a leader in open data. But if it can’t even get something basic like this right… such claims sounds increasingly silly here at home, among our G8 partners and, well, among the rest of the world.

Addendum: It gets worse still. Few people have noticed yet, but Canada recently (and quietly) stopped reporting the names of corporate directors in the public database of the country’s firms. This is a major step backwards and makes those who benefit from one of the most important benefits society can confer – limited liability – invisible to the public who confers that right. This is a major step backwards. Read this wonderful Economist article on why. More on this to come.

Great Hacks from the Open Data in Vancouver

Last weekend I helped host an Open Data Day in Vancouver. With the generous support of Domain7, who gave us a place to host talks and hack, over 30 Vancouverites braved the sleet and snow to spend the day sharing ideas and working on projects.

We had opening comments from Andy Yan – whose may be the most prolific user of Open Data in Vancouver, possibly Canada. I encourage you to check out his work here. We were also incredibly lucky to have Jeni Tennison – the Technical Director of the Open Data Institute – onsite to talk to participants about the ODI.

After the opening talks, people simply shared what they hoped to work on and people just found projects to contribute to. Minimal organization was involved… and here a taste of the awesome projects that got worked on! Lots of ideas here for other communities.

1. Open Data Licenses Resource: JSON + search + compatibility check = Awesome.

Kent Mewhort, who recently moved to Vancouver from Ottawa (via the Congo) updated his ongoing CLIPol project by adding some of the recently published licenses. If you’ve not seen CLIPol it is… awesome. It allows you to easily understand and compare the restrictions and rights of many open government licenses.

CLIPol Data

Better still CLIPol also lets you to see how compatible a license is (see example here). Possibly the best tool of all is one that allows you to determine what license you can apply to your re-mixed work in a way that is compliant with the original licenses (check out that tool here – screenshot below).

CLIPol compatibility

CLIPol is just such a fantastic tool – can’t recommend it enough and encourage people to add more licenses to it.

2. Vancouver in MineCraft

I have previously written about how Minecraft is being used to help in public consultations and urban planning – I love how the game becomes a simple tool that enables anyone to shape the environment.

So I was crazy excited I heard that Ryan Smith (aka Goldfish) had used the City of Vancouver’s open elevation data to recreate much of the city in Minecraft.

Below is a photo of Ryan presenting at the end of the day. The projection behind him shows Stanley park, near Siwash Rock. The flat feature at the bottom is the sea wall. Indeed Ryan notes that the sea wall makes for one of the clearest features since it creates almost perfectly flat structure along the city’s coast.

Mincraft Data

3. Vancouver’s Capital Budget Visualized in Where Does my Money Go

It is hard to imagine a project going better. I’m going to do a separate blog post on it.

This is a project I’ve always wanted to do – create a bubble tree visualization with Where Does my Money Go. Fortunately two developers – Alexandre Dufournet and Luc Lussier – who had never hacked on open data jumped on the idea. With help from City of Vancouver’s staff who were on site, I found a PDF of the capital budget which we then scraped.

WDMYG Data

The site is not actually live, but for developers who are interested in seeing this work (hint, hint City of Vancouver staff) you can grab their code from github here.

4. Monitoring Vancouver’s Bike Accident Data – Year 3

Eric Promislow has been coming to Open Data Hack-a-thons ever since Luke Closs and I started organizing them in 2009. During the first Open Data Day in 2011 you can read in my wrap up post about a bike accident monitoring website Eric created that day which Eric would eventual name Bent Frame. Well, Bent Frame has been live ever since and getting bigger. (Eric blogs about it here)

Each open data day, Eric updates Bent Frame with new data from ICBC – the province’s insurance monopoly. With over 6 years of data now in Eric is starting to be able to analyze trends – particularly around the decline of bike accidents along many roads with bike lanes, and an increase in accidents where the bike lanes end.


Bike Data

I initially had conversations with ICBC to persuade them to share their data with Eric and they’ve been in touch with him ever since, passing along the data on a regular basis. It is a real example of how an active citizen can change an organization’s policies around sharing important data that can help inform public policy debates.

5. ProactiveDisclosure.ca – Making government information easier to search

Kevin McArthur is the kind of security guy most governments dreads having around but should actually love (example his recent post on e-voting).  He continued to hack on one of his side projects: proactivedisclosure.ca. The site is a sort of front end for open data sets, making it easier to do searches based on people or companies. Thus, want to find all the open data about a specific minister… proactive disclosure organizes it for you.

Proactive Data

Kevin and a small team of players uploaded more data into their site and allowed it to consume unstructured data. Very cool stuff.

6. Better Open Data Search

Herb Lainchbury – another fantastic open data advocate – worked on a project in which he tried to rethink what an open data search engine would look like. This is a topic that I think matters A LOT. There is simply not a lot of good ways to find data that you are interested in.

Herb’s awesome insight was invert the traditional way of thinking about data search. He created a search engine that didn’t search for the data set keywords or titles, but rather searched the meta data exclusively.

One interesting side outcome of this approach is that it made related data sets easier and, made locating identical data sets but from different years a snap. As Herb notes the meta data becomes a sort of “finger print” that makes it easy to see when it has been duplicated. (Quick aside rant: I loath it when governments releases 20 data files of the same data set – say crime data – with each file representing a different year and then claiming that it is 20 unique data sets in their catalogue. No. It is one data set. You just have 20 years of it. Sigh).

7. School Performance Chart

Two local video game programers – Louie Dinh and Raymond Huang – with no experience in open data looked around the BC Government Open Data catalogue and noticed the data on test scores. Since they attended school here in British Columbia they thought it might be interesting to chart the test scores to see how their own schools had preformed over time.

They were able to set up a site which graphed how a number of elementary schools had performed over time by looking at the standardized test scores.

Test SCore Data

This is just a great example of data as a gateway to learning. Here a simple hackathon project become a bridge for two citizens to dive into a area of public policy and learn more about it. No one is claiming that there chart is definitive, rather it is the start of a learning process around what matters and what doesn’t and what can be measured and what can’t in education.

Congratulations to everyone who participated in the day – thank you for making it such an amazing success!

Open Data Day 2014 – Five Fun Events Around the World

With over 110 Events happening world wide it is impossible to talk about every Open Data Day event. But looking almost every event on the wiki I’ve been deeply moved and inspired by the various efforts, goals and aspirations of the people who have organized these events.

In order to help others understand why Open Data Day matters as well as what can happen on it, here are five open data day events that I’m stumbled across that are doing something particularly fun or interesting.

1. Capetown & Johannesburg, South Africa

Their Description:

Coders, data wranglers and data investigators will pair up to look at one of three openly available datasets we have on hand, and work out the most interesting questions they can ask of it in less than half an hour. After 30 minutes, it’s all change – another desk, another partnership, another exciting data set to turn into a story.

What we’re hoping is that you’ll learn tips and tricks for getting data, querying it, creating quick visualizations and turning it to stories that people want to know about. You’ll learn from different people with a variety of skills, hopefully that you wouldn’t normally work with. And we’re also hoping it will be four hours of fun.

Why I love it: I love the focus on learning. With the participation of hacks and hackers the goal is clearly to help journalists and citizens learn new skills, not so they can do something with the data sets available on open data day, but so they can better play with data sets in the future to pursue stories or help a community. The point of speed data dating is thus not to build a product, the product is the skills and networks developed and, with luck the future stories and analyses that will be told by those who participated.

2. Buenos Aires, Argentina

Their description:

On February 22nd we will go out to the street and play with local data and some street artists to create beautiful visualizations.

Why I love it: Street art open data? What a great way to try to raise awareness of the importance of data literacy and transparency. In addition, how awesome is it to move outside the digital realm and use data to create artifacts that are not necessarily digital. And if there are artists involved? Jer would be so happy to read about this.

3. Greenfield, MA, United States

Their description:

We’re convening a small group to work with the Franklin Regional Council of Governments on a user-friendly way to map private wells in Western Massachusetts…

…Why is it important to map wells?

  • Only about 5% of private wells in Massachusetts are geolocated.
  • Many towns in Western Mass rely 100% on private wells.

Not knowing where our wells are can (and does) lead to water contaminated by nearby septic systems, dumping, and pollutant storage. Aside from the obvious health concerns, there are also financial implications from remediation costs and lowered property values.

Why I love it: Wow, WOW, WOW!!! This is maybe one of the coolest open data day events I’ve ever seen. Here you have a small community focusing on a problem that is real and tangible to them. Moreover, open data could have a direct and meaningful impact on the issue. I love the focus. I love that rallying point. I love the high impact with low resources (their building has minimal heat – so they are advising people to layer up). I wish these crew all the best success and hope to see an update.

4. Nagoya, Japan

Their Description:

Now, highlight of this year is “data of Nagoya Castle!”

The nearly 300 maps and survey drawings of the Nagoya Castle will be made open prior to Open Data Day. The Nagoya Castle office is cooperating with us and has decided that we can use their data for “International Open Data Day.” The references to the image are here.

Why I love it: Well – fill disclosure, my understanding of this event is through the prism of Google translate. But if I understood correctly… there are a few open data events in Japan that have a strong focus on local history which I find totally fascinating. At this event in Nagoya they are bringing in a professor who is an expert in open data as well as expert in the Nagoya castle to talk about the data that is being made open. In addition they are organizing and actual physical tour of the caste. Open Data meets local history buffs!

5. Cairo, Egypt

Their Description:

We will be organizing an online and decentralized event in Cairo, Egypt for the Open Data Day. There are numerous suggested tracks depending on the participants set of expertise:

For translators (المترجمون)

  • Open Data Handbook: The handbook discusses the legal, social and technical aspects of open data. It can be used by anyone but is especially designed for those seeking to open up data. It discusses the why, what and how of open data – why to go open, what open is, and the how to ‘open’ data. Translate it into Arabic here
  • Translate any of the School of Data short tutorials, for example, What is Data?Telling a Story with DataFinding Data, or Any other course/modules

For bloggers (المدونون)

Write blog posts about Open Data related topics and case studies, and don’t forget to use the following hashtag, #ODD2014. Possible ideas for blog posts:

  • Write about the concept of Frictionless Data
  • Case studies how you searched for, extracted and used governmental data
  • Listing of local organizations working or promoting Open Data or advocating for more Transparent and Open Governments

For Developers (مطوري البرامج)

  • Scrape data from capmas and put it into Open Format
  • Scrape data (Budget or the The Financial Monthly Bulletin) from the Minister of Finance and upload it to OpenSpending.org,
  • Create a tool to scrap the traffic data from bey2ollak and put it in an open format.

For Data Wranglers (هواة جمع البيانات)

Why I love it: I love that there are calls to action for a variety of people – including those who have no coding skills at all. How genius is it to organize an event to localize/translate the Open Data handbook? This is something a large number of people could do – and better still can help make open data accessible to a still larger pool of people.

And for the other roles the suggestion of projects – particular with a focus on the national budget and government operations data (capmas) suggests there is a strong civil society presence within the open data community. Will be super interested to see what progress they make and if there is broader interest in their work.

Open Data for Development Challenge on Jan 27-28

This just came across my email via Michael Roberts who has been doing great work in this space.

Mail Attachment

Open Data for Development Challenge
January 27–28, 2014 — Montreal, Canada

Do you want to share your creative ideas and cutting-edge expertise, and make a difference in the world?
Do you want to help Canadians and the world understand how development aid is spent and what its impact is?
Do you want to be challenged and have fun at the same time?

If so, take the Open Data for Development Challenge!

This unique 36-hour ”codathon” organized by Foreign Affairs, Trade and Development Canada will bring together Canadian and international technical experts and policy makers to generate new tools and ideas in the fields of open data and aid transparency and contribute to innovative solutions to the world’s pressing development challenges.

The event will feature keynote speakers Aleem Walji, Director of the World Bank’s Innovation Labs, and Mark Surman, Executive Director of the Mozilla Foundation. It will have two related dimensions:

  • Technical challenges that involve building applications to make existing open aid and development-related data more useful. Proposed topics include building a data viewer compatible with multilingual data, creating a publishing tool suitable for use by mid-sized Canadian non-profit organizations, developing and testing applications for open contracting, and taking a deep dive into the procurement data of the World Bank Group. There is room for challenges proposed by the community. Proposals should be submitted through the event website no later than January 8th. Challenges will be published prior to the event, along with key datasets and other related information, to enable participants to prepare for the event.
  • Policy discussions on how open data and open government can enable development results. This would include the use of big data in development programming, the innovative ways in which data can be mapped and visualized for development, and the impact of open data on developing countries.

The international aid transparency community will be encouraged to take promising tools and ideas from the event forward for further research and development.

An overview of the draft program is attached. The event will be in English and French, with interpretation provided in the plenary sessions and panel discussions.

We invite you to register, at no cost, at this website as soon as possible and no later than January 10. A message confirming your registration and providing additional information about the venue and accommodation will be sent to confirmed participants. Please wait for this confirmation before making any travel arrangements. Participants are asked to make their own accommodation arrangements. A limited number of guest rooms will be available to event participants at a preferential rate.

To find out more about the Open Data for Development Challenge, please go to DFATD’s website.

The End of Canada Post and the Coming War for Your Mailbox

As pretty much everyone in Canada learned yesterday (and no one outside the country cares to know), Canada Post, the country’s national postal service will phase out home mail delivery by 2019.  The reason? It’s obvious. The internet has hammered mail volumes. There was 20% less mail delivered in 2012 than 2006. And 6 of that 20% decline occurred in 2012 alone, suggesting the pace is accelerating.

First, I’m really quite happy about (the long term implications of) the demise of home delivery. For me, Canada Post has become a state sanctioned spamming infrastructure. When the little red dot on my mailbox rubs off (as it recently did) the volume of actual wanted mail versus unsolicited mail I receive runs at at least 20% versus 80%. Indeed, the average Canadian household got 1,178 flyers in 2010. About 22 a week. And that doesn’t even count unaddressed mail.

I shudder to think of the colossal waste of paper and energy created by the production, shipping, delivery and recycling the essentially endless circulation of this vast pulp forrest. All the more so given less than 3% probably ever gets looked at, much less read.

The problem is, in the short term at least, things may get worse. Or at least messier. One way of thinking about this change is that your front door just got massively deregulated. I suspect a whole new level of unwanted and unsolicited mail spam is about to hit the more densely populated swaths of the country. So much so, I expect we are going to see – in fact demand – new legislation to regulate physical spam.

Let me explain.

Up until now the cheapest way to send you spam – unsolicited mail or even just targeted advertising – was via the post person. Indeed Canada Post has long depended on this – generally unwanted – mail. You may remember in May, in one of the saddest public campaigns ever launched, Canada Post tried persuading Canadians that Junk mail was good for them.

One of the big advantages of junk mail is, however fleeting, it ended up in your home. Shift delivery to a mailbox out of the house however and you get this:

mailbox mess

Toronto Star File Photo

So there are two implications of the change. The first, as the photo above testifies, is that some – maybe even many advertisers, will feel like their mailers are less effective. They will of course actually know this, since the ROI on mailers is a pretty exact, and measured, science.

The second is that the largest player in the delivery of pulp to peoples homes business will have retreated away from… the home. Leaving a big demand to be filled by new entrants.

Thus, it is quite conceivable that Canada Post may see its junk mail volumes decline faster still. However, I suspect that while mail will decline, unaddressed mail – what you and I think of as flyers – could increase. These flyers, delivered by private players, have the enormous benefit of going right to your front door, just like good old junk mail did. Oh, and deliverers of these flyers don’t have pesky policies that stop them from delivering items to houses with signs that say “no junk mail.”

What does that mean? Well hopefully, in the long term, junk mail proves less and less effective a means of selling things. But I suspect that there will always be an advantage to shoveling 30 flyers a week onto your front stoop. So I can imagine another long term trend. In 2010 the government passed anti-spam legislation that focused on, the digital form of spam. So while I’m quite confident this law will have close to zero impact on digital spammers, for a growing number of Canadians I suspect there is little difference between online and offline spam in their mind. So much so that, it would not surprise me if an uptick in unsolicited flyers and mailers to people’s door – where they no longer get actual mail – make real anti-spam legislation a political winner. Indeed, a clever opposition party, wanting to show the more ill-conceived elements of the government’s plan, burnish its environmental credentials and own the idea early, might even propose it.

Will we get there? I don’t know. But if we just unleashed a wave of new spam and flyers on Canadians, I hope some new tool emerges that allows Canadians to say no to unsolicited junk.

The OGP, Civil Society and Power: Why #CSOday missed its mark

Yesterday in the University of London student union building, civil society organizations (CSOs) from around the world that are participating in the Open Government Partnership (OGP) gathered to prepare for today and tomorrow’s OGP summit.

There was much that was good about Civil Society Day (#CSOday). Old acquaintances reconnect and some new connections were forged. There were many useful exchanges of best practices and shared challenges and even some fun moments – such as singing led by transparency activists from the sub-continent who regularly put their lives on the line.

However with an evenings reflection I feel increasingly that the day represents a missed opportunity.

Not discussed – at least in the sessions I attended – was the more basic question of: Is this working for us? And if no, what should we do about it. Perhaps still more important was using the time to ask: How can the civil society participants use one another and the OGP to build power to advance their goals?

What – in retrospect – might have been the session most likely to trigger this conversation, the “What can civil society do to push ambition on Open Government?” did spark a brief discussion about if and how civil society organizations may exit the OGP if the process is not serving their needs. It also generated a brief acknowledgement that the OGP processes could be revisited. But ultimately the conversation felt unambitious. Something that, as an audience member, was as much my fault as anyones.

Indeed the entire day, the sessions felt like mere prologues/duplications of the sessions that are occurring during the OGP. Coalitions were not formed. Misunderstandings not broken down. Progress was made, but at was best iterative, not transformative.

Again, the CSO’s in my mind, need to start thinking about how the OGP can help them build power. I think, until now, we’ve believed that the secretariat and the processes would do that for us. It does – but likely not enough to generate the type of action many are looking for. Worse, the OGP is probably unlikely to have a single failure moment – rather the CSOs might slowly start drifting away quietly, if they feel it does not serve them. This makes figuring out more about how the OGP can serve CSO’s – particularly more local ones – all the more important.

I am perhaps, alone in thinking this. But if not, I offer one proposal about how we could build power.

A Brief Diagnosis

A core part of the problem is that while the heads of states can regularly generate media by simply meeting within the context of the OGP, it is much harder for civil society. I – and some I talk to – feel like this void should be filled by the steering committee – and particularly its CSO members. However, they appear constrained in what they can say and do. This manifests itself in three ways:

  • First, it appears the steering committee is unable to speak out against – and attract attention to – countries that are clearly moving backwards on their commitments.
  • Second, there appears to be limited capacity to challenge new entrants who cause many CSOs to feel uncomfortable. This includes Russia (who ultimately opted not to join) and Argentina, which many Latin American CSOs feel has been particularly egregious in systemically limiting freedom of expression. Membership has privileges, it endows on countries some social license and impacts the OGP brand in other countries – barriers to entry matter.
  • Third, the steering committee seems to have done little to attract international and/or national attention to Independent Reporting Mechanism reports – a third party report that assessed governments’ progress against their goals. Fears that the IRPs would be watered down seem to have been misplaced. According to many the IRPs are fair, balanced and in many cases quite critical. This is fantastic. The feat now is that poor IRP reports are not creating neither attention nor pressure for change.

It may not be the role of the steering committee to draw attention to these issues. I feel it is. Either way, it needs to be someone’s role. I want to be clear, I don’t believe the CSOs steering committee members have been negligent – I know they are diligent and effective CSO partners. Rather I believe there are some norms, and even hard structural barriers that prevent them from speaking out or pushing the steering committee as a whole to speak out on these issues.

Thus I suggest that the CSOs do the following.

A Suggestion

First – create a committee of highly respected CSO members that most members believe can, in specific circumstances, speak on behalf of the global CSO community. Normally I’d advocate that the members of each regional committee caucus until they decide on who that person can be. However, perhaps in the interim, we should just pick some that are appear to be widely respected. I’ve not consulted with any of these people – so mentioning them is just as likely to embarrass them – but I might nominate: Alison Tilley (South Africa), John Wonderlich (United States),  Emmanuel C. Lallana (Philippines), Felipe Heusser (Chile), Helen Darbishire (Europe). There is a imperfect list and is limited by people I’ve met and heard others speak about in positive terms. The key thing is to not get bogged down – at this time – with the selection process (at this time).

Second – a common mailing list where if, at any point, a national group of CSOs feel like their country is backsliding on its commitments or failing to live up to the OGP in a significant way, they could raise their concern with this committee.

Third – if, after some deliberation both within the committee and across the CSO community in general it was felt that there was a serious problem, this committee could issues statements on behalf of the CSO community. I could be wrong, but it would be nice to think that a collective outcry from the world’s leading CSO’s in transparency, governance and government reform might focus some (hopefully embarrassing) international media on the situation and put this issue on the agenda in various diplomatic circles. This committee might also bang the drum more aggressively in the international media about poor IRM reports.

I’ll be absolutely transparent about the goals here. Directly, the idea is to make the OGP process empower more CSO’s – hopefully the local one in particular. Indirectly however, the underlying hope to put pressure on the OGP governance and culture to remove any barriers that currently prevent CSO steering committee members from speak out as a group about various issues. If we succeeded in this, we could abandon this idea and concentrate on new ways to create power. And, if this had not come to pass, we could then formalize the committee and make it more permanent.

I don’t claim this model is perfect, and would invite feedback and or suggestions for alternatives. But I would love for the CSOs to starting thinking about how they can leverage the community the OGP has created to foster power to enable them to challenge governments more effectively.

Moreover, I think many governments would like it. Indeed, after floating this idea past one government official, they commented “We would like the CSOs to push as more. We want to do more and need to have a political environment in which that pressure exists. It helps us.” Perhaps not true of every government – but we have allies.

The promise and challenges of open government – Toronto Star OpEd

As some readers many know it was recently announced that I’ve been asked by Ontario Premier Wynn and Government Services Minister John Milloy to be part of the Government of Ontario’s task force on Open Government.

The task force will look at best practices around the world as well as engage a number of stakeholders and conduct a series of public consultations across Ontario to make a number of recommendations around opening up the Ontario government.

I have an opinion piece in the Toronto Star today titled The Promise and Challenges of Open Government where I try (in a few words) to outline some of the challenges the task force faces as well as some of the opportunities I hope it can capitalize on.

The promise and challenges of open government

Last week, Premier Kathleen Wynne announced the launch of Ontario’s Open Government initiative, including an engagement task force (upon which I sit).

The premier’s announcement comes on the heels of a number of “open government” initiatives launched in recent years. President Barack Obama’s first act in 2009 was to sign the Memorandum on Transparency and Open Government. Since then numerous city, state and provincial governments across North America are finding new ways to share information. Internationally, 60 countries belong to the Open Government Partnership, a coalition of states and non-profits that seeks to improve accountability, transparency, technology and innovation and citizen participation.

Some of this is, to be blunt, mere fad. But there is a real sense among many politicians and the public that governments need to find new ways to be more responsive to a growing and more diverse set of citizen needs, while improving accountability.

Technology has a certainly been – in part – a driver, if only because it shifts expectations. Today a Google search takes about 30 milliseconds, with many users searching for mere minutes before locating what they are looking for. In contrast, access to information requests can take weeks, or months to complete. In an age of computers, government processes often seem more informed by the photocopier – clinging to complex systems for sorting, copying and sharing information – than using computer systems that make it easy to share information by design.

There is also growing recognition that government data and information can empower people both inside and outside government. In British Columbia, the province’s open data portal is widely used by students – many of whom previously used U.S. data as it was the only free source. Now the province benefits from an emerging workforce that uses local data while studying everything from the environment to demography to education. Meanwhile the largest user of B.C.’s open data portal are public servants, who are able to research and create policy while drawing on better information, all without endless meetings to ask for permission to use other departments’ data. The savings from fewer meetings alone is likely significant.

The benefits of better leveraging government data can affect us all. Take the relatively mundane but important issue of transit. Every day hundreds of thousands of Ontarians check Google Maps or locally developed applications for transit information. The accumulated minutes not spent waiting for transit has likely saved citizens millions of hours. Few probably realize however that it is because local governments “opened” transit data that it has become so accessible on our computers and phones.

Finally, there are a number of new ways to think about how to “talk” to Ontarians. It is possible that traditional public consultations could be improved. But there is also an opportunity to think more broadly about how the government interacts with citizens. Projects like Wikipedia demonstrate how many small contributions can create powerful resources and public assets. Could such a model apply to government?

All of these opportunities are exciting – and the province is right to explore them. But important policy questions remain. For example: how do we safeguard the data government collects to minimize political interference? The country lost a critical resource when the federal government destroyed the reliability of the long form census by making it voluntary. If crowdsourcing and other new forms of public engagement can be adopted for government, how do we manage privacy concerns and preserve equality of opportunity? And how will such changes affect public representation? Canada’s political system has been marked by increasing centralization of power over the past several decades – will new technologies and approaches further this trend? Or could they be shaped to arrest it? These are not simple questions.

It is also easy to dismiss these efforts. This will neither be the first nor the last time people talk about open government. Indeed, there is a wonderfully cynical episode of Yes, Minister from 1980 titled “Open Government.” More recently, various revelations about surveillance and national governments’ desire to snoop in on our every email and phone call reveals much about what is both opaque and to be feared about our governments. Such cynicism is both healthy and necessary. It is also a reason why we should demand more.

Open government is not something we will ever fully achieve. But I do hope that it can serve as an objective and a constantly critical lens for thinking about what we should demand. I can’t speak for the other panelists of the task force, but that will be how I approach my work.

David Eaves is a public policy entrepreneur, open government activist and negotiation expert. He is a member of the Ontario government’s new Engagement Task Force.

Government Procurement Reform – It matters

Earlier this week I posted a slidecast on my talk to Canada’s Access to Information Commissioners about how, as they do their work, they need to look deeper into the government “stack.”

My core argument was how decisions about what information gets made accessible is no longer best managed at the end of a policy development or program delivery process but rather should be embedded in it. This means monkeying around and ensuring there is capacity to export government information and data from the tools (e.g. software) government uses every day. Logically, this means monkeying around in procurement policy (see slide below) since that is where the specs for the tools public servants use get set. Trying to bake “access” into processes after the software has been chosen is, well, often an expensive nightmare.

Gov stack

Privately, one participant from a police force, came up to me afterward and said that I was simply guiding people to another problem – procurement. He is right. I am. Almost everyone I talk to in government feels like procurement is broken. I’ve said as much myself in the past. Clay Johnson is someone who has thought about this more than others, here he is below at the Code for America Summit with a great slide (and talk) about how the current government procurement regime rewards all the wrong behaviours and often, all the wrong players.

Clay Risk profile

So yes, I’m pushing the RTI and open data community to think about procurement on purpose. Procurement is borked. Badly. Not just from a wasting tax dollars money perspective, or even just from a service delivery perspective, but also because it doesn’t serve the goals of transparency well. Quite the opposite. More importantly, it isn’t going to get fixed until more people start pointing out that it is broken and start contributing to solving this major bottle neck of a problem.

I highly, highly recommend reading Clay Johnson’s and Harper Reed’s opinion piece in today’s New York Times about procurement titled Why the Government Never Gets Tech Right.

All of this becomes more important if the White House’s (and other governments’ at all levels) have any hope of executing on their digital strategies (image below).  There is going to be a giant effort to digitize much of what governments do and a huge number of opportunities for finding efficiencies and improving services is going to come from this. However, if all of this depends on multi-million (or worse 10 or 100 million) dollar systems and websites we are, to put it frankly, screwed. The future of government isn’t to be (continue to be?) taken over by some massive SAP implementation that is so rigid and controlled it gives governments almost no opportunity to innovate. And this is the future our procurement policies steer us toward. A future with only a tiny handful of possible vendors, a high risk of project failure and highly rigid and frail systems that are expensive to adapt.

Worse there is no easy path here. I don’t see anyone doing procurement right. So we are going to have to dive into a thorny, tough problem. However, the more governments that try to tackle it in radical ways, the faster we can learn some new and interesting lessons.

Open Data WH

Access to Information, Technology and Open Data – Keynote for the Commissioners

On October 11th I was invited by Elizabeth Denham, the Access to Information and Privacy Commissioner for British Columbia to give a keynote at the Privacy and Access 20/20 Conference in Vancouver to an audience that included the various provincial and federal Information Commissioners.

Below is my keynote, I’ve tried to sync the slides up as well as possible. For those who want to skip to juicier parts:

  • 7:08 – thoughts about the technology dependence of RTI legislation
  • 12:16 –  the problematic approach to RTI implementation that results from these unsaid assumptions
  • 28:25 – the need and opportunity to bring open data and RTI advocates together

Some acronyms used: