Tag Archives: opengov

Proactive Disclosure – An Example of Doing it Wrong from Shared Service Canada

Just got flagged about this precious example of doing proactive disclosure wrong.

So here is a Shared Service Canada website dedicated the Roundtable on Information Technology Infrastructure. Obviously this is a topic of real interest to me – I write a fair bit about delivering (or failing to deliver) government service online effectively. I think it is great that Service Canada is reaching out to the private sector to try to learn lessons. Sadly, some of the links on the site didn’t work for me, specifically the important sounding: Summary of Discussions: Shared Services Canada Information and Communications Technology Sector Engagement Process.

But that is not the best part. Take a look at the website below. In one glance the entirety of the challenge of rethinking communications and government transparency  is nicely summed up.
proactive-nonedisclosure2

Apparently, if you want a copy of the presentation the Minister made to the committee you have to request it.

That’s odd, since really, the cost of making it downloadable is essentially zero. While the cost of emailing someone and making them get it back to you, is well, a colossal waste of my, and that public servants, time. (Indeed, to demonstrate this to the government, I hope that everyone of my readers requests this document).

There are, in my mind, two explanations for this. The first, more ominous one, is that someone wants to create barriers to getting this document. Maybe that is the case – who knows.

The second, less ominous, but in some ways more depressing answer is that this is simply standard protocol, or worse, that no one involved in this site has the know how or access rights to upload the document.

Noted added 6 mins after posting: There is also a third reason, less innocuous than reasons one and two. That being that the government cannot post the document unless it is in both official languages. And since this presentation is only available in (likely) english, it cannot be posted. This actually feels the most likely and will be teeing up a whole new post shortly on bilingualism and transparency. The number of times I’m told a document or data set can’t be proactively shared because of language issues is frustratingly frequent. I’ve spoken to the Language Commissioner on this and believe more dialogue is required. Bilingualism cannot be an excuse for a poor experience, or worse, opaque government.

In either case, it is a sad outcome. Either our government is maliciously trying to make it difficult to get information to Canadians (true of most governments) or they don’t know how to.

Of course, you may be saying… but David – who cares if there is an added step to geting this document that is slightly inconvenient? Well, let me remind you THIS IS SHARED SERVICE CANADA AND IT IS ABOUT A COMMITTEE FOCUSED ON DELIVERING ONLINE SERVICES (INTERNALLY AND EXTERNALLY) MORE EFFECTIVELY. If there was one place where you wanted to show you were responsive, proactive and reducing the transaction costs to citizens… the kind of approach you were going to use to make all government service more efficient and effective… this would be it.

The icing on the cake? There is that beautiful “transparency” button right below the text that talks about how the government is interested in proactive disclosure (see screenshot below). I love the text here – this is exactly what I want my government to be doing.

And yet, this is experience, while I’m sure conforming to the letter of the policy, feels like it violates pretty much everything around the spirit of proactive disclosure. This is after all a document that has already been made public… and now we are requiring citizens to request it.

We have a lot of work to do.

How Government should interact with Developers, Data Geeks and Analysts

Below is a screen shot from the Opendatabc google group from about two months ago. I meant to blog about this earlier but life has been in the way. For me, this is a prefect example of how many people in the data/developer/policy world probably would like to interact with their local, regional or national government.

A few notes on this interaction:

  • I occasionally hear people try to claim the governments are not responsive to requests for data sets. Some aren’t. Some are. To be fair, this was not a request for the most controversial data set in the province. But it is was a request. And it was responded to. So clearly there are some governments that are responsive. The questions is figuring out which one’s are, why they are, and see if we can export that capacity to other jurisdictions.
  • This interaction took place in a google group – so the whole context is social and norm driven. I love that public officials in British Columbia as well as with the City of Vancouver are checking in every once in a while on google groups about open data, contributing to conversations and answering questions that citizens have about government, policies and open data. It’s a pretty responsive approach. Moreover, when people are not constructive it is the group that tends to moderate the behaviour, rather than some leviathan.
  • Yes, I’ve blacked out the email/name of the public servant. This is not because I think they’d mind being known or because they shouldn’t be know, but because I just didn’t have a chance to ask for permission. What’s interesting is that this whole interaction is public and the official was both doing what that government wanted and compliant with all social media rules. And yet, I’m blacking it out, which is a sign of how messed up current rules and norms make citizens relationships with public officials they interact with online -I’m worried of doing something wrong by telling others about a completely public action. (And to be clear, the province of BC has really good and progressive rules around these types of things)
  • Yes, this is not the be all end all of the world. But it’s a great example of a small thing being doing right. It’s nice to be able to show that to other government officials.

 

Should we Start a Government as Platform Business Association

I have an idea.

I want to suggest starting a community of disruptive software companies that are trying to sell products to local and regional governments. I know we can make cities better, more participatory, more accessible, to say nothing of saving them money. But to be effective I think we need a common message – an association that conveys why this disruption is in government’s interest, and how it will help them.

Here’s why.

Last year, I along with some friends, incorporated a small company with an innovative approach to messaging that helps cities be smarter, communicate better and serve their citizens more effectively.  Where we deploy, citizens love us. It’s a blast to do. (You can read more about our company here – if you work for a local or regional government, I’d love to talk to you).

We also don’t think we are alone. Indeed we like to think we are part of a new breed of start ups – companies we respect like SeeClickFix, Azavea  and Citizenvestor – whose DNA is influenced by the likes of Tim O’Reilly and others who talk about government as a platform. Companies that believe there are hyper low cost ways to make local government and services more transparent, enable citizen participation and facilitate still more innovation.

Happily we’ve had a number of early successes, several cities have signed on with us as paying customers. This is no small feat in the municipal space – governments, especially local governments – tend to be risk averse. Selling software as a service (SaaS) for a product category that previously didn’t exist can be challenge. But it pales in comparison to the two real challenges we confront:

1)   Too Cheap to Buy

For many cities we are, weirdly, too cheap  to buy. Our solution tends to cost a couple of thousand dollars a year. I’m talking four digits. In many municipalities, this price breaks the procurement model, which is designed for large purchases like heavy equipment or a large IT implementation. We’re too expensive for petty cash, too cheap for a formal process. I’ve even had a couple experiences where a city has spent significantly more money in staff time talking to and evaluating us than it would have cost to simply deploy us for a year and try us out. We need a smarter context for talking to procurement specifically, and local government in general. That might be easier in a herd.

2)   Marketing

As company that tries to keep its product as cheap as possible we have a limited budget to invest in marketing and sales.  We could charge more to pay for that overhead, but we’d prefer to be cheaper, mostly because we don’t believe taxpayers should pay for the parts of our business that don’t really give them value. In short, we need a better way of letting cities know we exist, one that is cheap and allows our product to reflect its value, not an advertising budget.

As I look at our peer group of companies, I have to believe they share similar challenges. So why don’t we band together? A group of small companies could potentially do a virtual trade show that not only could attract more clients than any of us could on our own, but would attract the right clients: local governments that are hungry for next generation online services.

So who would I imagine being part of this association? I don’t think the criteria is complex, so here are some basic ideas that come to mind:

  • Software focused
  • Disruptively low or hyperlow-cost: here I imagine the cost is under 35 cents per citizen per year.
  • Following a SaaS or open source model
  • You keep the barriers to entry low – any operational data your system creates is open and available to staff and, if requested by the city, to citizens as well
  • Citizen-centric: In addition to open data, your service should, whenever relevant or possible, make it as easy as possible for citizens to use, engage or participate.

Is it the Government as Platform Business Association? Or the Gov 2.0 Software Association? Or maybe the League of Awesomely Lean Gov Start Ups. I don’t know. But I can imagine a shared branded site, maybe we pool money to do some joint marketing. I love the idea of a package deal – get Recollect, SeeClickFix and OpenTreeMap bundled at a discount! Maybe there is even a little logo that companies who meet the criteria and participate in the group could paste on their website (no worries I’m not a designer and am no attached to the mock up below).

Gov20-bia-logo

The larger point here is that if the next generation of civic start ups – companies that can do software much, much cheaper while enhancing the experience for city staff and residents – have an education challenge on our hands. Cities need to learn that there emerging radically small, lean solutions to some problems. I’m not sure this is the right answer. I know this proposal creates a lot of unanswered questions, but it is an idea I wanted to throw out there.

If you have a company that fits the bill I’d love to hear from you. And if you work for a local or regional government and think this would be helpful, I’d love to hear about that as well.

Some thoughts on the Open Government Partnership

It is hard to sum up what is happening at the Open Government Partnership this year. Whether it is the geography the conference covers (over 40 countries), the range of issues affected by openness, or the sheer number of people, there is a great deal to wrap your arms around.

Here are some reflections after a day and a half.

First is the sheer size of the conference. I’m told there are roughly 1200 registered participants. And you feel it. The buzz is louder, the crowds are bigger, and the number of people you don’t know is larger.

For one, governments get to see what others are up to, but more important are the connections made among civil society members. In many ways the OGP’s biggest benefit may be the way it builds capacity by enabling civil society organizations and individuals to learn from one another and trade stories.

The potential for this is particularly true (and remains unrealized) between civil society communities that do not tend to interact. There remain important and interest gaps particularly between the more mature “Access to Information” community and the younger, still coalescing “Gov2.0/OpenGov/Tech/Transparency” community. It often feels like members of the access to information community are dismissive of the technology aspects of the open government movement in general and the OGP in particular. This is disappointing as technology is likely going to have a significant impact on the future of access to information. As more and more government work gets digitized, how way we access information is going to change, and the opportunities to architect for accessibility (or not) will become more important. These are important conversations and finding a way to knit these two communities together more could help the advance everyone’s thinking.

Moreover, concerns among access to information types that the OGP will be dominated by technology issues feel overplayed, every “official” civil society representative I witnessed respond to a government presentation on its OGP goals was someone out of the Access to Information community, not the Gov.20/tech community. In a real sense, it is the access to information community that has greater influence over the discourse at the OGP and so concerns about the reverse feel, to some measure, overblown.

Finally, and perhaps most intriguingly, there are some very early debates about the future of the OGP, particularly in relation to its members. The articles of governance published yesterday by the OGP do lay out a process for removing members, but the criteria is vague regarding many issues the virtually all civil society members feel strongly about. The OGP has already demonstrated that the term open can capture the imaginations of a broad group of people and is a desirable trait to which governments want to be associated. In this regard it has some realized and a great deal more potential of being an important carrot that can provoke governments to make commitments around openness that they might not have otherwise make or prioritize. But the stick – which is essential to many civil society participants – remains still somewhat vague. And without it, it is hard to imagine the project working. If, once you are in the OGP, it does not much matter what you do, then the project loses a great deal of its meaning, at least, based on conversations I had, to many of its civil society participants.

And the tests on this issue are real and immediate.

South Africa – a OGP steerting committee member(!) – is in the process of enacting the “Protection of Information Bill” which effectively makes leaks illegal. If this can happen without any sanctions to its OGP status, then I suspect, the process loses a great deal of credibility. The participation of Russia raises similar questions. While it speaks volumes about the attractiveness of the OGP and Russia’s participation may help foster some domestic positive changes, to admit a country that is regularly accused of rigging elections and where journalists routinely go missing is likely to frustrate many who wish to use the OGP as a stick by which to hold their own governments to account. How worried will Mexico, Turkey or Canada be about reneging on its commitments if South Africa is allowed to pass draconian laws around access to information, or journalists are allowed to go missing in Russia?

To date, there are not heated arguments over the issue (at least publicly) and my sense is the topic is only just beginning to peculate for most civil society members, but given the immediate challenges South Africa and Russia pose to the OGP expect this issue to become much more heated, barring some clear resolution that satisfies the civil society participants.

Much less important, but still worth noting, is the simple fact that the logistics must be better next time. While the Brazilians were generous and warm hosts and, unlike in New York, civil society participants were thankfully not segregated from the government representatives, the failure to have internet access on the first day was unacceptable. It meant that anyone not on site could not follow along to the presentations and those at the conference could not engage those at home, or at the conference, online. For a conference about openness and engagement, it was an unfortunate reminder of even some of the more basic challenges still confronting us.

Canada's Action Plan on Open Government: A Review

The other day the Canadian Government published its Action Plan on Open Government, a high level document that both lays out the Government’s goals on this file as well as fulfill its pledge to create tangible goals as part of its participation in next week’s Open Government Partnership 2012 annual meeting in Brazil.

So what does the document say and what does it mean? Here is my take.

Take Away #1: Not a breakthrough document

There is much that is good in the government’s action plan – some of which I will highlight later. But for those hoping that Canada was going to get the Gov 2.0 bug and try to leapfrog leaders like the United States or the United Kingdom, this document will disappoint. By and large this document is not about transforming government – even at its most ambitious it appears to be much more about engaging in some medium sized experiments.

As a result the document emphasizes a number of things that the UK and US started doing several years ago such  getting license that adheres to international norms or posting government resource allocation and performance management information online in machine readable forms or refining the open data portal.

What you don’t see are explicit references to try to re-think how government leverages citizens experience and knowledge with a site like Challenge.gov, engage experts in innovative ways such as with Peer to Patent, or work with industries or provinces to generate personal open data such as the US has done with the Blue Button (for Healthcare) or the Green Button (for utilities).

Take Away #2: A Solid Foundation

This said, there is much in the document that is good. Specifically, in many areas, it does lay a solid foundation for some future successes. Probably the most important statements are the “foundational commitments” that appear on this page. Here are some key points:

Open Government Directive

In Year 1 of our Action Plan, we will confirm our policy direction for Open Government by issuing a new Directive on Open Government. The Directive will provide guidance to 106 federal departments and agencies on what they must do to maximize the availability of online information and data, identify the nature of information to be published, as well as the timing, formats, and standards that departments will be required to adopt… The clear goal of this Directive is to make Open Government and open information the ‘default’ approach.

This last sentence is nice to read. Of course the devil will be in the detail (and in the execution) but establishing a directive around open information could end being as important (although admittedly not as powerful – an important point) as the establishment of Access to Information. Done right such a directive could vastly expand the range of documents made available to the public, something that should be very doable as more and more government documentation moves into digital formats.

For those complaining about the lack of ATI reform in the document this directive, and its creation will be with further exploration. There is an enormous opportunity here to reset how government discloses information – and “the default to open” line creates a public standard that we can try to hold the government to account on.

And of course the real test for all this will come in years 2-3 when it comes time to disclose documents around something sensitive to the government… like, say, around the issue of the Northern Gateway Pipeline (or something akin to the Afghan Prisoner issue). In theory this directive should make all government research and assessments open, when this moment happens we’ll have a real test of the robustness of any new such directive.

Open Government License:

To support the Directive and reduce the administrative burden of managing multiple licensing regimes across the Government of Canada, we will issue a new universal Open Government License in Year 1 of our Action Plan with the goal of removing restrictions on the reuse of published Government of Canada information (data, info, websites, publications) and aligning with international best practices… The purpose of the new Open Government License will be to promote the re-use of federal information as widely as possible...

Full Disclosure: I have been pushing (in an unpaid capacity) for the government to reform its license and helping out in its discussions with other jurisdictions around how it can incorporate the best practices and most permissive language possible.

This is another important foundational piece. To be clear, this is not about an “open data” license. This is about creating a licensing for all government information and media. I suspect this appeals to this government in part because it ends the craziness of having lawyers across government constantly re-inventing new licenses and creating a complex set of licenses to manage. Let me be clear about what I think this means: This is functionally about neutering crown copyright. It’s about creating a licensing regime that makes very clear what the users rights are (which crown copyright does not doe) and that is as permissive as possible about re-use (which crown copyright, because of its lack of clarity, is not). Achieving such a license is a critical step to doing many of the more ambitious open government and gov 2.0 activities that many of us would like to see happen.

Take Away #3: The Good and Bad Around Access to Information

For many, I think this may be the biggest disappointment is that the government has chosen not to try to update the Access to Information Act. It is true that this is what the Access to Information Commissioners from across the country recommended they do in an open letter (recommendation #2 in their letter). Opening up the act likely has a number of political risks – particularly for a government that has not always been forthcoming documents (the Afghan detainee issue and F-35 contract both come to mind) – however, I again propose that it may be possible to achieve some of the objectives around improved access through the Open Government Directive.

What I think shouldn’t be overlooked, however, is the government’s “experiment” around modernizing the administration of Access to Information:

To improve service quality and ease of access for citizens, and to reduce processing costs for institutions, we will begin modernizing and centralizing the platforms supporting the administration of Access to Information (ATI). In Year 1, we will pilot online request and payment services for a number of departments allowing Canadians for the first time to submit and pay for ATI requests online with the goal of having this capability available to all departments as soon as feasible. In Years 2 and 3, we will make completed ATI request summaries searchable online, and we will focus on the design and implementation of a standardized, modern, ATI solution to be used by all federal departments and

These are welcome improvements. As one colleague – James McKinney – noted, the fact that you have to pay with a check means that only people with Canadian bank accounts can make ATIP requests. This largely means just Canadian citizens. This is ridiculous. Moreover, the process is slow and painful (who uses check! the Brits are phasing them out by 2018 – good on em!). The use of checks creates a real barrier – particularly I think, for young people.

Also, being able search summaries of previous requests is a no-brainer.

Take Away #4: The is a document of experiments

As I mentioned earlier, outside the foundational commitments, the document reads less like a grand experiment and more like a series of small experiments.

Here the Virtual Library is another interesting commitment – certainly during the consultations the number one complaint was that people have a hard time finding what they are looking for on government websites. Sadly, even if you know the name of the document you want, it is still often hard to find. A virtual library is meant to address this concern – obviously it is all going to be in the implementation – but it is a response to a genuine expressed need.

Meanwhile the Advancing Recordkeeping in the Government of Canada and User-Centric Web Services feel like projects that were maybe already in the pipeline before Open Government came on the scene. They certainly do conform with the shared services and IT centralization announced by Treasury Board last year. They could be helpful but honestly, these will all be about execution since these types of projects can harmonize processes and save money, or they can become enormous boondoggles that everyone tries to work around since they don’t meet anyone’s requirements. If they do go the right way, I can definitely imagine how they might help the management of ATI requests (I have to imagine it would make it easier to track down a document).

I am deeply excited about the implementation of International Aid Transparency Initiative (IATI). This is something I’ve campaigned for and urged the government to adopt, so it is great to see. I think these types of cross jurisdictional standards have a huge role to play in the open government movement, so joining one, figuring out what about the implementation works and doesn’t work, and assessing its impact, is important both for Open Government in general but also for Canada, as it will let us learn lessons that, I hope, will become applicable in other areas as more of these types of standards emerge.

Conclusion:

I think it was always going to be a stretch to imagine Canada taking a leadership role in Open Government space, at least at this point. Frankly, we have a lot of catching up to do, just to draw even with places like the US and the UK which have been working hard to keep experimenting with new ideas in the space. What is promising about the document is that it does present an opportunity for some foundational pieces to be put into play. The bad news is that real efforts to rethink governments relationship with citizens, or even the role of the public servant within a digital government, have not been taken very far.

So… a C+?

 

Additional disclaimer: As many of my readers know, I sit on the Federal Government’s Open Government Advisory Panel. My role on this panel is to serve as a challenge function to the ideas that are presented to us. In this capacity I share with them the same information I share with you – I try to be candid about what I think works and doesn’t work around ideas they put forward. Interestingly, I did not see even a draft version of the Action Plan until it was posted to the website and was (obviously by inference) not involved in its creation. Just want to share all that to be, well, transparent, about where I’m coming from – which remains as a citizen who cares about these issues and wants to push governments to do more around gov 2.0 and open gov.

Also, sorry or the typos, but I’m sick and it is 1am. So I’m checking out. Will proof read again when I awake.

Citizen Surveillance and the Coming Challenge for Public Institutions

The other day I stumbled over this intriguing article which describes how a group of residents in Vancouver have started to surveille the police as they do their work in the downtown eastside, one of the poorest and toughest neighborhoods in Canada. The reason is simple. Many people – particularly those who are marginalized and most vulnerable – simply do not trust the police. The interview with the founder of Vancouver Cop Watch probably sums it up best:

“One of the complaints we have about District 2 is about how the Vancouver police were arresting people and taking them off to other areas and beating them up instead of taking them to a jail,” Allan told the Georgia Straight in a phone interview. “So what we do is that, when in the Downtown Eastside, whenever we see the police arresting someone, we follow behind them to make sure that the person makes it to the jail.”

In a world where many feel it is hard to hold accountable government in general and police forces specifically, finding alternative means of creating such accountability will be deeply alluring. And people no longer need the funding and coordination of organizations like Witness (which initially focused on getting videocameras into peoples hands in an effort to prevent human rights abuses). Digital video cameras and smart phones coupled with services like youtube now provide this infrastructure for virtually nothing.

This is the surveillance society – predicted and written about by authors like David Brin – and it is driven as much by us, the citizens, as it is by government.

Vancouver Cop Watch is not the first example of this type of activity – I’ve read about people doing this across the United States. What is fascinating is watching the state try to resist and fail miserably. In the US the police have lost key battles in the courts. This after the police arrested people filming them even when while on their own property. And despite the ruling people continue to be arrested for filming the police – a choice I suspect diminishes public confidence in the police and the state.

And it is not just the police getting filmed. Transit workers in Toronto have taken a beating of late as they are filmed asleep on the job. Similarly, a scared passenger filmed an Ottawa bus driver who was aggressive and swearing at an apologizing mentally ill passenger. A few years ago the public in Montreal was outraged as city crews were filmed repairing few potholes and taking long breaks.

The simple fact is, if you are a front line worker – in either the private, but especially, the public sector – there is a good chance that at some point in your career you’re going to be filmed. And even when you are not being filmed, more data is going to be collected about what you do and how you do it.

Part of this reality is that it is going to require a new level of training for front line workers, this will be particularly hard on the police, but they should expect more stories like this one.

I also suspect there will be two reactions to it. Some government services will clam up and try to become more opaque, fearing all public inquiry. Their citizens – armed with cameras – all become potential threats. Over time, it is hard not imagining their legitimacy becoming further and further eroded (I’m thinking of you RCMP) as a video here, and audio clip there, shapes the publics image of the organization. Others will realize that anecdotal and chance views of their operations represents a real risk to their image. Consequently they may strive to be more transparent – sharing more data about their operations and their processes – in an effort to provide the public with greater context. The goal here will be to provide a counter point to any unfortunate incidents, trying to make a single negative anecdotal data point that happened to be filmed part of a larger complex number of data points.

Obviously, I have strong suspicions regarding which strategy will work, and which one won’t, in a democratic society but am confident many will disagree.

Either way, these challenges are going to require adaptation strategies and it won’t be easy for public institutions adverse to both negative publicity and transparency.

My Canadian Open Government Consultation Submission

Attached below is my submission to the Open Government Consultation conducted by Treasury Board over the last couple of weeks. There appear to be a remarkable number of submission that were made by citizens, which you can explore on the Treasury Board website. In addition, Tracey Lauriault has tracked some of the submissions on her website.

I actually wish the submissions on the Government website were both searchable and could be downloaded in there entirety. That way we could re-organize them, visualize them, search and parse them as well as play with the submissions so as to make the enormous number of answers easier to navigate and read. I can imagine a lot of creative ways people could re-format all that text and make it much more accessible and fun.

Finally, for reference, in addition to my submission I wrote this blog post a couple months ago suggesting goals the government set for itself as part of its Open Government Partnership commitments. Happily, since writing that post, the government has moved on a number of those recommendations.

So, below is my response to the government’s questions (in bold):

What could be done to make it easier for you to find and use government data provided online?

First, I want to recognize that a tremendous amount of work has been done to get the present website and number of data sets up online.

FINDING DATA:

My advice on making data easier to engage Socrata to create the front end. Socrata has an enormous amount of experience in how to share government data effectively. Consider http://data.oregon.gov here is a site that is clean, easy to navigate and offers a number of ways to access and engage the governments data.

More specifically, what works includes:

1. Effective search: a simple search mechanism returns all results
2. Good filters: Because the data is categorized by type (Internal vs. external, charts, maps, calendars, etc…) it is much easier to filter. One thing not seen on Socrata that would be helpful would be the ability to sort by ministry.
3. Preview: Once I choose a data set I’m given a preview of what it looks like, this enables me to assess whether or not it is useful
4. Social: Here there is a ton on offer
– I’m able to sort data sets by popularity – being able to see what others find interesting is, in of itself interesting.
– Being able to easily share data sets via email, or twitter and facebook means I’m more likely to find something interesting because friends will tell me about it
– Data sets can also be commented upon so I can see what others think of the data, if they think it is useful or not, and what for or not.
– Finally, it would be nice if citizens could add meta data, to make it easier for others to do keyword searches. If the government was worried about the wrong meta data being added, one could always offer a search with crowd sourced meta data included or excluded
5. Tools: Finally, there are a large number of tools that make it easier to quickly play with and make use of the data, regardless of one’s skills as a developer. This makes the data much more accessible to the general public.

USING DATA

Finding data is part of the problem, being able to USE the data is a much bigger issue.

Here the single most useful thing would be to offer API’s into government data. My own personal hope is that one day there will be a large number of systems both within and outside of government that will integrate government data right into their applications. For example, as I blogged about here – https://eaves.ca/2011/02/18/sharing-critical-information-with-public-lessons-for-governments/ – product recall data would be fantastic to have as an API so that major retailers could simply query the API every time they scan inventory in a warehouse or at the point of sale, any product that appears on the list could then be automatically removed. Internally, Borders and Customs could also query the API when scanning exports to ensure that nothing exported is recalled.

Second, if companies and non-profits are going to invest in using open data, they need assurances that both they are legally allowed to use the data and that the data isn’t going to suddenly disappear on them. This means, a robust license that is clear about reuse. The government would be wise to adopt the OGL or even improve on it. Better still helping establish a standardized open data license for Canada and ideally internationally could help reduce some legal uncertainty for more conservative actors.

More importantly, and missing from Socrata’s sites, would be a way of identifying data sets on the security of their longevity. For example, data sets that are required by legislation – such as the NPRI – are the least likely to disappear, whereas data sets the the long form census which have no legal protection could be seen as at higher risk.

 

How would you use or manipulate this data?

I’m already involved in a number of projects that use and share government data. Among those are Emitter.ca – which maps and shares NPRI pollution data and Recollect.net, which shares garbage calendar information.

While I’ve seen dramatically different uses of data, for me personally, I’m interested mostly in using data for thinking and writing about public policy issues. Indeed, much has been made of the use of data in “apps” but I think it is worth noting that the single biggest use of data will be in analysis – government officials, citizens, academics and others using the data to better understand the world around them and lobby for change.

This all said, there are some data sets that are of particular usefulness to people, these include:

1. Data sets on sensitive issues, this includes health, inspection and performance data (Say surgery outcomes for specific hospitals, or restaurant inspection data, crime and procurement data are often in great demand).
2. Dynamic real-time Data: Data that is frequently updated (such a border, passport renewal or emergency room wait times). This data is shared in the right way can often help people adjust schedules and plans or reallocate resources more effectively. Obviously this requires an API.
3.Geodata: Because GIS standards are very mature it is easy to “mashup” geo data to create new maps or offer new services. These common standards means that geo data from different sources will work together or can be easily compared. This is in sharp contrast to say budget data, where there are few common standards around naming and organizing the data, making it harder to share and compare.

What could be done to make it easier for you to find government information online?

It is absolutely essential that all government records be machine readable.

Some of the most deplorable moment in open government occur when the government shares documents with the press, citizens or parliamentary officers in paper form. The first and most important thing to make government information easier to find online is to ensure that it is machine readable and searchable by words. If it does not meet this criteria I increasingly question whether or not it can be declared open.

As part of the Open Government Partnership commitments it would be great for the government to commit to guarantee that every request for information made of it would include a digital version of the document that can be searched.

Second, the government should commit that every document it publishes be available online. For example, I remember in 2009 being told that if I wanted a copy of the Health Canada report “Human Health in a Changing Climate:A Canadian Assessment of Vulnerabilities and Adaptive Capacity” I had to request of CD, which was then mailed to me which had a PDF copy of the report on it. Why was the report not simply available for download? Because the Minister had ordered it not to appear on the website. Instead, I as a taxpayer and to see more of my tax dollars wasted for someone to receive my mail, process it, then mail me a custom printed cd. Enabling ministers to create barriers to access government information, simply because they do not like the contents, is an affront to the use of tax payer dollars and our right to access information.

Finally, Allow Government Scientists to speak directly to the media about their research.

It has become a reoccurring embarrassment. Scientists who work for Canada publish an internationally recognized ground break paper that provides some insight about the environment or geography of Canada and journalists must talk to government scientists from other countries in order to get the details. Why? Because the Canadian government blocks access. Canadians have a right to hear the perspectives of scientists their tax dollars paid for – and enjoy the opportunity to get as well informed as the government on these issues.

Thus, lift the ban that blocks government scientists from speaking with the media.

 

Do you have suggestions on how the Government of Canada could improve how it consults with Canadians?

1. Honour Consultation Processes that have started

The process of public consultation is insulted when the government itself intervenes to bring the process into disrepute. The first thing the government could do to improve how it consults is not sabotage processes that already ongoing. The recent letter from Natural Resources Minister Joe Oliver regarding the public consultation on the Northern Gateway Pipelines has damaged Canadians confidence in the governments willingness to engage in and make effective use of public consultations.

2. Focus on collecting and sharing relevant data

It would be excellent if the government shared relevant data from its data portal on the public consultation webpage. For example, in the United States, the government shares a data set with the number and location of spills generated by Enbridge pipelines, similar data for Canada would be ideal to share on a consultation. Also useful would be economic figures, job figures for the impacted regions, perhaps also data from nearby parks (visitations, acres of land, kml/shape boundary files). Indeed, data about the pipeline route itself that could be downloaded and viewed in Google earth would be interesting. In short, there are all sorts of ways in which open data could help power public consultations.

3. Consultations should be ongoing

It would be great to see a 311 like application for the federal government. Something that when loaded up, would use GPS to identify the services, infrastructure or other resources near the user that is operated by the federal government and allow the user to give feedback right then and there. Such “ongoing” public feedback could then be used as data when a formal public consultation process is kicked off.

 

Are there approaches used by other governments that you believe the Government of Canada could/should model?

1. The UK governments expense disclosure and release of the COINS database more generally is probably the most radical act of government transparency to date. Given the government’s interest in budget cuts this is one area that might be of great interest to pursue.

2. For critical data sets, those that are either required by legislation or essential to the operation of a ministry or the government generally, it would be best to model the city of Chicago or Washington DC and foster the creation of a data warehouse where this data could be easily shared both internally and externally (as privacy and security permits). These cities are leading governments in this space because they have tackled both the technical challenges (getting the data on a platform where it can be shared easily) and around governance (tackling the problem of managing data sets from various departments on a shared piece of infrastructure).

 

Are there any other comments or suggestions you would like to make pertaining to the Government of Canada’s Open Government initiative?

Some additional ideas:

Redefine Public as Digital: Pass an Online Information Act

a) Any document it produces should be available digitally, in a machine readable format. The sham that the government can produce 3000-10,000 printed pages about Afghan detainees or the F-35 and claim it is publicly disclosing information must end.

b) Any data collected for legislative reasons must be made available – in machine readable formats – via a government open data portal.

c) Any information that is ATIPable must be made available in a digital format. And that any excess costs of generating that information can be born by the requester, up until a certain date (say 2015) at which point the excess costs will be born by the ministry responsible. There is no reason why, in a digital world, there should be any cost to extracting information – indeed, I fear a world where the government can’t cheaply locate and copy its own information for an ATIP request as it would suggest it can’t get that information for its own operations.

Use Open Data to drive efficiency in Government Services: Require the provinces to share health data – particularly hospital performance – as part of its next funding agreement within the Canada Health Act.

Comparing hospitals to one another is always a difficult task, and open data is not a panacea. However, more data about hospitals is rarely harmful and there are a number of issues on which it would be downright beneficial. The most obvious of these would be deaths caused by infection. The number of deaths that occur due to infections in Canadian hospitals is a growing problem (sigh, if only open data could help ban the antibacterial wipes that are helping propagate them). Having open data that allows for league tables to show the scope and location of the problem will likely cause many hospitals to rethink processes and, I suspect, save lives.

Open data can supply some of the competitive pressure that is often lacking in a public healthcare system. It could also better educate Canadians about their options within that system, as well as make them more aware of its benefits.

Reduce Fraud: Creating a Death List

In an era where online identity is a problem it is surprising to me that I’m unable to locate a database of expired social insurance numbers. Being able to query a list of social security numbers that belong to dead people might be a simple way to prevent fraud. Interestingly, the United States has just such a list available for free online. (Side fact: Known as the Social Security Death Index this database is also beloved by genealogist who use it to trace ancestry).

Open Budget and Actual Spending Data

For almost a year the UK government has published all spending data, month by month, for each government ministry (down to the £500 in some, £25,000 in others). More over, as an increasing number of local governments are required to share their spending data it has lead to savings, as government begin to learn what other ministries and governments are paying for similar services.

Create a steering group of leading Provincial and Municipal CIOs to create common schema for core data about the country.

While open data is good, open data organized the same way for different departments and provinces is even better. When data is organized the same way it makes it easier to citizens to compare one jurisdiction against another, and for software solutions and online services to emerge that use that data to enhance the lives of Canadians. The Federal Government should use its convening authority to bring together some of the countries leading government CIOs to establish common data schemas for things like crime, healthcare, procurement, and budget data. The list of what could be worked on is virtually endless, but those four areas all represent data sets that are frequently requested, so might make for a good starting point.

Solving the Common Standards problem in the Open Data Space

Last year during my Open Government Data Camp keynote speech on The State of Open Data 2011 I mentioned how I thought the central challenge for open data was shifting from getting data open (still a big issue, but a battle that is starting to be won) to getting all that open data in some common standards and schemas so that use (be it apps, analysis and other uses) can be scaled across jurisdictions.

Looks like someone out there is trying to turn that challenge in to a business opportunity.

Listpoint, a UK based company has launched a platform with the goal of creating translators between various established specs. As they point out in an email I saw from them:

“The Listpoint reference data management platform is a repository for data standards in the shape of code lists. Listpoint will help interpret open data by providing its underlying metadata and schema in machine readable format. E.g. mapping ISO country codes and Microsoft Country codes to provide a translation layer for systems to surface a single view of data.”

Interesting stuff… and exactly the types of challenges we need solved if we are going to scale the opendata revolution.

Open Government Advocacy: The Danger of Letting Narrative Trump Fact

So I loath making this the first post of the new year, but here we go.

Today Canada.com published a story “Tony Clement vows innovative new open government, but critics point to poor record.” In it,  Jason Fekete the journalist responsible for the story, quotes a Democracy Watch spokesperson who sadly gets the facts completely wrong despite the fact that I warned Democracy Watch about their error a month ago after their press release caused similar errors to appear in a CBC story. I’ll outline why this is problem later in the post. Bur first the error.

In the article Fekete reports

Democracy Watch said it will appeal to the international open government group to reject Canada’s entry because the federal government failed to keep one of its required commitments to consult Canadians. Ottawa announced its online consultation one day after the watchdog complained about it.

This is, in fact, not true. To date, the government has not failed to meet its commitment. As I pointed out in an earlier blog post (to which Democracy Watch responded as is aware) Democracy Watch accuses the government of failing because it believed consultations needed to be conducted before a November OGP meeting in Brazil. Unfortunately, the meeting in which Governments will be sharing their plans (and thus need to complete their consultations) will be taking place in Brazil in April. The OPG clearly states this on their website (under section 5). There was a meeting in November, so the confusion was understandable.

Of course, just to be safe, I did what the CBC and Postmedia should have done. I emailed the OGP secretariat to check. Within minutes they confirmed to me that the April meeting is the deadline for consultations and developing plans. What is more interesting to me is the no one from Democracy Watch, the CBC or Post Media bothered to simply email or call the OGP secretariat and confirm these facts. For the CBC and Postmedia this is a matter of laziness. For Democracy Watch, I’m not sure what is driving this willed blindness. Ultimately, I suspect that once they went public with their narrative, backing down would be seen as weakness and then government secrecy would win!

This is dangerous for two reasons.

The first is, it isn’t true. Government secrecy doesn’t win if Democracy Watch got its facts mixed up. I agree that this government has a lot to answer for around its willingness to disclose government documents. Be it documents around the procurement of the F-35 or the treatment of Afghan prisoners there are many cases where the lack of transparency has been blatant and, I believe, counter to the principles of democracy and open government. Conceding that the Government is still on track for its Open Government Partnership objectives does not diminish that fact. The only thing that misrepresenting the facts does is cause conservative leaning voters who believe in government transparency (an important constituency) to tune out of the debate and believe that Democracy Watch is simply out to score points against the government, not fulfill its mission.

The bigger reason I think it is dangerous is that it undermines the very thing that makes the Open Government Partnership an effective tool of open government advocates. I want to be clear. The Open Government Partnership is, in part, designed to empower advocates and help them compel their government’s to be more open. Used correctly it could be powerful. The fact that Canadian government signed on to the International Aid Transparency Initiative (IATI) and the Extractive Industries Transparency Initiative is a result, in part, of the fact that other OGP countries were signing on. We were able to use peer pressure to create an upward spiral. We can also use the timelines of the OGP to ensure the government carries out the pledges that it has made. And of course, there is an Open Government consultation that is currently taking place (please participate) that the government will have to share the results of with its partners – potentially giving us a way to verify that our input is being taken seriously. Indeed, participating OPG countries may even try to out do one another to demonstrate how seriously they are taking this input.

But when this tool is misused it gives the government license to ignore and write off critics. As someone who wants to use the OGP commitments as a carrot and stick to hold our government to account, stories like those I linked to above hurt our capacity to be effective.

This government does not have a great record of transparency. At the same time, there is a legitimate effort to create open government goals as part of the OGP, let’s let the process run its course (and criticize when they actually violate the process) and use the tools that are at our disposal constructively to maximize impact, rather than try to snare a quick headline that in the long term, could damage the open government movements credibility.

I certainly wouldn’t encourage Democracy Watch to petition the OGP to ask Canada to leave the partnership. I suspect the secretariat would be confused by the request. The deadline has not passed, indeed, most OGP countries are in the middle of their consultations right now.

 

 

Open Government Consultation, Twitter Townhalls & Doing Advocacy Wrong

Earlier this week the Canadian Federal Government launched its consultation process on Open Government. This is an opportunity for citizens to comment and make suggestions around what data the federal government should make open and what information it should share, and provide feedback on how it can consult more effectively with Canadians. The survey (which, handily, can be saved midway through completion) contains a few straightforward multiple choice questions and about eight open ended questions which I’ve appended to the end of this post so that readers can reflect upon them before starting to fill out the form.

In addition to the online consultations, Tony Clement – the Minister responsible for the Open Government file – will host a Twitter townhall on Open Government this Thursday (December 15). Note! The townhall will be hosted by the treasury board twitter account @TBS_Canada (English) and @SCT_Canada (French) not Minister Clement’s personal (and better known) twitter account. The townhall will first take place in French from 4-4:45pm EST using the hashtags #parlonsgouvert and then in English from 5-5:45 EST using the hashtag #opengovchat.

Some of you may have also noticed that Democracy Watch issued a strongly worded press release last week with the (somewhat long) headline “Federal Conservatives break all of their international Open Government Partnership commitments by failing to consult with Canadians about their draft action plan before meeting in Brazil this week.” This seems to have prompted the CBC to write this article.

Now, to be clear, I’m a strong advocate for Open Government, and there are plenty of things for which one could be critical about this government for not being open about. However, to be credible – especially around issues of transparency and disclosure – one must be factual. And Democracy Watch did more than just stretch the truth. The simple fact is, that while I too wish the government’s consultations had happened sooner, this does not mean it has broken all of its Open Government Partnership commitments. Indeed, it hasn’t broken any of its commitments. A careful read of the Open Government Partnership requirements would reveal that the recent December meeting was to share drafts plans (including the plans by which to consult). The deadline that Democracy Watch is screaming about does not occur until March of 2012.

It would have been fair to say the government has been slow in fulfilling its commitments, but to say it has broken any of them is flatly not true. Indeed the charge feels particularly odd given that in the past two weeks the government signed on greater aid transparency via IATI and released an additional 4000 data sets, including virtually all of StatsCan’s data, giving Canadian citizens, non profits, other levels of governments and companies access to important data sets relevant for social, economic and academic purposes.

Again, there are plenty of things one could talk about when it comes to transparency and the government.  Yes, the consultation could have gotten off the ground faster. And yes, there is much more to done. But this screaming headline is somewhat off base. Publishing it damages both the credibility of the organization making the charge, and risk hurting the credible of open government advocates in general.

 

List of Open Ended Questions in the Open Government Consultation.

1. What could be done to make it easier for you to find and use government data provided online?

2. What types of open data sets would be of interest to you? Please pick up to three categories below and specify what data would be of interest to you.

3. How would you use or manipulate this data?

4. What could be done to make it easier for you to find government information online?

7. Do you have suggestions on how the Government of Canada could improve how it consults with Canadians?

8. Are there approaches used by other governments that you believe the Government of Canada could/should model?

9. Are there any other comments or suggestions you would like to make pertaining to the Government of Canada’s Open Government initiative?