Category Archives: commentary

Does your Government (and thus you) actually own its data?

For those who missed it, there was fascinating legal analysis of Public Engines, Inc. effort to sue ReportSee, Inc. the other day on the Berkman centre’s Citizen Media Law Project blog.

If you haven’t read it, I encourage you to take a look. It’s more than a legal brief. It is a cautionary tale for every government official.

Why is this?

The story is as such. Public Engines Inc is paid by police departments to collect and analyze their crime data. Given this privileged position Public Engines strips the data of privacy related information and, through a service called CrimeReports.com, it allows citizens to see maps of it and so forth.

The problem is, this isn’t actually open data. As I argue in the three laws of open data (and the good folks at Berkman seem to share my sense of humour) crime data for cities that contract with Public Engines Inc isn’t open. You can look at the data, but you can’t touch it. Worst still… don’t even think about playing with it (unless you are doing so ON crimereports.com website, in a way that their license lets you – its all quite constraining stuff).

And herein lies Reportsee Inc’s big mistake. It scraped this data from CrimeReports.com and offered it up in a competing manner.

The legal analysis on the post is very much worth reading. At the end of the day, everyone is behaving rationally. Public Engine Inc is trying to protect its monopoly on crime data, and the investment it has made in cleaning it up of private information. Reportsee is simply trying to access what is public data the only place where – in many instances – it appears to be being made available.

The real party to blame here are governments that signed this agreements and that don’t understand that data is both a strategic and public asset. Understandably the smart people at Berkman understood this and jumped all over it:

The bottom line is that this sort of dispute could be avoided if government agencies are more proactive and farsighted when negotiating terms with third-party providers of data management services. In particular, government agencies should maintain control over the resulting data, or at a minimum, require that the contractor permit a wide range of uses of the data. It’s not just in the public interest of promoting government transparency and accountability. It’s also in the agencies’ interest to streamline its public records requests. The agencies are already paying for the data management services anyway, why spend even more government resources in order to respond to redundant public records requests?

Indeed, the post notes that:

…that government agencies often pay third parties to collect, compile and maintain public records data in useful formats, and who may retain rights over the data. This isn’t the first time a third-party data contractor has stepped in the way of a commercial use of data feeds. In the Bay Area a few years ago, Routsey’s iPhone app making use of data feeds with bus and train arrival times got in a jam when the contractor providing the data to MUNI, the public transportation agency, asserted its rights to the data.

So, if you are a government official, this is the critical lesson. Many vendors know that if they control the data, they control you. They’ve got you locked into to buying their software and possible even locked in to buying their consulting services. More importantly, they now have a monopoly over what the public can learn about services and information their tax dollars paid to deliver and collect. No government would ever allow the New York Times or the Globe and Mail to become the exclusive distributor of government information. And yet, everyday, governments sign contracts with software vendors that effectively does just this but with something more basic than information, the raw data. Frightening enough stuff for governments. Still more frightening for us citizens.

Also, having heard tale after tale of government legal offices fighting open data initiatives, I’m reminded of how I wish some government lawyers would take the time they spend preventing the public from accessing public data and reallocate it towards preventing publicly funded data from becoming the monopoly assets of private vendors.

Getting Government Right Behind the Firewall

The other week I stumbled on this fantastic piece by Susan Oh of Ragan.com about a 50 day effort by the BC government to relaunch its intranet set.

Yes, 50 days.

If you run a large organization’s intranet site I encourage to read the piece. (Alternatively, if you are forced (or begged) to use one, forward this article to someone in charge). The measured results are great – essentially a doubling in pretty much all the things you want to double (like participation) – but what is really nice is how quick and affordable the whole project was, something rarely seen in most bureaucracies.

Here is an intranet for 30,000 employees, that “was rebuilt from top to bottom within 50 days with only three developers who were learning the open-source platform Drupal as they as went along.”

I beg someone in the BC government to produce an example of such a significant roleout being accomplished with so few resources. Indeed, it sounds eerily similar to GCPEDIA (available to 300,000 people using open source software and 1 FTE, plus some begged and borrowed resources) and OPSPedia (a test project also using open source software with tiny rollout costs). Notice a pattern?

Across our governments (not to mention a number of large conservative companies) there are tiny pockets where resourceful teams find a leader or project manager willing to buck the idea that a software implementations must be a multi-year, multimillion dollar roll out. And they are making the lives of public servants better. God knows our public servants need better tools, and quickly. Even the set of tools being offered in the BC examples weren’t that mind-blowing, pretty basic stuff for anyone operating as a knowledge worker.

I’m not even saying that what you do has to be open source (although clearly, the above examples show that it can allow one to move speedily and cheaply) but I suspect that the number of people (and the type of person) interested in government would shift quickly if, internally, they had this set of tools at their disposal. (Would love to talk to someone at Canada’s Food Inspection Agency about their experience with Socialtext)

The fact is, you can. And, of course, this quickly get us to the real problem… most governments and large corporations don’t know how to deal with the cultural and power implications of these tools.

We’ll we’d better get busy experimenting and trying cause knowledge workers will go where they can use their and their peers brains most effectively. Increasingly, that isn’t government. I know I’m a fan of the long tail of public policy, but we’ve got to fix government behind the firewall, otherwise their won’t be a government behind the firewall to fix.

Twitter, Criminal Investigations & Fox News North

Today, in a headline that came as somewhat of a shock (that, of course, I first saw on twitter) Kory Teneycke, the Quebecor Media vice-president and main advocate for the proposed Sun TV News Channel, announced his resignation. As backgrounder for those not familiar with this story, the proposed Sun TV News Channel is seeking to bring a conservative, Fox styled cable news channel to Canada. There has been a little bit of a battle over what type of license they should get which is covered very well in this blog post. What’s important is that Avaaz launched a petition against the proposed channel which subsequently had a number of false names added to it (adding someone else’s name to a petition is, I’m told, illegal in Canada).

What makes Teneycke’s resignation so interesting is that it comes on the heels of Avaaz asking the police to investigate the additions. It appears that, thanks to technology, figuring out who was illegally adding the names may not be that hard:

On September 2, 2010, Avaaz became aware that an individual operating from an Ottawa IP address was adding both fictional and actual names and email addresses to a petition to stop Prime Minister Harper from pushing biased crony media onto Canadian airwaves. The next morning, Quebecor executive and Sun TV front man Kory Teneycke published several pieces in Quebecor owned newspapers attacking Avaaz and accusing them of running a fraudulent petition – even quoting actual names added by the fraudster. Teneycke later admitted to insider knowledge of both the perpetrator and crimes committed.

Days later, Quebecor threatened to sue Avaaz for the content of its petition site.

In short, it appears that either Teneycke or someone he knew was adding false names to the petition so that a) Teneycke could write a story to discredit the petition and b) prompt Quebeccor to launch a lawsuit to have it taken down. This is serious stuff. Especially from someone who intends to run a news channel. (although, to be fair, it is consistent with the type of thing one might expect from Fox News).

Perhaps Teneycke’s resignation has nothing to do with the false names on the petition? But it is also worth noting that Teneycke’s twitter account is no longer active. This also means that the original offending tweet where he admits that he knew the person adding the false names can no longer be seen. Fortunately, on a lark, I took a screen shot of it the day it went up since, after reading CBC reporter Kady O’malley’s excellent coverage of the back and forth, since given her coverage something seemed very odd about the whole affair.

So what are some key lesson here?

a) Things on twitter don’t disappear

b) Manipulating the press in a world of social media is not as easy as you think it is, even for a former Prime Minister spokes person

c) It appears that Sun TV executives are every bit as slimy as the counterparts feared they would be. If even 10% of this is true then this is shocking behaviour from a proposed News television executive.

d) This may yet lead to Canada’s first high-profile criminal investigation involving twitter

Interesting stuff indeed.

The Web and the End of Forgetting: the upside of down

A reader recently pointed me to a fantastic article in the New York Times entitled The Web and the End of Forgetting which talks about the downside of a world where one’s history is permanently recorded on the web. It paints of the dangers of a world where one can never escape one’s past – where mistakes from college rear their head in interviews and where bad choices constrain the ability to start anew.

It is, frankly, a terrifying view of the world.

I also think it is both overblown and, imagines a world where the technology changes, but our social condition does not. Indeed, the reader sent me the piece because it reminded him of a talk and subsequent blog post I wrote exactly a year ago on the same topic.

But let’s take the worse case scenario at face value. While the ability to start anew is important, at times I look forward to a world where there is a little more history. A world where choices and arguments can be traced. A world of personal accountability.

Broadcast media fostered a world where one could argue one position and then, a few months later, take the exact opposite stand. Without easily accessible indexes and archives discerning these patterns was difficult, if not impossible. With digitization, that has all changed.

The Daily Show remains the archetype example of this. The entire show is predicated on having a rich archival history of all the major network and cable news broadcasts and having the capacity, on a nightly basis, to put the raw hypocrisy of pundits and politicians on display.

The danger of course, is if this is brought to the personal level. The NYT article identifies and focuses on them. But what of the upsides? In a world where reputation matters, people may become more thoughtful. It will be interesting to witness a world where grandparents have to explain to their grandchildren why they were climate change deniers on their Facebook page. Or why you did, or didn’t join a given political campaign, or protest against a certain cause.

Ultimately, I think all this remembering leads to a more forgiving society, at least in personal and familial relationships, but the world of pundits and bloggers and politicans may become tougher. Those who found themselves very much on the wrong side of history, may have a hard time living it down. The next version of the daily show may await us all. But not saying anything may not be a safe strategy either. Those who have no history, who never said anything at anytime, may not be seen relevant, or worse, could be seen as having no convictions or beliefs.

I loved the New York Times article, but it looked at society as a place where social values will remain unchanged, where we won’t adapt to our technology and place greater emphasis on new values. I can imagine a world where our children may say – how did you have friends with so little personal history? It may not be our ideal world, but then, our grandparents world wasn’t one I would have wanted to live in either.

Your friday funny: This blogger is at the wrong blog

For those who haven’t seen it yet, I strongly, strongly, strongly encourage you to watch the “This Drummer is at the Wrong Gig” video embedded below. I discovered the clip a few weeks and have been sharing it with all my friends. It’s awe inspiring, hilarious, amazing and, just keeps getting better and better as you get deeper into the clip.

Watch the drummer. Pure genius.

What’s better, the drummer – Steve Moore – is just flat out nice. Check out this interview with him about his youtube fame. He’s everything you’d want in a bandmate: loyal, talented and doing it for the right reason.

Indeed, the best part of the interview is him talking about how he couldn’t care less about money but how getting the respect from drummers he looks up to is what has been the biggest pay off.

Anyone whose felt passionate about something likely feels the same way. Personally, I hope I blog half as well as this guy drums. And nothing feels better than getting an email or tweet about a blog post from someone I really respect. Those really are the best moments.

Nice work Steve Moore. You’re an inspiration. And just plain awesome.

The dangers of narrow cast politics

I am going to very substantially scale back my writing about this issue. I have reached the point where I am wasting my breath. My consolation is that many tens of thousands of Canadians now see this charade for what it is; that this has turned into a very, very bad day at the office for all concerned, including a few strategic geniuses who thought they could narrow-cast their way to electoral gain while the rest of the country missed this story; and that I have managed to shine a bit of a light on some of the most squalid behaviour I have ever witnessed in 20 years as a reporter.

The census?

Wrong.

This was written back on February 24th, 2010 in a fantastic post by Paul Wells about… the Rights & Democracy scandal. Today, the audit promised by the government on that organization has missed three deadlines and is still not been delivered. Today the organization remains in shambles: demoralized, frustrated and tarnished.

This, I fear, could be the fate of Statistics Canada. With the census (and a number of other survey) “a few strategic geniuses” thought that in the dead of summer, on the friday of a long weekend, they could kill something that has become core to legislation and decision making for every level of government, businesses, NGO’s, researchers and ordinary Canadians.

Today we know differently. With a Deputy Minister resigned, the media sniffing blood, the country up in arms and every major newspaper running damning editorials the only difference between the census scandal and the rights and democracy scandal is the size and scope of the impact.

Someone needs to tell the PMO that narrow-cast politics is dead. At least for this government There have simply been too many mistakes and the intelligence of too many Canadians has been insulted too many times to get away with it.

I hope that message gets through. I don’t know how many more times this government intends to narrow-cast a policy to try to pick up a few points with a vested interest group but I do know that we are running out of institutions we can’t afford to have destroyed.

Minister Clement, privacy and (un)balanced views

Just moments ago Industry Minister Tony Clement, in response to growing criticism about his decision to end the mandatory long form census (now the Canadian Medical Association has come out in opposition), again cited “privacy concerns” from Canadians.

To quote Minister Clement via the Globe article:

“Just in the past 48 hours I’ve received dozens and dozens of [letters from] Canadians who despite the adverse publicity … have come forward and said, ‘We agree with your position,’” Mr. Clement said.

“I am not saying it’s every Canadian, but I am saying there are Canadians [who complained] and we should try to accommodate their concerns in a balanced way,” he said.

Of course, the minister made no reference to complaints made before he made his decision. That’s because it is rapidly becoming obvious their were none. The Privacy Commissioner registered just 3 complaints in the last decade. Statistics Canada’s survey about the last census generated no feedback regarding privacy. The minister’s claim about privacy concerns is a sham – he’s veering on the edge of having lied to Canadians. Now he’s trying to cover it up by citing complaints since his decision.

It is great to hear the Minister Clement is interested in Canadians concerns since he made his announcement because in contrast to the few dozen he’s received the rest of the country seems focused on a petition in opposition to his decision that has garnered 5800 Canadians names (and that grows at about 3 names a minute) in the last few days. Will he listen to their voices too?

I can’t say I’m confident. Even with conservatives like C.D. Howe Institute President William Robson speaking in opposition. Why? Two reasons.

First, let’s take a look at the last time the Minister consulted Canadians regarding a decision. How about last year on the issue of copyright, digital locks and circumvention. During this consultation 6641 speaking Canadians spoke against anti-circumvention provisions and a mere 46 Canadians spoke in favour. And yet, the desire of those 46 trumped the 6641. Or how about on Tuesday when Industry Canada suddenly pulled the second most popular discussion (about the census long form) from the Digital Economy Consultation.

It is the second, however, that is more important. I don’t think the Minster is the decision maker. Indeed, I don’t think he even wanted to do this. I don’t always agree with him but Minister Clement seems  smart and even fun. His twitter account is personable and engaging. More interestingly, the Minister allegedly spoke in opposition to this decision behind closed doors. The real decision maker was the Prime Minister. All the more reason why Canadians need to let their unhappiness with this decision known – they need to help Minister Clement reverse it.

Irony, defined

So it appears that the Vancouver Province Editorial Page Editor Gordon Clark is not a fan of either the census or me. In a piece the other day (which someone kindly forwarded on to me) he become the lone person in the country to defend Industry Minister Clement’s decision to end the Long Form Census.

His reason? In his own words:

Clement is right when he says the data from a voluntary form may be more accurate than under the current forced scheme, which resulted, for example, in 55,000 Canadians listing “Jedi” as their religion in the last census. It makes you wonder how accurate the rest of it was despite its $567-million cost. For that kind of money shouldn’t those StatsCan folks be curing cancer or something?

Actually, Clement is not right. There isn’t a statistician in the country who would agree with this opinion. Indeed, I dare Gordon Clark to produce a single statistician at a university, or even a polling firm, who will agree with this statement. I’ve got about a 1000, and indeed, their professional organization, who feel otherwise. So Clark’s defense is built on a lie. But then, since  this whole debate is about replacing facts with opinions, should we be surprised?

But that’s reasoned fact part of this blog post, there’s a juicier little tidbit…

Over at Gordon Clark’s twitter page, take a look at his bio:

See that line that proudly states “The Province, the best-read newspaper in Canada west of Toronto.”

Interesting that, isn’t it?

So how does Gordon know that The Province newspaper is the best read paper west of Toronto? Well, he relies on NADbank, which produces regular reports about newspaper readership. But dig a little deeper. In the technical report that outlines the survey’s methodology I’ll give you one guess on how NADbank ensures it has an accurate cross section of Canadians so that Gordon Clark can accurately and proudly claim his paper is the best-read in Western Canada.

Again… one chance…

How about… the census! Yes, the census – including references to data collected by the long form – is mentioned no less than 20 times in the report and is essential to enabling NADbank to do its survey.

So not only does Gordon Clark wish to replace fact with opinion, he has no idea how the census – especially the long form – impacts almost every aspect of his life, including his ability to brag. Of course, if he wants to he could change his bio to say:

I’m in charge of the editorial pages and write a weekly column for The Province, a newspaper in western Canada that we aren’t really sure how many people read.

But somehow that doesn’t have the same punch, does it?

As an aside, it is worth noting that while NADbank has The Province as the most-read newspaper in western Canada the Canadian Newspaper Association survey shows the Vancouver Sun has a bigger paid circulation (by quite a margin). I suppose if you give away enough free copies, you too can boost your readership…

When Police Lie

The single most important tool police have in their arsenal isn’t a gun, it isn’t baton, it isn’t even their badge. It is public confidence.

It is this confidence that ensures the public they can have faith in some of the most important and powerful public servants they meet in their day to day lives, and more importantly, it is vested in hands that will prioritize the rule of law over violence.

This, however, breaks down when police lie.

This week, as far as I can tell, the Toronto Police Chief Bill Blair has been caught in two lies. First, in claiming the policy had legal authority to detain people within 5 meters of the perimeter fence at the G20, second, when they put confiscated weapons on display that had been found on “protesters.”

Worse still, was his defense.

Asked Tuesday if there actually was a five-metre rule given the ministry’s clarification, Toronto Police Chief Bill Blair smiled and said, “No, but I was trying to keep the criminals out.”

The police have more than a tough job. Consider the idiocy they had to deal with during the G20. Take, for example, Anti-Capitalist Convergence spokesperson Mathieu Francoeur’s claim that vandalism and violent protests were “not violence” but “a means of expression and doesn’t compare to the economic and state violence we’re subjected to.” Yes, it drives me crazy too. Of all the ills in the world to choose from, violence against a state that provides welfare, free health-care and subsidized education just never seems to make my top 10 list…

But the best weapon against this idiocy is honest and upfront police force. Admittedly, this contributes to what makes their job hard, but citizens expect the police to follow the law and behave ethically. That, more than a gun, a badge, or a uniform, this code of conduct is what separates them from everyone else – from the criminals, and even, ordinary citizens. We expect, and we need them to model behaviour.

Mistakes I can understand. Poor decisions under stress I can understand. But deliberately misleading the public I cannot understand, nor do I think there are many who will condone it. Is lying now an appropriate strategy for dealing with the public? If a police force – and more importantly, its chief – is willing to mislead us about weapons captured and the nature of the law during the G20, what will they lie about at other times?  Perhaps when I get pulled over? Or when my 21 year cousin accidentally bumps into an officer who is having a bad day? Do I believe the Toronto police force is on a slippery slope? No. But I don’t want them on the slope at all.

Today, it feels we are a long, long way away from the era of the trusted and honest Mountie (side note about the RCMP, it has the dubious distinction of having a whole wikipedia page dedicated to some of scandals) and the erosion of this trust may be one of the biggest causalities of the G20 Summit.

yellow-pages-banCanadian? Hope you’ll also consider opting out of receiving the yellow pages. Facebook group and instructions on how to save some trees here.

Minister Moore and the Myth of Market Forces

Last week was a bad week for the government on the copyright front. The government recently tabled legislation to reform copyright and the man in charge of the file, Heritage Minister James Moore, gave a speech at the International Chamber of Commerce in which he decried those who questioned the bill as “radical extremists.” The comment was a none-too-veiled attack at people like University of Ottawa Professor Michael Geist who have championed for reasonable copyright reform and who, like many Canadians, are concerned about some aspects of the proposed bill.

Unfortunately for the Minister, things got worse from there.

First, the Minister denied making the comment in messages to two different individuals who inquired about it:

Still worse, the Minister got into a online debate with Cory Doctorow, a bestselling writer (he won the Ontario White Pine Award for best book last year and his current novel For the Win is on the Canadian bestseller lists) and the type of person whose interests the Heritage Minister is supposed to engage and advocate on behalf of, not get into fights with.

In a confusing 140 character back and forth that lasted a few minutes, the minister oddly defended Apple and insulted Google (I’ve captured the whole debate here thanks to the excellent people at bettween). But unnoticed in the debate is an astonishing fact: the Minister seems unaware of both the task at hand and the implications of the legislation.

The following innocuous tweet summed up his position:

Indeed, in the Minister’s 22 tweets in the conversation he uses the term “market forces” six times and the theme of “letting the market or consumers decide” is in over half his tweets.

I too believe that consumers should choose what they want. But if the Minister were a true free market advocate he wouldn’t believe in copyright reform. Indeed, he wouldn’t believe in copyright at all. In a true free market, there’d be no copyright legislation because the market would decide how to deal with intellectual property.

Copyright law exists in order to regulate and shape a market because we don’t think market forces work. In short, the Minister’s legislation is creating the marketplace. Normally I would celebrate his claims of being in favour of “letting consumers decide” since this legislation will determine what these choices will and won’t be. However, the Twitter debate should leave Canadians concerned since this legislation limits consumer choices long before products reach the shelves.

Indeed, as Doctorow points out, the proposed legislation actually kills concepts created by the marketplace – like Creative Commons – that give creators control over how their works can be shared and re-used:

But advocates like Cory Doctorow and Michael Geist aren’t just concerned about the Minister’s internal contradictions in defending his own legislation. They have practical concerns that the bill narrows the choice for both consumers and creators.

Specifically, they are concerned with the legislation’s handling of what are called “digital locks.” Digital locks are software embedded into a DVD of your favourite movie or a music file you buy from iTunes that prevents you from making a copy. Previously it was legal for you to make a backup copy of your favourite tape or CD, but with a digital lock, this not only becomes practically more difficult, it becomes illegal.

Cory Doctorow outlines his concerns with digital locks in this excellent blog post:

They [digital locks] transfer power to technology firms at the expense of copyright holders. The proposed Canadian rules on digital locks mirror the US version in that they ban breaking a digital lock for virtually any reason. So even if you’re trying to do something legal (say, ripping a CD to put it on your MP3 player), you’re still on the wrong side of the law if you break a digital lock to do it.

But it gets worse. Digital locks don’t just harm content consumers (the very people people Minister Moore says he is trying to provide with “choice”); they harm content creators even more:

Here’s what that means for creators: if Apple, or Microsoft, or Google, or TiVo, or any other tech company happens to sell my works with a digital lock, only they can give you permission to take the digital lock off. The person who created the work and the company that published it have no say in the matter.

So that’s Minister Moore’s version of “author’s rights” — any tech company that happens to load my books on their device or in their software ends up usurping my copyrights. I may have written the book, sweated over it, poured my heart into it — but all my rights are as nothing alongside the rights that Apple, Microsoft, Sony and the other DRM tech-giants get merely by assembling some electronics in a Chinese sweatshop.

That’s the “creativity” that the new Canadian copyright law rewards: writing an ebook reader, designing a tablet, building a phone. Those “creators” get more say in the destiny of Canadian artists’ copyrights than the artists themselves.

In short, the digital lock provisions reward neither consumers nor creators. Instead, they give the greatest rights and rewards to the one group of people in the equation whose rights are least important: distributors.

That a Heritage Minister doesn’t understand this is troubling. That he would accuse those who seek to point out this fact and raise awareness to it as “radical extremists” is scandalous. Canadians have entrusted in this person the responsibility for creating a marketplace that rewards creativity, content creation and innovation while protecting the rights of consumers. At the moment, we have a minister who shuts out the very two groups he claims to protect while wrapping himself in a false cloak of the “free market.” It is an ominous start for the debate over copyright reform and the minister has only himself to blame.