TV Punditry

Those of you who might be following me on social media (Twitter/Facebook/LinkedIN) might know that I’ve started a career in TV Punditry over the last week. Well, it’s not that much of a career – I still need to figure out how to get paid for it.

Anyway, so I was on News9 once on Saturday (analysing exit polls) and again on Tuesday (analysing the election results). It happened pretty much at random, from a random twitter conversation:

And so Mathang (who I’d first met in 2004 when he had interviewed me for Education Times) set me up with Anil Kumar from News9, who presently asked me for my number. A couple of twitter DMs, a couple of emails and a couple of phone calls later, I had been asked to come to the News9 studio at 5pm on Saturday.

Saturday’s session was really enjoyable, and I spoke a fair bit on the process of conducting an exit poll, the importance of sample sizes and representative samples, the process of converting votes to seats, etc. A 5 minute monologue on sampling process got the anchors interested in me, and they kept coming back to me. As is my wont, I summarised the import of my arguments for Mint.

And so I got invited again for Tuesday’s post-counting session, and I’m not sure I enjoyed it that much. As the elections threw up a hung assembly, the politicians on the panel spent their time shouting at each other. I was seated in an inappropriate place – right between a loud JDS spokesperson and a loud BJP spokesperson. I recused myself from much of the discussion and was only brought in because the anchors probably thought I should be “given some lines” – an opportunity I used to comment on the parties’ election strategies.

So two TV appearances later, I must say I quite like the format – it’s good footage (literally) if not anything else, but it can be a bit painful. Writing is easy in the sense that you just collect your thoughts and deliver them at a time.

Video means that you are virtually participating in a group discussion, and need to butt in to make your point. You might have something insightful to say, but need to wait for an opportune time to interject. You might be in the middle of a long point but get interrupted by another panellist. You might wait for ages to say something but the opportunity never comes. At other times, you might get a question that you’re not prepared for.

The worst thing as an analytical guy on TV is that you need to keep referring to your data, and your analysis. So there was one occasion on each session when the anchors asked me a question to answer which I’d to write some code to answer. So each time I mumbled something and bent down to my laptop, and got bailed out by the anchor who got someone else’s view in the time I took to get the requisite data.

In any case, I want to do more of this. I also hope that like with my writing, I can some day hope to get paid for TV appearances – this is a hard job since panellists representing political parties don’t charge anything – it’s in their parties’ interests to be represented on the show.

But, some day..

Algorithmic curation

When I got my first smartphone (a Samsung Galaxy Note 2) in 2013, one of the first apps I installed on it was Flipboard. I’d seen the app while checking out some phones at either the Apple or Samsung retail outlets close to my home, and it seemed like a rather interesting idea.

For a long time, Flipboard was my go-to app to check the day’s news, as it conveniently categorised news into “tech”, “business” and “sport” and learnt about my preferences and fed me stuff I wanted. And then after some update, it suddenly stopped working – somehow it started serving too much stuff I didn’t want to read about, and when I tuned (by “following” and “unfollowing” topics) my feed, it progressively got worse.

I stopped using it some 2 years back, but out of curiosity started using it again recently. While it did throw up some nice articles, there is too much unwanted stuff in the app. More precisely, there’s a lot of “clickbaity” stuff (“10 things about Narendra Modi you would never want to know” and the like) in my feed, meaning I have to wade through a lot of such articles to find the occasional good ones.

(Aside: I dedicate about half a chapter to this phenomenon in my book. The technical term is “congestion”. I talk about it in the context of markets in relationships and real estate)

Flipboard is not the only one. I use this app called Pocket to bookmark long articles and read later. A couple of years back, Pocket started giving “recommendations” based on what I’d read and liked. Initially it was good, and mostly curated from what my “friends” on Pocket recommended. Now, increasingly I’m getting clickbaity stuff again.

I stopped using Facebook a long time before they recently redesigned their newsfeed (to give more weight to friends’ stuff than third party news), but I suspect that one of the reasons they made the change was the same – the feed was getting overwhelmed with clickbaity stuff, which people liked but didn’t really read.

Basically, there seems to be a widespread problem in a lot of automatically curated news feeds. To put it another way, the clickbaity websites seem to have done too well in terms of gaming whatever algorithms the likes of Facebook, Flipboard and Pocket use to build their automated recommendations.

And more worryingly, with all these curators starting to do badly around the same time (ok this is my empirical observation. Given few data points I might be wrong), it suggests that all automated curation algorithms use a very similar algorithm! And that can’t be a good thing.

Why Twitter is like Times Now

One reason I stopped watching news television about a decade back is because of its evolution into a “one issue channel”. On each day, a channel basically picks a “topic of the day”, and most discussion on that day is regarding that particular topic.

In that sense, these “news channels” hardly provide news (unless you bother to follow the tickers at the bottom) – they only provide more and more discussion about the topic du jour (ok I’m feeling all pseud about using French on my blog!). If you’re interested in that topic, and willing to consume endless content about it, great for you. If not, you better look for your news elsewhere (like the <whatever> o’clock news on the government-owned channel which at least makes a pretence of covering all relevant stuff).

One thing that made Twitter attractive soon after I joined it in 2008 was the diversity of discussions. Maybe it was the nature of the early users, but the people I followed provoked thought and provided content on a wide array of topics, at least some of which I would find interesting. And that made spending time on twitter worthwhile.

It’s still true on a lot of days nowadays, but I find that Twitter is increasingly becoming like a modern news channel such as Times Now. When there are certain events, especially of a political nature, it effectively becomes a one-topic channel, with most of the timeline getting filled with news and opinion about the event. And if it is either an event you don’t care about, or if you’ve moved on from the event, Twitter effectively becomes unusable on such days.

In fact, a few of my twitter breaks in the last 2-3 years have followed such periods when Twitter has turned into a “one issue channel”. And on each of these occasions, when I’ve joined back, I’ve responded by unfollowing many of these “one-issue tweeters” (like this guy who I don’t follow any more because he has a compulsive need to livetweet any game that Arsenal is playing).

That Twitter becomes a one-topic channel occasionally is not surprising. Basically it goes like this – there are people who are deeply passionate or involved in the topic, and they show their passion by putting out lots of tweets on the topic. And when the topic is a current event, it means that several people on your timeline might feel passionately about it.

People not interested in the topic will continue to tweet at their “usual rate”, but that gets effectively drowned out in the din of the passionate tweeters. And when you look at your linear timeline, you only see the passion, and not the diverse content that you use Twitter for.

Some people might suggest a curated algorithmic feed (rather than a linear feed) as a solution for this – where a smart algorithm learns that you’re not interested in the topic people are so passionate about and shows you less of that stuff. I have a simpler solution.

Basically the reason I’m loathe to unfollow these passionate tweeters is that outside of their temporary passions, they are terrific people and tweet about interesting stuff (else I wouldn’t follow them in the first place). The cost of this, however, is that I have to endure their passions, which I frequently have no interest in.

The simple solution is that you should be able to “temporarily unfollow” people (Twitter itself doesn’t need to allow this option – a third party client that you use can offer this at a higher layer). This is like WhatsApp where you can mute groups for just a day, or a week. So you can unfollow these passionate people for a day, by which time their passion will subside, and you can see their interesting selves tomorrow!

Of course it’s possible to manually implement this, but I know that if I unfollow them today I might forget to follow them back tomorrow. And there are countless examples of people in that category – who I unfollowed when they were passionate and have thus missed out on their awesomeness.


The problem with premium ad-free television

I watched snippets of the just-concluded ICC WorldT20 final using an illegal streaming service, which streamed content drawn from SkySports2.  The horrible quality of the streaming aside (the server seemed to have terrible bandwidth issues), the interesting thing to note was that it was completely devoid of advertisements.

With the quality of cricket coverage in India currently being abysmal due to the frequent cutting for advertisements (I remember getting thoroughly pissed off with the cuts for advertisements before the replay of a wicket was shown during the India-Australia series earlier this year), it made me think about the economics of a separate premium service that is ad-free.

The infrastructure for delivery is in place, given that internet-based legal streaming services are fairly common now (the likes of HotStar). Internet-based delivery also makes it easy to charge pay per view, so payment is also not a problem. This raises the question of whether it is a good idea for channels to monetise the demand for ad-free cricket by providing the service through online streaming, leaving the mainstream broadcast to be monetised via advertisements.

While in theory this appears like a good idea, the problem is with the kind of people who will migrate to the new service – they will be people who have the ability and willingness to pay for a higher quality broadcast. Such people are likely to belong to two overlapping categories – loyal fans of the game and people who can afford to pay a premium.

It is unlikely that the┬áunion of these two sets will comprise of too high a proportion of the overall viewership of the game, but the point is that these are the two groups who are likely to be most lucrative to advertisers – the loyal fans watch regularly and the people who are able to pay have more disposable income.

Moving such customers to an ad-free online channel might reduce the supply of advertisements which can be used to reach them, and this might not make advertisers happy. And given that television channels have cosy relationships with advertisers (or at least media buyers), they are unlikely to piss them off by moving the most lucrative customers to a premium platform.

Of course if this segmentation (between ad-free and free broadcasts) is implemented, it will also impact the price of advertisements in the free broadcast. That will need to be taken as an input while setting prices for the ad-free service. In other words, pricing is going to be a challenge!

If some television channel wants to work on this, I’m available for hire as a consultant. I’ve done a fair amount of prior work on pricing and dynamic pricing, am pretty good at quantitative methods and am in the course of writing a popular economics book.

Bleg: News sources

I’ve decided to take yet another social media sabbatical (long time readers know I do this once in a while), and since I’m currently living abroad, one of the downsides of this is that I now have no direct access to news (social media did provide news, but came along with extremely fierce commentary and outrage).

I use Flipboard to curate some news, but the way I’ve been curating it of late means that I don’t get much news about India. Online editions of newspapers are there, but I find that most simply use them to archive stories, and the curation that is present in newspapers is missing.

So I’m basically looking towards curated sources of news that i can read and be satisfied that I know what’s happening in this world. I currently subscribe to two newsletters – the Economist Espresso that arrives in the morning and tells me all that’s happening in the world, and Matt Levine’s newsletter that arrives in the afternoon (Europe time) and tells me everything that’s happening in world markets.

Do any Indian newspapers have good curated content in the form of newsletters? Or any third party newsletter aggregators in India? Do let me know (by leaving a comment here or reaching me directly – if you don’t have my contact details, you can use the contact form on this blog). Thanks in advance.

The Economist and the Murray Gell-Mann Amnesia effect

I’ve been a subscriber to the Economist for the last couple of years and quite enjoy reading that newspaper. There are weeks when I don’t manage to go through the week’s edition, but there are certain weeks when it forms a large part of my reading. I quite like the paper, and I subscribe to the daily “Espresso” issue on my mobile phone.

I have only one problem – a lot of their writing about India is biased, and filled with Sominisms. I mean their business pieces are pretty good, like this profile of Welspun. But their political coverage is generally biased by their correspondents’ dislike for Prime Minister Narendra Modi, and hence not particularly objective.

I had recently carried a copy of the newspaper to read on my way to a quiz, where I met Baada. Baada was surprised that I read the newspaper, since it was so obviously biased in its coverage of Indian politics. “I agree that India coverage is biased”, I said, “but its worldwide coverage is really good. Hence I read it”.

Recently I came across the “Murray Gell-mann Amnesia effect“. It is named after the physicist, and claims that you will trust the rest of a newspaper even though you know that its coverage of your domain is shit. And thinking about it, I’m wondering if I should continue trusting The Economist.

Currently, I believe that the Economist’s coverage of Indian politics is shit, but I continue to read the newspaper for its other coverage. But what if everyone believes that the Economist’s coverage of their domain is inadequate? If that is the case, does it still make it a good paper? Should I use the fact of┬áthe Economist’s coverage of Indian business being better as a mitigating factor?

The problem is that there is no other paper that gives a nice concise view of what is happening in the world (FT is too voluminous given its frequency), and that makes the Economist good. But if their coverage is biased by their correspondents’ views in every country, it is not that trustworthy any more.

The only option I can think of is to continue reading the newspaper, but to “add salt to taste”. Every time I read a political story set in some country, I should keep in mind that the correspondent might be biased, and adjust my views accordingly. That way, I can consume the paper’s curation and analysis while not getting influenced by its inherent biases.

My tryst with Kannada media

So about a month or so back, I wrote up an essay on why the much-maligned TenderSURE project is a right step in the development of Bangalore, and why the Chief Minister’s comments on the issue were misguided and wrong.

Having written it, considering it worthy of a better forum than NED, I shared it with my Takshashila colleagues. They opined that is should get published in a Kannada newspaper, and Varun Shenoy duly translated the piece into Kannada. And then the story began.

We sent it to PrajaVani (which has published several other Op-Eds from other Takshashila people), but they summarily rejected this without giving reasons. We then sent it to UdayaVani, reaching it after passing some hoops, but then they raised some questions with the content, the answers to which had been made quite clear within the text.

I think Mint has spoilt me, in that I assume that it’s okay to write geeky stuff and have it accepted for publication. Rather, it is possible that they’ve recruited me so that they can further bolster their geek quotient. Last week, for example, I sent a piece on Fractional Brownian Motion, and it got published. A couple of years back I’d sent a formula with Tchebyshev’s inequality to be included in a piece on sampling, and they had published that too.

When translating my piece, Varun thought it was too geeky and technical, and he made an attempt to tone it down during his translation. And the translation wasn’t easy – for we had to find Kannada equivalents for some technical terms that I’d used. In some cases, Varun expertly found terms. In others, we simply toned it down.

Having toned down the piece and made an effort to make it “accessible”, UdayaVani’s response was a bit of a dampener for us – and it resulted in a severe bout of NED. And so we sat on the piece. And continued to put NED.

Finally, Varun got out of it and published it on the Takshashila blog (!!). The original piece I’d written is here:

A feature of Bangalore traffic, given the nature of the road network, is that bottlenecks are usually at the intersections, and not at the roads. As a consequence, irrespective of how much we widen the roads, the intersections will continue to constrain the flow of traffic in the city. In other words, making roads narrower will not have a material impact on the throughput of traffic in the city.

And Varun’s translation is here:

(Update: I tried to extract Varun’s piece here but it’s not rendering properly, so please click through and read on the Logos blog)

Read the whole thing, whichever piece you can understand. I think we are on to something here.

And on that note, it might make sense to do a more rigorous network-level analysis of Bangalore’s roads. Designing the graph is simple – each intersection (however small it might be) is a node, each “road segment” is an edge. The graph is both directed (to take care of one-ways) and weighted (to indicate width of roads).

We’ll need data on flows, though. If we can get comprehensive data of origin and destination of a large number of people, we should be able to impute flows in each segment based on that.

And then we can rigorously test the hypothesis (I admit that it’s still only a hypothesis) that bottlenecks on Bangalore’s roads are intersections and not roads.