Should you have an analytics team?

In an earlier post a couple of weeks back, I had talked about the importance of business people knowing numbers and numbers people knowing business, and had put in a small advertisement for my consulting services by mentioning that I know both business and numbers and work at their cusp. In this post, I take that further and analyze if it makes sense to have a dedicated analytics team.

Following the data boom, most companies have decided (rightly) that they need to do something to take advantage of all the data that they have and have created dedicated analytics teams. These teams, normally staffed with people from a quantitative or statistical background, with perhaps a few MBAs, is in charge of taking care of all the data the company has along with doing some rudimentary analysis. The question is if having such dedicated teams is effective or if it is better to have numbers-enabled people across the firm.

Having an analytics team makes sense from the point of view of economies of scale. People who are conversant with numbers are hard to come by, and when you find some, it makes sense to put them together and get them to work exclusively on numerical problems. That also ensures collaboration and knowledge sharing and that can have positive externalities.

Then, there is the data aspect. Anyone doing business analytics within a firm needs access to data from all over the firm, and if the firm doesn’t have a centralized data warehouse which houses all its data, one task of each analytics person would be to get together the data that they need for their analysis. Here again, the economies of scale of having an integrated analytics team work. The job of putting together data from multiple parts of the firm is not solved multiple times, and thus the analysts can spend more time on analyzing rather than collecting data.

So far so good. However, writing a while back I had explained that investment banks’ policies of having exclusive quant teams have doomed them to long-term failure. My contention there (including an insider view) was that an exclusive quant team whose only job is to model and which doesn’t have a view of the market can quickly get insular, and can lead to groupthink. People are more likely to solve for problems as defined by their models rather than problems posed by the market. This, I had mentioned can soon lead to a disconnect between the bank’s models and the markets, and ultimately lead to trading losses.

Extending that argument, it works the same way with non-banking firms as well. When you put together a group of numbers people and call them the analytics group, and only give them the job of building models rather than looking at actual business issues, they are likely to get similarly insular and opaque. While initially they might do well, soon they start getting disconnected from the actual business the firm is doing, and soon fall in love with their models. Soon, like the quants at big investment banks, they too will start solving for their models rather than for the actual business, and that prevents the rest of the firm from getting the best out of them.

Then there is the jargon. You say “I fitted a multinomial logistic regression and it gave me a p-value of 0.05 so this model is correct”, the business manager without much clue of numbers can be bulldozed into submission. By talking a language which most of the firm understands you are obscuring yourself, which leads to two responses from the rest. Either they deem the analytics team to be incapable (since they fail to talk the language of business, in which case the purpose of existence of the analytics team may be lost), or they assume the analytics team to be fundamentally superior (thanks to the obscurity in the language), in which case there is the risk of incorrect and possibly inappropriate models being adopted.

I can think of several solutions for this – but irrespective of what solution you ultimately adopt –  whether you go completely centralized or completely distributed or a hybrid like above – the key step in getting the best out of your analytics is to have your senior and senior-middle management team conversant with numbers. By that I don’t mean that they all go for a course in statistics. What I mean is that your middle and senior management should know how to solve problems using numbers. When they see data, they should have the ability to ask the right kind of questions. Irrespective of how the analytics team is placed, as long as you ask them the right kind of questions, you are likely to benefit from their work (assuming basic levels of competence of course). This way, they can remain conversant with the analytics people, and a middle ground can be established so that insights from numbers can actually flow into business.

So here is the plug for this post – shortly I’ll be launching short (1-day) workshops for middle and senior level managers in analytics. Keep watching this space 🙂

 

Name mutilation

Like Bangalore supposedly became Bengaluru a few years back (when HDK was cheap minister), West Bengal is going to change its name to “Poschim Bongo” or some such thing. Now, unlike Bombay-Mumbai or Madras-Chennai, the thing with these name changes is that they are merely globalization of local names. Let me explain.

Bombay (bom bahia or good port in Portuguese) and Mumbai (of Mumba Devi) are fundamentally different. Madras (mad race? ) and Chennai (beautiful) are again fundamentally different. While I disagree with those name changes and still prefer to call those cities by their former names, I see that the change in those names at least has some merit. They wanted to get rid of their colonial British-given names (and i’m sure Tams wanted to prove they aren’t a mad race, though they might have achieved the opposite through this action) and chose local names in the local language.

When Bangalore’s name was supposedly changed to “Bengaluru” a few years back, Kannada newspapers (I used to subscribe to Vijaya Karnataka back then) had a tough time explaining the name change. Because Bangalore has forever been known as “Bengaluru” in Kannada. Even now, when I speak in Kannada I say “Bengaluru” but I say “Bangalore” when speaking in any other language. While it might have been a noble intention by HDK and UR Ananthamurthy and others behind the name change to get the non-Kannadigas to use the Kannada name, the effect has been completely counterproductive.

Till date, I’m yet to meet someone who is not conversant in Kannada to pronounce “BengaLuru” correctly. First of all, most people can’t say the “L” sound and instead pronounce it as “l” (in Kannada that can make a profound difference. for example “hELu” is “tell” while “hElu” is “shit” ). Next (this is the problem with most North Indians), people have trouble pronouncing the short ‘e’ sound. Finally, it’s hard for people to figure out that the first U in Bengaluru is to be pronounced long and the terminal u should be pronounced short. The combination of all these means horribly messed up pronunciation, which makes one wonder why they bothered to “change” the name at all.

West Bengal doesn’t seem to have learnt from this experience of Bangalore. They want to call themselves “Poschim Bongo” it seems. Not being a bong, I’m going to have major difficulty in pronouncing that name, and I might end up pronouncing it in a way that makes most bongs cringe. I really hope they see sense before they make this name change official and opt for a saner name, if they want to change their name at all that is.

One thing they could try would be to knock that “west” off their name (I believe the Times of India has been campaigning for this). West Bengal was the primary reason that I got my directions and geography horribly wrong till I was some eight years old. I used to assume that “West Bengal” was at the western edge of India! Especially since Bangladesh is no more called “East Bengal”.

Given that they are mostly commie, one thing they could try is probably to go the East Germany or North Korea way, and name themselves “Democratic State of Bengal” or some such thing.

Arranged Scissors 12 – Rejection Sharing Agreements

This is similar to the Klose-Podolski corollary to the Goalkeeper Theory. To refresh your memory, or to fresh it in case I haven’t mentioned this earlier, the Klose-Podolski corollary refers to a case of two close friends who decide to hit on the same person. The implicit understanding is that they don’t regard each other as rivals but blade together, and first get rid of all the other suitors before they engage in one last showdown so that the bladee picks one of them.

We came up with this corollary to the Goalkeeper Theory shortly after the 2006 Football World Cup, during which Klose and Podolki formed a cracking strike partnership for Germany. Later on, they were to play together for Bayerrn Munchen, but like most Klose-Podolski arrangements, they too ended up in bitterness with Poodolski (who scored the lesser number of goals among the two) publicly voicing his bitterness and finally transferring to his “native” Koln.

Now that the crazy digression is out of the way, let me get to the point. Today is the first day of Navaratri, and with the inauspicious “Mahalaya Paksha” having gotten out of the way, arranged scissors is back in full earnest. This also means that I re-enter the market, though I’m still yet to list myself (don’t plan to for a while at least. OTC is said to give superior valuations). And some casual conversation and some not-so-casual phone calls this morning, I have been thinking of the arranged marriage equivalent of the Klose-Podolski arrangement.

So basically, as part of this arrangements, two parties who are looking to hit the same side of the deal strike a deal to share “rejection information” with each other. “Rejection information” can be of the following two types:

  • Today I found out about this girl. She seems to be really good in most respects – good looking, rich, good family background, virgin and all that. But for some (usually random) reason, my son doesn’t want to marry her. Why don’t you try her for your son?
  • Today I found out about this girl. Talked to her, her parents, etc. Doesn’t seem like a good prospect at all. She is either ugly or too “forward” or her family background is bad. I think the chances of her getting along with your son is quite low. Don’t waste your time with her.

Note that both of this is extremely useful information, especially in an illiquid market. What is important here is the nature of people with whom you strike such agreements. The basic thing is that your correlation with them should neither be too low nor too high. Ideally, they should belong to the same/similar caste, should have a fairly similar family background, etc. but the boys shouldn’t be too similar. Yeah, I think that is a fair criterion – they should be as similar as possible in terms of “arranged criteria” but as different as possible in terms of “louvvu criteria”.

Basically if the correlation is too low, then you can’t really trust their judgment on counterparties. On the other hand, if the correlation is too high, then it is extremely likely that they turn out to be “rivals” and that if one party rejects a girl, it’s unlikely that the other party will like the girl. I supppose you get what I’m talking about.

One downside to such agreements that I can think of – it might cause bitterness later on in life, long after the goal has been scored. The feeling that “this guy married a girl that I rejected” or the other way round might come back to haunt you later on in life.

The Perils of Notes Dictation

Thinking about my history lessons in schools, one picture comes to mind readily. A dark Mallu lady (she taught us history in the formative years between 6th and 8th) looking down at her set of voluminous notes and dictating. And all of us furiously writing so as to not miss a word of what she said. For forty minutes this exercise would continue, and then the bell would ring. Hands weary with all the writing, we would put our notebooks in our bags and look forward to a hopefully less strenuous next “perriod”.

The impact of this kind of “teaching” on schoolchildren’s attitude towards history, and their collective fflocking to science in 11th standard is obvious. There are so many things that are so obviously wrong with this mode of “teaching”. I suppose I’ll save that for else-where. Right now, I’m trying to talk about the perils of note-making in itself.

Before sixth standard and history, in almost all courses we would be dictated “questions and answers”. The questions that would appear in the exam would typically be a subset of these Q&A dictated in class. In fact, I remember that some of the more enthu teachers would write out the stuff on the board rather htan just dictating. I’m still amazed how I used to fairly consistently top the class in those days of “database query” exams.

I’m thinking about this from the point of view of impact on language. Most people who taught me English in that school had fairly good command over the language, and could be trusted to teach us good English. However, I’m not sure if I can say the same about the quality of language of other teachers. All of them were conversant in English, yes, and my schoool was fairly strict about being “English-medium”. However, the quality of English, especially in terms of grammar and pronunciation, of a fair number of teachers left a lot to be desired.

I can still remember the odd image of me thinking “this is obviously grammatically incorrect” and then proceeding to jot down what the teacher said “in my own words“. I’m sure there were other classmates who did the same. However, I’m also sure that a large number of people in the class just accepted what the teacher said to be right, in terms of language that is.

What this process of “dictation of notes” did was that teachers with horrible accents, grammar, pronunciation or all of the above passed on their bad language skills to the unsuspecting students. All the possible good work that English teachers had done was undone.There is a chance that this bad pronunciation, grammar, etc. would have been passed on even if the teachers didn’t give notes – for the students would just blindly imitate what the teachers would say. However, the amount by which they copied different teachers would not then be weighted by the amount of notes that each teacher dictated, and I think a case can be made that the quality of a teacher is inversely proportional to the amount of notes he/she dictates.

Teachers will not change because dictation is the way that they have been taught to “teach”. The onus needs to go to schools to make sure that the teachers don’t pass on their annoying language habits to the students. And a good place to start would be to stop them from dictating notes. And I still don’t understand the value of writing down notes that you don’t really bother to understand when you have a number of reasonably good text books and guide books available in the market. I agree that for earlier classes, some amount of note-making might be necessary (I think even that can be dispensed with), but in that case the school needs to be mroe careful regarding the language skills of people it recruits in order to dictate these notes.