Should I become a data scientist (or a business analyst)?

One of the common queries I come across repeatedly across several forums is “Should I become a data scientist (or an analyst)?” The query takes various forms and factors, but here is a common real life anecdote:

“I have been doing Sales for multiple BFSI giants for last 3 years, but I have stopped enjoying my role. After reading about Business Analytics and machine learning, my interest in this area has grown. Should I make a switch and learn data science? If so, How do I do this?

When I reflect back on how I took the decision, I realized – I happened to be lucky! The decision was relatively easier for me. Why? I knew the industries / roles, I would not enjoy – these included roles in Sales, roles in Physical engineering and a few others. I was open to roles in data science in retail banks and investment banks and luckily ended up with Capital One.

Today, after spending ~8 years in the industry, it is far easier for me to guide and mentor people on whether Analytics is the right role for them or not. So, I thought, I’ll try and put my thoughts in a framework and share it with the audience of this blog. The aim of this post is to help those people who are sitting on the fence and thinking which job / role is right for them. So, if you are someone deliberating a move in data science or are wondering whether you are a right fit with this industry, here is a neat framework which might help.

Framework

I have put a framework in the form of a very simple test. This test is based on the attributes every analyst should possess. You should score yourself against each of the questions (out of the score mentioned after the question) and then add your scores. A good analyst should score more than 70 and any one scoring below 50 should seriously re-consider a decision to be a data-scientist.

Test Questions:

Do you love number crunching and logical problem solving – i.e. puzzles, probabilities and statistics? (score out of 20)

By love I don’t mean like, I don’t mean you don’t mind numbers – I mean, do you have an obsession with numbers! Do you love doing guess-estimates at any time of the day – I have done those estimates while I am taking a shower, while I am driving, while I am watching a movie or even when I am swimming (and lost my count of laps)! I know my friend Tavish does these calculations in his mind too – while he is driving or while he is playing badminton. If you want me to space out of a discussion, just ask me a really hard logical problem!

Key:

5 – dread mathematics & statistics, but can face to some extent

10 – Comfortable with mathematics and statistics, but need calculators and excel to work on problems. Don’t mind attempting puzzles

15 – Love crunching numbers and solving logical puzzles anywhere

20 – Can’t live without number crunching and logical puzzles – an obsession!

Do you enjoy working / handling unstructured problems? (score out of 20)

An analyst will inevitably be tested against unstructured and amorphous business problems. And it is how you solve these unstructured problems, what decides how good or bad analyst you are. My first project in my first role stated: “In last few months, we have seen a high increase in high risk customers of type X. You need to come up with a data based strategy to measure, control and improve this situation.“

Even the business did not have a clear definition of these customers. Can you handle this kind of ambiguity and provide a direction on your own? Do you enjoy these situations or you would rather be comfortable in a more defined role?

Key:

5 – Have tried these problems in past – but not my cup of tea!

10 – A score of 10 would mean, you like solving these problems once in a while (say 3 – 6 months)

15+ – You prefer unstructured problems over structured. You don’t enjoy some one else structuring problems for you.

Do you enjoy deep research and can spend hours slicing and dicing data? (score out of 20)

Going back to the first project I faced, it took me 3 months to understand the business, have multiple discussions with stakeholders, bring them on the same page and then mine the data to bring out solutions. You need an outlook of a researcher to be a good business analyst. When was the last time you spent hours and hours immersed in solving a problem? Can you do that again and again?

Key:

5 – You want a change every few hours. You can’t work on a single problem for the entire day

10 – You can work on a research problem – but need some side work to help you out of boredom

15 – You feel the side work is distracting you from making progress on the key problem you are working. Would be happy if they are taken away

20 – Can’t stand distractions

Do you enjoy building and presenting evidence based stories? (score out of 20)

A data scientist needs to be a fluid presenter. What is the use of all the hard work, if he is not able to influence his stakeholders? Communicating with data and presenting stories backed by data is one of the most important elements in the life of a data scientist. Imagine being part of companies like Google and Amazon – you have all the data you need (probably more than that) for the domain you are working on, but you need to convert it into meaningful story, present it to the stakeholders and influence them to take the right decision!

Key:

5 – You struggle to communicate my mathematical thoughts to audience

10 – You can manage telling stories with a lot of practice. Can’t think of doing this on the fly!

15+ – Any time, any where!

Do you always find yourself questioning people’s assumptions and are always curious to know ‘Why”? (score out of 10)

This is probably the best part and the most fun part! Here is a quote a read somewhere on Linkedin: Arguing with an Engineer is a lot like wrestling in the mud with a pig: After a few hours, you realize the pig likes it. Similarly, asking why comes naturally to a good data scientist. Some of the best data scientists would stop any one and ask for a rationale, if they are not clear – Why did you ask this question? What was your thought process? Why do you assume so? are just a few examples of these questions!

Key:

5 – You only ask questions when they are critical to be asked

8+ – You can’t stand the anxiety of not understanding something! Jumping to ask questions!

Do you enjoy problem solving and thrive on intellectual challenges? (score out of 10)

Analysts require a knack of problem solving. Most of the problems businesses would face would be unique to them and it would take a smart solver to solve them. Solutions, which work for one Organization may not work for another – you need to be some one who quickly develops deep understanding of a problem and then come out with innovative ways to solve these problems

Key:

3 – You don’t mind thinking about solving problems – but you struggle.

6 – You can solve problems at times

9 / 10 – You just love the process of intellectual thinking

End Notes:

What is my score? I would score somewhere between 80 – 85 on this test. It is your turn now. Do take the test and let me know, how much do you score? Also, do let me know, if you think the test was helpful or otherwise.

Please note that like all subjective questions, there are no right or wrong answers here. You might score low in the test, but still be the best analyst / data scientist out there. However, the test should help most of the people facing the confusion. If you still remain confused after reading this article, please feel free to share your confusion / query through comments below. It will help you clear the confusion and it will help me improve this framework.

Kunal is a post graduate from IIT Bombay in Aerospace Engineering. He has spent more than 10 years in field of Data Science. His work experience ranges from mature markets like UK to a developing market like India. During this period he has lead teams of various sizes and has worked on various tools like SAS, SPSS, Qlikview, R, Python and Matlab.

71 Comments

Hey Bro,
Thanks for a wonderful article and this gave me a chance to introspect myself. Thanks for the great article! All these days I was like a cat sitting on a wall. Through this article I have made my decision stronger to be a Business Analyst armored with analytical tool (SAS) + being a Business Analyst for the last 11+ years across various domains.

Once again thanks for this article and I shall promise by doing a noble cause of sharing this article with all the persons who are still sitting like a CAT on the WALL. By the way, I have got 72 marks!

72 is a good score. The only thing you need in addition to the skills mentioned above is strong motivation! So, if at any point in time, you feel your motivation to learn analytics is going down, do visit http://www.analyticsvidhya.com

I am planning to shift to analytics after 14 years of experience across IT enable/IT/Health care/Engineering industry, I scored 73, though ‘m comfortable with mathematics and statistics, but need calculators and excel to work on problems, but I love solving strategic and number puzzles.
So is doing mind/mental calculation an important criteria for an analytics? Will this be a hindrance in shifting to analytics world?

I too am between and 80-85. I don’t mind working within structures. I find the tradeoff between skepticism and working within the confines of expectations to have a reasonable business purpose. Also, sometimes the monotony of side work is often the break I need to “clear the fog” after long periods of intellectual thinking. Also as an analyst, I tend to only focus on critical issues because there is just not enough time in the day to focus on everything.

78 is a good score. If you are already a data scientist / business analyst – you have a long way to go! If you are aspiring to become one – all you need is to supplement your skills with right efforts and mentorship.

12+10+12+18+6+6=64
I am putting lots of effort to learn every granular thing in the business problems and learning the art of analytics from every possible way.
Kunal I would really like to appreciate for creating such a great framework. You are a real Data scientist who can put real life situation into such innovative and logical framework.

I belive I have reached the right place. I want to ask something regarding mid career switch.

I am working in an international BPO Finance & accounts domain totally I have 8+ years Exp (5.5L CTC per Annum)…..have a great interest in Analytics I am 32 years of age..though I think age is just a number but dont know what recruiters think.

I have done BCom & Master of Foreign Trade, I would like to move to an analytics field.
Planning to join Analytics foundation course with SAS

Could you please advise me will recruiters will consider my profile for entry level Analyics job?

I have spoke to One of Trainer in Analytics Training centre, he said my profile will not match with Industry requirement., Now im in dilema, whether to join or not to join.

I m becoming fan of urs reading ur articles in various forums. I m puzzled while thinking of being a ‘Data Scientist”. Recently I got chance and enrolled in ISB CBA 2015 program. Before the enrollment, I talked with a few persons at home and abroad but no one could answer to my satisfaction. Let me share a brief of my personal profile. I am running 34, working in a Bangladeshi leading bank as senior manager in R&D, having overall experience of almost 12 years. I love number crunching, advance user of EXCEL but limited knowledge about SPSS/STAT. Currently m drawing BDT 18L (INR 14 equivalent) per annum. Now I m really confused about my mid-age career shift/job prospect after investing BDT 12L+ (INR 9.5L+). By the way, I scored 72.

Hi Kunal,
I have 3 years of prior work experience in IT industry and currently I am pursuing my MBA.
I am getting a score of 69 but I am interested in the field of analytics.
However, I am not able to decide whether switching to analytics/data scientist track after an MBA will be right choice? Does data scientist’s work is more dominated by technical work or functional and whether opting for an analytics profile will be right option?
Please advise

My score was 73 – what should I do? I love data, using Excel to its limits with the amount of data I am using, but don’t know SQL/R/SAS. I think Tableau is amazing but yet to use it, however I am pretty sure I can learn fast.

That was an impressing article. This is first time I’m reading your blog, I stumbled upon via Google Alert.

You’ve sliced all the skills pretty intelligently. The only thing I’d like to add is Programming skills. Do you think they need to be part of the skills, to measure for.

I got 73. I love number crunching, business analysis, mathematics, statistics and story telling about data. But my biggest fear is programming. The reason is: I tried learning C++, couple of time, in the past but couldn’t get it. And drew a decision that programming is not my cup of tea. Sometimes I think that might be a wrong decision or may be right. For data science I need to learn at least SQL, R and Python. Which makes me feel bit nervous. Right now I’m on fence of making a decision if I should go for data science career or not. Please help me making the decision. Your views would be highly appreciated.

Answering the questions could perhaps be a bit biased if you already know the interpretation of the score? I have a high motivation to play around with Machine Learning tools, but perhaps not necessarily the right mindset to become a Data scientist with a score of 52… :-s

Contemplating from devops programming back to something more math-ish/analytical. I’m at 70 or perhaps a bit more, but I’m giving myself bonus points for wondering while taking the quiz whether and how you validated it… 😉

Hi! Got an 80, but here’s my problem: (!!)
I got a 5 each on question 1 and 4, and max score on the rest – Essentially I LOVE scrutinizing stuff, can be a PAIN in the way I ask questions to get to the depth of something, love to spend HOURS in figuring out stuff……..but – I’m just not comfortable numerically!!

Sure I can look at numbers and come up with insights, pretty valid ones too, but it takes time and effort and I’m not as intuitive as many freshers I know! So what should I do?

Thanks for this article !! I scored 73(Just crossed the boundary ) .I already have decided to shift my career to analytics. I know the statistical tool like SAS and R (Tested my expertise on article written by Tavish ,scored 16/20 in SAS and R ,didn’t attempted Python ).I have done one project on Kaggle .But still its hard for me to get a interview call . Because without any interview I cant show any one one what I know .I have 2+ yrs of experience in Business Analysis and Business Process .Can you suggest me in how to go ahead .your previous suggestion helped me a lot .

Here is the good news! I think you are inches close to get the break you have been looking for. Just keep your confidence up and continue your learning with Projects on Kaggle and various MOOCs. Keep learning advanced techniques (beyond linear & logistic regressions and decision trees) and aim to get a one time break into Kaggle top 10%.

Thanks for your reply .I am working on one of kaggle project and will try to perform best .I am planning to learn Python which is in demand for almost every analyst job (Python is in more demand than R ).Should I go for Python or any other visualization tool like Tableau . Is there any MOOC to learn Python or Visualization tool .

I am based in Mumbai but looking for job in other city and ready to relocate .I am more interested in working at start-up so looking for such type of opportunity .

Very interesting post! Thank you for your insight regarding the attributes which make a person more or less likely to enjoy the field of data science. I have transitioned from a finance/accounting track within the healthcare industry into data analysis in same. This framework has helped focus my thoughts about what skillsets I need to invest time into strengthening to support my transition. I scored a 75.

Wow! That sounds like a really good score. I would suggest that you take up your first job very carefully. Your employer should ideally have good diversity of people and obsession with how data can be used for smart decisions!

Thanks Kunal, for making this quiz. I’ve been doing a lot of research and am getting started in the field.

20+10+15+20+10+10=85

I’m hoping with my background in electrical engineering and mathematics that I seem like an ideal candidate. I know this is the field for me and your quiz confirmed it. I must admit I sat awhile analyzing the quiz. It’s a habit.
Question is would I need to get another degree in an analytic field such as operation research, management science, or something like that. I love math so I’m wanting to get my master’s in mathematics but if getting it in operation research or management will improve my chances? So can math help me as an analyst/data scientist?

That was an interesting framework. The self assessment gave me an understanding of which areas I am strong and also gave me reassurance that I am on the right track.

I am working as Operations & supply chain consultant at IBM, currently focused on developing the technical foothold required for executing the Business analytics through R and SPSS. I was just wondering what is the depth of understanding that is required and the dependency on other technical languages like python/Hadoop which I usually hear from the guys who are already there, as being a non IT professional I don’t have any base in these
languages.

It entirely depends on what you want to achieve. Independently R / SPSS are capable of handling most of the challenges, you will come across. Hadoop is only required, when you have huge (really huge!) data and Python is just a programming language.

Got 75 from your test.
Currently employed as system analyst in software development company.
Work with the same systems and same problems all over and over again burning me out, I’ve got tired of all this routine and decided to shift career next year to data scientist/BA.

Started searching the web for relevant sources of information and found your blog.
Thank you for it! It’s like to find a stash full of gold!
Your articles is so helpful, especially about skills and tools I need to master to achieve competence in BA/ data science.

sir I have scored 76. I am currently in my final year b.tech from an NIT and I am already been placed at one of the KPOs. Sir i would like to know more about my future prospects as M&A analyst?. that is the profile I have been offered.

My score is 71 and I have done graduation in Mathematics and I have done MCA also. I have 5.2 years exp in operation with Infosys. After that I have 3 years of gap. I have practiced Hadoop framework with Hortonworks. Now I am learning Python and Machine Learning.
Please suggest me, am I going right..??? Need ur suggestion. Its urgent.

That’s nice, Hope you have gained good hands-on experience in Hadoop. Once you will be comfortable with Python and Machine Learning, apply your learning to a few datasets and participate in a few Kaggle competitions for experimenting and gaining hands-on experience.

First of all Thanks to you & your entire team in starting and continuously adding new article to this website. Recently joined a 50hrs session on Business Analytics from EduPristine. From one our faculty get to know about your website and since then I am reading articles published by you & Tavish.

I am working as a Business Analyst in an IT firm with around 10 years of experience. I have worked for some of the ERP & BI projects as Requirement Analyst. Now I have set my mind to shift to Analytics side. And I find the above framework a right tool to judge whether one should shift to Analytics or not. Thanks for creating this framework. I am sure all the new entrants to Analytics like me will find this framework/tool useful and give a true reflection of their interest. I can say its a Psychometric test to know your Interest for Business Analytics.

100 points! – And note that the most important aspects are, enthusiasm about data, asking and identifying questions, solving problems with business value and last but not least communicating results! Totally agree!

Hello.
I got around 60…I have a bachelor degree as engineer so I’m decent with numbers, but does one needs to know and understand all the mathematics behind predictive analytics or just the main principles of how to use and when to use it? The math behind machine learning it could be pretty advanced and not just crunching numbers and curiosity…
So, using R for example, do I just need when to choose linear discriminant analysis over linear regression and how to write this in R and how to interpret it? Or more than that?
I see the advance of technology as exponential and soon enough all this will be done more reliable by a machine instead of a person and just the best of data scientists will be able to continue in the job. The gray area will not exist anymore. What do you think?
Thanks

Hello,,
As for as I know data scientist and business analyst are two different career paths.How can we generalize the above steps to both the fields?I am doing MBA right now and I am confused in choosing my career between these two options.Please help me to choose the right one which suits my nature.I am an INTP personality as per the MBTI test.And also mention which one leads to BI career.

My score is 58 and still an unable to decide what should i opt for .. i am working as a Business analyst from past 4 years.

Key Roles and responsibilities:
Requirement gathering, documentation SRS FRS, bridge between technical team and client, UAT, ..
But now a days as i am looking into the market. Org. demanding technology driven business analyst (pl correct if i am wrong).

Which is more imp Domain Business Analyst OR Technology Business Analyst? If technology Business analyst are good for long run than for which technology i should opt. Like SQL, SAS, Macros, analytics , etc

Please enlighten me what should i do in terms of growth and knowledge.

I got 72 acore. I have done MTech and data mining, text mining was my domain for research. My research work is published by IEEE XPLORE and Springer Scientometrics journal. I am working with MNC as a role of Support with 6 months of experience. Now I have got an opportunity of a role of Analyst analytics from other company. Should I go for it ? I want to be Data Scientist, so is it possoble to get this after some experience in Analyst role?

I got a score of 10+5+10+10+7+5 = 47. I know that s quite a low score compared to the many other scores that were posted, so I am not sure if I am downplaying myself, or this is really who I am.

A little bit background about myself. I hold a Masters Degree in Machine Learning and Data Mining from Finland, and have been working in analytics industry in India for the last 3 years. I find unstructured problems that is ambiguity in business problems difficult to handle, and structured thinking tough, And I dont have great storytelling (telling stories from data and presenting insights) skills. These are the areas where I scored the lowest.

What does this mean ? Where do I stand ? I am pursuing executive MBA from Symbiosis and working in a private firm. I wish to transition my career towards business analytics / data science. Where do I start ?

As mentioned in the article “A good analyst should score more than 70 and any one scoring below 50 should seriously re-consider a decision to be a data-scientist.” Your score is good, so you can probably attempt for a transition in data science.