Becoming a Functional Data Scientist

Hello World,

So today, I was asked to put some thought into what we should focus our entry level data scientists on in terms of tech skills.  After I put a bunch of thought into it, I ended up coming up with this.  I decided that the most important aspect of this was a few items fold

  1. Don’t overload them
  2. Can deliver to production where the target can be anything, including IoT.
  3. They will not be concerned with building front ends.

I have to say, the result greatly surprised me.

Here is a great set of materials that set a great foundation.

https://drcdata.blob.core.windows.net/presentations/CISW%20-%20Foundations%20and%20Focus.zip

 

I would also recommend folks do the following:

  1. Python on Data Camp
  2. Tutorial: http://dacrook.com/setting-up-python-and-virtual-environments-in-visual-studio-code-on-ubuntu/
  3. Read: http://dacrook.com/categories-of-analytics/

 

If you want to do Machine Learning, this is a must

https://www.coursera.org/learn/machine-learning/

 

Functional Data Scientist

Can deliver projects where data science is the core and integrate into anything.

  1. Languages
    1. Python
    2. C++
  2. Core Libraries to be familiar with
    1. Flask (or Django)
    2. Anaconda
    3. Tensor Flow
    4. Plot.ly
  3. Core Platform Technology Familiarities…
    1. Ubuntu
    2. Azure Machine Learning
    3. Azure Blob Storage & Azure Storage Explorer
    4. Azure Data Factory

 

Reasons for everything.

  1. Python -> Easiest hitter across all server side technologies and integration into Tensor Flow and soon CNTK as well.  Loads of documentation and community support.  You can deploy your intelligence in Micro-Service architectures allowing for easiest and lightest touch integration into customer projects.
  2. C++ -> Any model can be built in python and exported to C++ for delivery on any platform in any language with any hardware.  As there are native calls from .Net and Java for this, it’s perfect.  This enables high performance requirements on top of dealing with any platform.  Xamarin can even consume this.
  3. Flask or Django -> I don’t know much about these, I’ve been delivering via Asp.Net.  Basically it’s the Python version of it.  I chose this to reduce needing to learn .Net, though .net would be prefferable.
  4. Anaconda -> Basically this contains all the typical Python Data Science Libraries, numpy, pandas, scikitlearn etc etc.
  5. TensorFlow -> Need a backup when you can’t use Azure ML.  This could be due to data size limits, complexity of training, data security etc.  The models can be trained on prem with this and then delivered into Azure.
  6. Plotly -> Great Python plotting library for interactive charts and plots.
  7. Ubuntu -> Tensor Flow requires this.  Also has cron jobs and lots of good server side stuff.  NVidia embedded runs on this as well.  It’s all about checking as many boxes with as little extra needed knowledge as possible.  Code can also be deployed to Windows Boxes.
  8. Azure Machine Learning -> Still the best and fastest time to market machine learning tool out there.
  9. Blob Storage and Storage Explorer -> This is home base.  Upload Data, Share Data Securely, munge tons of data, reliable, cheap.  Its awesome.
  10. Azure Data Factory -> Really need to understand data pipelining and engineering.

 

Bonus:

  1. Understanding of web security.  SSL and OAuth

Leave a Reply

Your email address will not be published. Required fields are marked *