Complex Neural Network Data Modelling with CNTK

dl_robo_arm

Hello World,

This article is kinda exciting for me; because once you can internalize how this works, the world really becomes your oyster as far as what you can model with what kind of data.  In this example we are going to take some sample images and some random vector features and merge them together.  In a more realistic example you may take something like an image as well as some contextual tabular data and want to merge those two data sets together into a single prediction.

Continue reading

Prepping Label Files for ML Training on Specific Machine

AzureDC

Hello World!

So you likely will run into this at some point.  You are reading data from somewhere and it is relative path based; but that doesn’t necessarily always help load data in especially if you are storing data and your code in separate paths (which is common) or if you are sharing data with a team; or even if your data is just somewhere totally different.

Anyways; this article will help convert a .csv label file with actual named labels to a label file with full path with a numerical label that can be more easily one hot encoded during the reading process.  Note for deep learning often this is a two step process.  Step 1: Convert from relative pathing to specific pathing & numerical labels.  Step 2: Convert to framework specific storage format for input reading pipeline (which varies framework to framework).  Here we cover Step 1.  We will be using the CIFAR 10 data set which can be downloaded from here: https://www.kaggle.com/c/cifar-10/data

Continue reading

High Performance, Big Data, Deep Learning at Scale

containership

Hello World!

I’m not sure the title really nailed it well enough, but we are going to talk about solving VERY big problems as fast as we possibly can using highly sophisticated techniques.  This blog article is really a high level overview of what you want to set up as opposed necessarily to the usual how to set it up.  There are a ton of steps to the actual how to; I thought it best to just provide an overview in this article to what you want to do instead of how to do it.

Continue reading

Microsoft Cognitive Toolkit + VS Code = Awesome

CNTKIntellisense

Hello World!

In this article I’m going to go through how to set up CNTK with Visual Studio Code and take advantage of those PASCAL GPUs I know everybody has these days.  I will also do a breif overview of what CNTK and Visual Studio Code are and why they are so incredible for machine learning scientists.

CNTKIntellisense

Continue reading