Intro to Angular, Web API and Azure

Hello World,

So I thought it would be beneficial to discuss Angular, Web API and Azure in some form of depth as well as provide an entire set of functioning code.  I will start by addressing a few things, What is Angular, What is Web API, and what is Azure?  Followed by the code and explanation of the code.  The code itself provides a simple website, which has restful routing, requests for processing and lists out data from a database acquired from said processing.

Continue reading

So you want to be an Analytics Developer

Hello World!

I get a series of questions all the time.

  1. How do I switch careers to be a developer?
  2. How do I become a data scientist?
  3. How do I add intelligence to my code?
  4. How do I get a job in distributed computing?
  5. How do I code more analytically?

The answer to these questions are pretty much all the same.  Step 1, learn about it and build one piece of software focused on that goal.  Step 2, go for it, just do it.  So that said, Microsoft has a fantastic resource, Microsoft Virtual Academy, which provides free training around various topics from entry level to advanced.  This article focuses on a learning plan with MVA to attain the goal of becoming an Analytics Developer.

Continue reading

Mocking IoT Telemetry Data with Azure

Hello World!

This should prove to be an interesting series of posts coming up, as I am working on a new project that is very unique and interesting. The idea is to use incoming data from Arduinos, Raspberry Pis, Gallileos, Edisons and other assortments of IoT type devices connected to oil and gas pipelines to determine if a leak is currently in progress and also predict if a leak is likely to occur in the future based on current and trending conditions.

My part in the project is all back end analytics, and I have very little to do with the actual telemetry and hardware. The telemetry will be posted using Azure Event Hubs, and thus my portion of the project begins with mocking that real time data at a large enough geo dispersed scale that I can develop a system that can handle it, and then switch my configurations to consume from the production event hubs. Since I am no longer a consultant working on projects with trade secrets and everything these days is about the elevation of skills in the community, I have posted everything on github that you can download and peruse at your leisure. Please note that this is in progress and well the github source may not necessarily work when you look. I’ll try to enforce a standard to comment “working – comment” on pushes to the repository. The git repository is located here: https://github.com/drcrook1/OilGas

Continue reading

Adopting F#

Hello World!

You can see from my blog that I have been increasing my adoption of F# and my love of the language is growing.  I find the language very conducive to cloud computing.  F# at its core seems to be built for distributed computing.  If you program with F# in an idiomatic way, you are setting yourself up for success on the cloud, as the cloud is a variably sized distributed system that you are deploying production code to.  That is what F# excels at.

As much as I have loved F#, it has not been all roses and sunshine.  There have been issues.  This article at its core is really an ask from the community to support me in building the case and evangelizing F# in such a way it can be recognized and adopted not only by the community, but by those who make the decisions to expend resources on additional tooling and support.  I must iterate that the contents of this article are in no way the opinion of Microsoft, but merely my own observations.  From these observations I have developed a strategy and action items that we the F# community must do to achieve these goals.

First, we must step outside of our normal mindset as F# developers and begin looking at the language from the outside perspective.  We must also look at some trends.

Continue reading

Two Track Coding (ROP) For Dummies – Part 2

Hello World!

Welcome to Part 2!  Hopefully you made it through part 1 with no issues.  In this part, I will discuss Applicatives, in this scenario, we are doing validation of an entire type, however you can use this method for any sort of processing in the system that returns a result or failure and takes n parameters.

Part 1: Bind
Part 2: Applicatives
Part 3: Options

Continue reading

Manage Azure Blobs with F#

Hello World!

So you are going to notice a slight shift in this blog to start incorporating not only video game development, but hardcore data analytics.  As part of that shift, I am going to start incorporating F# into my standard set of languages as it is the language of hardcore data analytics if you roll with the .NET stack.

This particular article is about building a console based blob manager in F# instead of C#.  The very first thing I noticed about using F# to manage my blobs as opposed to C# is just the sheer reduction in lines of code.  The code presented here is a port of the C# article located here.  This code will eventually make its way into a production system which is part of a big data solution I am building.  New data sets that we acquire will be uploaded into blob storage, an entry stored into a queue, with a link to the data set.  Once a job is prepared to run, the data will be moved to Hadoop to do the processing and then stored in its final location.  So step 1 is…Store data in Blob storage.

Continue reading

AthleTECH – DATA ANALYTICS CHALLENGE!

Do you love sports?  Do you love data analytics?  Are you a STUDENT or a PROFESSIONAL?  This is a call for student teams and mentors to participate in the AthleTECH challenge!  Teams consist of 1-4 students and potentially a professional mentor.

 

Continue reading