Weekly Journal: Week 3, 2019

Last week was fun in a brain-melting kind of way…

Data Science and Neural Networks

I found some great reading on using PyTorch to build neural network classifiers and also a bunch of great writing on using Word2Vec – the problem I was trying to solve was how best to design the inputs and outputs of a NN classifier. There are so many potential data-points that could be used to influence classification, where to start?

I ended up choosing a simple, yet not-quite-so-naive approach of using TF-IDF to build up a vector that can represent word-embedding after normalising the text-vocabulary with SpaCy. Then we pass in product information to get a predicted product classification (category-confidence vector) …it took a lot of ruminating and reading to get to this conclusion. This week I aim to write the data transformer to build the training set from the data available.

I spent a lot of time last week tuning my fuzzy-match engine as well. As I mentioned last week, an article is in progress. This week I have made the code multi-processor so at this point it is ready for a write up…


I finished reading the Wolfenstein 3D Black Book. This book is basically a code-review of one of the most influential games in history. It was riveting. I could not put it down and basically finished it in a week. Loved every second. There is something really compelling about discovering how a true genius of our time (John Carmack) thinks and solved his programming problems. This is the same reason I used to love disassembling demos and games as a kid to understand how visual effects were made.


Just sharing one of my goals this year is “Fitness every day with a focus on diet”…I will share more goals as it makes sense to. Friday was a 14 hour day at work and the first day I missed doing exercise. I missed not doing exercise after three weeks of sticking to this goal. Got back in the saddle on Saturday and Sunday…


Level 25, 88 Phillip Street
NSW 2000

+61 2 8024 5975
[email protected]

©2003-2019 Pixolut Pty Ltd trading as Thinking.Studio
All Rights Reserved