brain of mat kelcey


the map interpretation of attention

August 19, 2020 at 10:30 AM | categories: talk, three_strikes_rule

based on my three strikes rule i wrote a talk on the map interpretation of neural attention.it starts with the first NLP problem i saw where attention was used, goes through the way i think about attention in...

measuring baseline random performance for an N way classifier

April 11, 2020 at 12:34 PM | categories: three_strikes_rule

this post is part of my three-strikes-rule series; the third time someone asks me about something, i have to write it up>>> import numpy as np>>> from sklearn.metrics import *consider an 5 way classifier with varying level of...

deriving class_weights from validation data

March 03, 2020 at 06:00 PM | categories: three_strikes_rule

this post is part of my three-strikes-rule series; the third time someone asks me about something, i have to write it upwhen training a model we often want to weight instances differently to reflect either ...

initing the biases in a classifer to closer match training data

February 27, 2020 at 12:00 PM | categories: three_strikes_rule

this post is part of my three-strikes-rule series; the third time someone asks me about something, i have to write it upif we start with a simple model and run some data through it before it's trained ...

popular posts...

bnn : counting bees with a rasp pi


drivebot : learning to do laps with reinforcement learning and neural nets


wikipedia philosophy : do all first links on wikipedia lead to philosophy?


cartpole++ : deep RL hacking with a complex 3d cart pole environment


malmomo : deep RL hacking on minecraft with malmo


some papers from my time at google research / brain...

my honours thesis

the co-evolution of cooperative behaviour (1997) evolving neural nets with genetic algorithms for communication problems.

old projects...