brain of mat kelcey...
keras.io post on metric learning for image similarity search
June 05, 2020 at 12:00 PM | categories: metric_learning, keras
a keras.io tutorial on using contrastive learning for image similarity.
an illustrative einsum example
May 27, 2020 at 12:00 AM | categories: talk, short_tute
code (and youtube walkthrough) of a port of some numpy code i did recently to einsum that i thought was illustrative.
using cross entropy for metric learning
May 19, 2020 at 06:00 PM | categories: metric_learning, talk
youtube link and slides of a talk i did recently on contrastive learning at the melbourne ml and ai meetup
measuring baseline random performance for an N way classifier
April 11, 2020 at 12:34 PM | categories: short_tute, three_strikes_rule
quick example code of a simple way to gauge baseline random performance.
deriving class_weights from validation data
March 03, 2020 at 06:00 PM | categories: short_tute, three_strikes_rule
quick example code demoing a way to derive class_weights from performance on validation data. this can often speed training up.
initing the biases in a classifer to closer match training data
February 27, 2020 at 12:00 PM | categories: short_tute, three_strikes_rule
some code showing how you can init the bias of classifier to match the base distribution of your training data.
minimal example of running pybullet under google cloud dataflow
January 29, 2020 at 12:00 AM | categories: short_tute
some code that demos how to run pybullet for generating a truck load of synthetic training under google cloud dataflow.
data engineering concerns for machine learning products
September 26, 2019 at 06:00 PM | categories: talk
slides of a talk i did at the melbourne data engineering meetup.
solving cartpole... by evolving the raw bytes of a 1.4KB tflite microcontroller serialised model
September 13, 2019 at 12:00 AM | categories: projects
evolving a controller for cartpole using an evolutionary algorithm that operates directly on the byte level of a serialised tf lite microcontroller model.
brutally short introduction to learning to learn
August 07, 2019 at 12:00 AM | categories: talk
recording of a talk i did on meta learning at yow data
a half baked pix2pix experiment for road trip videos with teaching forcing
June 26, 2019 at 01:00 PM | categories: gan, projects
a half baked attempt to train a pix2pix model on dash cam videos from a roadtrip around the eastern state of the u.s.
pybullet grasping with time contrastive network embeddings
June 11, 2019 at 01:00 PM | categories: projects
an example of using time contrastive networks to learn embeddings for the pose of a kuka arm in a pybullet simulated grasping environment.
natural questions a benchmark for question answering research
February 01, 2019 at 12:00 AM | categories: paper
the last paper i was involved in at google has been released! congrats to tom and the team.
counting bees on a rasp pi with a conv net
May 17, 2018 at 12:30 PM | categories: projects
training a fully convolutional unet to count bees from a raspberry pi stuck to the side of a hive.
fully convolutional networks
April 06, 2018 at 06:00 PM | categories: short_tute
a short walkthrough explainer on fully convolutional networks.
using simulation and domain adaptation to improve efficiency of deep robotic grasping
September 22, 2017 at 12:00 AM | categories: paper
a paper i helped with at google robotics has been released! congrats to konstantinos and the team!
deep reinforcement learning for robotics
September 21, 2017 at 07:12 PM | categories: talk
a recording of a talk i did at the melbourne ml ai meetup.
simple tensorboard visualisation for gradient norms
June 27, 2017 at 09:45 PM | categories: Uncategorized
some cook book examples of gradient norm visualisation in tensorboard.
after 2,350 days in america we are moving home...
June 14, 2017 at 10:00 PM | categories: Uncategorized
i'm leaving google brain and we're moving back to australia.
« Previous Page -- Next Page »
popular posts...
FPGA wavenets : eurorack audio processing neural nets running at ~200,000 inferences/sec (oct 2023)
dithernet very slow movie player : a GAN that slowly plays a movie over a year on an eink screen (oct 2020)
evolved channel selection : neural networks robust to any subset of input channels, at any resolution (mar 2021)
ensemble nets : training ensembles as a single model using jax on a tpu pod slice (sept 2020)
bnn : counting bees with a rasp pi (may 2018)
drivebot : learning to do laps with reinforcement learning and neural nets (feb 2016)
wikipedia philosophy : do all first links on wikipedia lead to philosophy? (aug 2011)
some papers from my time at google research / brain...
- Natural Questions: a Benchmark for Question Answering Research
- Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping
- WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia
my honours thesis
the co-evolution of cooperative behaviour (1997) evolving neural nets with genetic algorithms for communication problems.
old projects...
- latent semantic analysis via the singular value decomposition (for dummies)
- semi supervised naive bayes
- statistical synonyms
- round the world tweets
- decomposing social graphs on twitter
- do it yourself statistically improbable phrases
- should i burn it?
- the median of a trillion numbers
- deduping with resemblance metrics
- simple supervised learning / should i read it?
- audioscrobbler experiments
- chaoscope experiment