Graph Deep Learning techniques on large graphs

Sometimes we encounter large graphs that force us beyond the available memory of our GPU or CPU. In these cases, we can utilize graph sampling techniques. PyTorch Geometric is a graph deep learning library that allows us to easily implement many graph neural network architectures with ease. The library contains many standard graph deep learning datasets like Cora, Citeseer, and Pubmed. But recently there’s been a push in graph open datasets to use large scale networks like the Open Graph Benchmark (OGB) [3]. In OGB, the various datasets range from ‘small’ networks like ogbn-arxiv (169,343 nodes) all the way up…


I recently read a paper by Sharif et al. that describes a general framework for adversarial example generation and they utilize eyeglass frames affixed to people’s faces to trick a facial recognition classifier. In addition, this method also worked when printing out the eyeglass frames and using them in a physical adversarial attack.

I decided to build a GitHub repository to implement this method using PyTorch. I also added some additional bells and whistles for inference (like trying the glasses out automatically on your webcam).

I will speak a bit about the method and how I implemented it.

Goal

to generate…


My goal is to outline a lesson that any teacher can use in the classroom or any person interested in a very high level understanding of how AI works can walk through. This is not meant to be an exact representation of how AI truly works, but simply give intuition as to how it works. I have been a Math, SAT, ACT, ISEE tutor for close to a decade and work in machine learning research.

Pre-requisites: know what a probability is.

There are 2 sub-lessons, 1 smaller one and 1 larger one. …


My goal here is to create an easily adaptable framework to generate faces that look realistic, but also trick a facial recognition classifier. The example we will work through is the task of generating realistic faces that always classify as your face — despite them not being your face (or anyone’s face for that matter).

This is actually a tricky task because it involves updating the generator in two ways.

  1. Update the generator to make realistic images
  2. Update the generator adversarially to classify as your face

As you might expect, this will require two loss functions to update simultaneously. And…


Tricking facial recognition systems using adversarial attacks with GANs.

This is part of a series I am writing on tricking facial recognition systems using adversarial attacks with GANs.

However, before we trick a facial recognition classifier we need to build one to trick. I personally want to build one that can recognize my own face. Instead of training a neural network from scratch I can start with a pre-trained network and then finetune it to recognize my face. Finetuning is greatly beneficial as we can start with the model weights already trained on a large-scale face database and then update some of them to reflect the new tasks we…


The goal of this post is to lay out a framework that could get you up and running with deep learning predictions on any dataframe using PyTorch and Pandas. By any dataframe I mean any combination of: categorical features, continuous features, datetime features, regression, binary classification, or multi-classification.

I may touch upon some of the technical aspects of what is going on behind the scenes, but mostly this is meant to be a framework discussion rather than a technical discussion. If you want to dig in further I suggest fast.ai courses in deep learning — and if you simply want…


This is a continuation of a previous post where I do a full walkthrough of how to build an autonomous truck simulator using fast.ai, but ultimately these methods can work on any case where you need to finetune pretrained models or develop models that predict bounding boxes and classes together.

Now my goal is to walk through some of the more technical aspects of the training and inference processes and explain the details of how they are implemented in PyTorch. You can also reference the codebase in this Github repo.

Recall from the last post that there are two neural…


For some reason I had an inkling to go back to HMMs recently and here was the result. I started with this article from Nature by Sean R Eddy on biological sequence analysis and gene identification. Note: I am not a biologist and do not have any strong understanding of gene sequencing so it may (most certainly will) happen that I use the wrong terminology.

Here is an image from the article that lays out the general plan we will try to replicate.

The key here will be to try and identify when a 5' splice comes up as indicated…


Hopefully this can be useful to anyone looking to host a Flask app on AWS with Docker, but more specifically this will deal with many of the hurdles involved with putting this app into production while analyzing Google Analytics API data, visualizing with Plotly Dash, and version controlled with Amazon Elastic Container Registry (ECR).

Here’s the general form of the visualization that will be built here for any given day in some date range. This will connect directly to your Google Analytics account and a slider bar can be dragged to change the visualization from day to day.

Start with…


I want to give a big thanks to the fast.ai team for not only open-sourcing a fantastic library for deep learning but also providing the resources to learn it. I also want to thank pythonprogramming.net for providing big insights into a lot of the different methods for screen display and manipulation using opencv and PIL.

I have been watching the fast.ai lessons for the past several weeks and wanted to test some of the methods out on a personal project. I thought an autonomous vehicle project would be especially intriguing and seemed to fit well with the methods we have…

Mike Chaykowsky

RAND Researcher. Based out of Los Angeles. @ChaykowskyMike linkedin.com/in/chaykowsky

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store