AI for Earth Camera Trap Stuff
We’ll talk about...
- Our repo
- Detectors and why they’re awesome
- From models to workflow
- How classifiers fit in to our universe
- We’re all only as good as our training data...
Our repo
All our stuff is available on GitHub. If you remember one thing from this presentation, make it this link:
github.com/agentmorris/MegaDetector
Oh, and this:
Detectors and why they’re awesome
What’s a detector?
A classifier tells you what an image is:
This image is warthog.
– A classifier
A detector tells you where in the image something is:
There’s a thing here.
– A detector
Detectors can also identify things:
There’s a warthog here.
– A multi-class detector
Even though we don’t care about where in an image animals occur, and we do care about species classification, we want to convince you that it’s useful and important to build a “generic” detector for camera traps.
Benefits of generic detectors
Why bother with detectors?
- Natural way to get rid of non-animal images
- Get value from lots of data, even in new ecosystems
- Make classification a lot easier:
Classifying an animal vs. classifying an animal and lots of background goop - Naturally handle classifying multiple species in an image
- Naturally handle training data that’s labeled at the sequence level, and is unreliable at the image level
- Natural way to get rid of non-animal images (so important we’re saying it twice)
- Natural way to get rid of non-animal images (and a third time, now in bold)
- Natural path to counting (sort of)
Our detector... aka “MegaDetector”, pronounced “MegaDetectooooooor”
- Available (code and model) on our GitHub page
- Trained on several hundred thousand bounding boxes from a variety of ecosystems
- Mostly about animals, but we recently added a “beta” people class, about to improve this and add a “vehicle” class
Workflow
- Batch API
- Results on real data!
Live demo, post-hoc viewers will have to settle for a teaser image... - Timelapse integration
Live demo, post-hoc viewers will have to settle for a teaser image... - Other ways to run our detector(s)...
- Handy scripts on our GitHub repo
- Download our model and run it however you like (email us or buy us fancy coffee please)
Image credit RSPB, Timelapse credit Saul Greenberg
How classifiers fit in to our universe
We train per-project (i.e., per-ecosystem) classifiers on images that have been cropped by our (generic) detector. We use this two-stage approach instead of a whole-image classifier or a multi-class detector.
I.e., sadly, we believe we’ll never be able to build a “MegaClassifier”.
Fun demo of some classifiers we’ve released publicly(ish)? Yes please!
Live demo, post-hoc viewers will have to settle for a teaser image...
Data
We’ve worked with lots of our camera trap friends to make lots of labeled images available at:
Go play with data, and send us new data sets!