Just to note, the categories I want to use are nested under a parent category if that happens to make a difference website.com/category/sub-category/post name
I’m officially a moron. I found it. In case anyone else is having a brain fart too, it’s under Posts > Taxonomy (change to category) > select the category below that.