If you are recycling properly, the only thing you should be throwing away are biodegradables like paper and food.

Since this won’t amount to much, you can use a paper shopping bag, instead if an evil plastic one.