Aparently so. I discovered that Amazon is now carrying tens of thousands of non-perishable items in their Grocery section.
I immediately searched on my favorite energy bars (Balance), and found that they sell the 15-bar boxes for $15.35. This isn't the best price I've every found, but it beats the non-sale price at my local grocer (better selection, too).
I also looked for the new Kashi cereal I've been eating, and while the price is reasonable, it only comes in cases containing 6 boxes. So, it might be more like shopping at Costco than Safeway.
All items in the Grocery Store qualify for Super Saver Shipping, as well as Amazon Prime.