Not sure if it’s intentional but I’ve noticed there are some ways to anger the security “faction” without getting a bounty - I think it’s when you do something directly to a guard (like intimidation ability) but are sneaking so don’t actually get caught doing it.
Exiting the area and sleeping for 48 UT hours should hopefully make them forget about you.
In Fallout with scrapping sure, but TES? There are a ton of items, like all the kitchenware, that are just for decoration and served no greater purpose.