I wouldn't worry about the plastic too much, but you could likely grind it out so it is more level and round it off so it blends in. I would worry about the paint, as it will lead to rust if left untreated since you are down to bare metal.
Curious how this happened? Thx