No worries. Shavings are from cam/lifters that's being fixed. As stated above, the oil filter will catch the debris or it will leave the pan during oil change. Put a magnet on the filter or pan if you're worried. Do a couple of quick oil/filter changes maybe to settle your mind. You should have seen all the shavings in the early oil changes after you bought it, it was hardly pristine, they never are
I would have no worries. I've had cams/lifters fail over the years, never thought about trashing a block over it