Unfortunately not. Roughness or excessive vibration in a bearing indicates wear. Removing old or dirty lubricant, will help to an extent but the bearing will have worn balls and raceways by now so the problem will not have gone away. The bearing may feel smoother with fresh grease but this will be temporary.
Once a bearing starts to wear, minute steel particles are being generated inside the bearing whenever it rotates. The steel surfaces of the raceways (grooves) and the balls in your rough bearing will be flaking already. Vibration will increase exponentially and this will lead to rapid failure. The best thing to do is replace the bearing as total bearing failure may damage other components in a machine.