A vision system for a vehicle includes a camera having a field of view exterior of the vehicle and being operable to capture image data. An angular filter is disposed at least partially in the field of view of the camera. The angular filter limits reflection of light through an angular range that corresponds to stray light that would otherwise impinge the lens of the camera. A control includes an image processor operable to process image data captured by the camera. Responsive at least in part to processing at the image processor of image data captured by the camera, the control controls a driver assistance system of the vehicle.