### Godot version

v4.1.1.stable.official [bd6af8e0e]

### System information

Godot v4.1.1.stable - Debian GNU/Linux trixie/sid trixie - Vulkan (Forward+) - dedicated NVIDIA GeForce GTX 1060 (nvidia) - Intel(R) Core(TM) i5-8400 CPU @ 2.80GHz (6 Threads)

### Issue description

`Area2D`s which extend beyond the bounds of the root viewport, eg. when using a `canvas_items` stretch mode, receive mouse input events even in the black bands letterboxing the game:

https://github.com/godotengine/godot/assets/441188/3beb962f-c1fa-4098-a375-f3d862013577


### Steps to reproduce

1. Set project stretch mode to either `canvas_items` or `viewport`
2. Have an `Area2D` whose `CollisionShape` extends beyond the bounds of the rendered region
3. Connect the `Area2D`'s `mouse_[entered|exited]` signal to something
4. Wave the mouse around in the black areas outside the rendered game

### Minimal reproduction project

Project used for video demo above:

[area2d-oob.zip](https://github.com/godotengine/godot/files/12207031/area2d-oob.zip)

This only demos `mouse_[entered|exited]`, but I first encountered this with the `Area2D.input_event` signal, where it received mouse clicks as well.
#ifndef _3D_DISABLED
	if (!use_xr) {
#endif
		if (p_allocated) {
			RS::get_singleton()->viewport_set_size(viewport, size.width, size.height);
		} else {
			RS::get_singleton()->viewport_set_size(viewport, 0, 0);
		}
#ifndef _3D_DISABLED
	} 
#endif
	_update_global_transform();
	update_configuration_warnings();
	update_canvas_items();
	for (ViewportTexture *E : viewport_textures) {
		E->emit_changed();
	}
	emit_signal(SNAME("size_changed"));
	Rect2i limit = get_visible_rect();
	for (int i = 0; i < gui.sub_windows.size(); ++i) {
		Window *sw = gui.sub_windows[i].window;
		Rect2i rect = Rect2i(sw->position, sw->size);
		Rect2i new_rect = sw->fit_rect_in_parent(rect, limit);
		if (new_rect != rect) {
			sw->set_position(new_rect.position);
			sw->set_size(new_rect.size);
		}
	}
}
Size2i Viewport::_get_size() const {