### Godot version

4.1 beta1

### System information

Windows 10.0.19045 - Vulkan (Forward+) - dedicated NVIDIA GeForce GTX 1060 (NVIDIA; 30.0.15.1403) - Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz (8 Threads)

### Issue description

When I change tile source, the view is initialized at a wrong position. After scrolling it for the first time, the position gets re-adjusted.

https://github.com/godotengine/godot/assets/2223172/830cef4a-10f0-4fa5-9172-e7f8015330eb

It wasn't happening before.

### Steps to reproduce

1. Create a TileMap with TileSet
2. Add a sufficiently big tile atlas source
3. Add another source, so that you can switch between the 2
4. Switch to the other source and then to the big one
5. Scroll

### Minimal reproduction project

The texture from the video: https://github.com/godotengine/godot/assets/2223172/7ac78271-84d0-48ab-ae28-45841e2e0880
Control::move_child_notify(p_child);
	if (!Object::cast_to<Control>(p_child)) {
		return;
	}
	update_minimum_size();
	queue_sort();
}
void Container::remove_child_notify(Node *p_child) {
	Control::remove_child_notify(p_child);
	Control *control = Object::cast_to<Control>(p_child);
	if (!control) {
		return;
	}
	control->disconnect("size_flags_changed", callable_mp(this, &Container::queue_sort));
	control->disconnect("minimum_size_changed", callable_mp(this, &Container::_child_minsize_changed));
	control->disconnect("visibility_changed", callable_mp(this, &Container::_child_minsize_changed));
	update_minimum_size();
	queue_sort();
}
void Container::_sort_children() {
	if (!is_inside_tree()) {
		return;
	}
	notification(NOTIFICATION_PRE_SORT_CHILDREN);
	emit_signal(SceneStringNames::get_singleton()->pre_sort_children);
	notification(NOTIFICATION_SORT_CHILDREN);
	emit_signal(SceneStringNames::get_singleton()->sort_children);
	pending_sort = false;
}
void Container::fit_child_in_rect(Control *p_child, const Rect2 &p_rect) {