payload: {"action":"closed","issue":{"url":"https://api.github.com/repos/cloudendpoints/esp/issues/636","repository_url":"https://api.github.com/repos/cloudendpoints/esp","labels_url":"https://api.github.com/repos/cloudendpoints/esp/issues/636/labels{/name}","comments_url":"https://api.github.com/repos/cloudendpoints/esp/issues/636/comments","events_url":"https://api.github.com/repos/cloudendpoints/esp/issues/636/events","html_url":"https://github.com/cloudendpoints/esp/issues/636","id":459431009,"node_id":"MDU6SXNzdWU0NTk0MzEwMDk=","number":636,"title":"[DNS] nginx does not re-resolve upstream server destination","user":{"login":"xavier-re","id":26717216,"node_id":"MDQ6VXNlcjI2NzE3MjE2","avatar_url":"https://avatars3.githubusercontent.com/u/26717216?v=4","gravatar_id":"","url":"https://api.github.com/users/xavier-re","html_url":"https://github.com/xavier-re","followers_url":"https://api.github.com/users/xavier-re/followers","following_url":"https://api.github.com/users/xavier-re/following{/other_user}","gists_url":"https://api.github.com/users/xavier-re/gists{/gist_id}","starred_url":"https://api.github.com/users/xavier-re/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/xavier-re/subscriptions","organizations_url":"https://api.github.com/users/xavier-re/orgs","repos_url":"https://api.github.com/users/xavier-re/repos","events_url":"https://api.github.com/users/xavier-re/events{/privacy}","received_events_url":"https://api.github.com/users/xavier-re/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2019-06-22T03:50:26Z","updated_at":"2019-07-16T22:17:53Z","closed_at":"2019-07-16T22:17:53Z","author_association":"NONE","body":"Hello,\r\nI run google cloud end point/ESP on debian stable (stretch) \r\nii  google-cloud-sdk                251.0.0-0                      all          Utilities for the Google Cloud Platform\r\nii  endpoints-runtime               1.35.0                         amd64        Google Cloud Endpoints Runtime  .  .  A Google Cloud\r\n\r\nWe have the following setup \r\ninternet -> ALB1 -> ESP running on ec2 -> ALB2 -> backend api\r\n\r\nwhen we change the ALB2, ips changes and the ESP cant connect anymore\r\nit says\r\n2019/06/21 14:33:26 [error] 20449#20449: *39048 upstream timed out (110: Connection timed out) while connecting to upstream\r\nI can verify with tcpdump that the ESP connect to the old ip and doesnt re-resolve the domain name. It then fails to answer request, and it's not unhealthy either, since /healthz is answering correctly.\r\nI tried using the valid=30s parameter to the resolver option (which doesnt look like it is applied anyway), no dice.\r\nOtoh I see tons of re-resolve for servicecontrol.googleapis.com and other google urls.\r\nattached are the config file, \r\ndo you have any advice ?\r\nIs it fixable ?\r\n\r\n[nginx.conf.txt](https://github.com/cloudendpoints/esp/files/3316496/nginx.conf.txt)\r\n[endpoints-nginx.conf.txt](https://github.com/cloudendpoints/esp/files/3316497/endpoints-nginx.conf.txt)\r\n\r\n[server_config.pb.txt](https://github.com/cloudendpoints/esp/files/3316495/server_config.pb.txt)\r\n\r\n\r\n\r\nthanks."}}
other: {"actor":{"display_login":"qiwzhang"}}