payload: {"action":"closed","issue":{"url":"https://api.github.com/repos/knative/serving/issues/3877","repository_url":"https://api.github.com/repos/knative/serving","labels_url":"https://api.github.com/repos/knative/serving/issues/3877/labels{/name}","comments_url":"https://api.github.com/repos/knative/serving/issues/3877/comments","events_url":"https://api.github.com/repos/knative/serving/issues/3877/events","html_url":"https://github.com/knative/serving/issues/3877","id":436418180,"node_id":"MDU6SXNzdWU0MzY0MTgxODA=","number":3877,"title":"Separate Runtime and API Conformance tests","user":{"login":"dgerd","id":43425586,"node_id":"MDQ6VXNlcjQzNDI1NTg2","avatar_url":"https://avatars0.githubusercontent.com/u/43425586?v=4","gravatar_id":"","url":"https://api.github.com/users/dgerd","html_url":"https://github.com/dgerd","followers_url":"https://api.github.com/users/dgerd/followers","following_url":"https://api.github.com/users/dgerd/following{/other_user}","gists_url":"https://api.github.com/users/dgerd/gists{/gist_id}","starred_url":"https://api.github.com/users/dgerd/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dgerd/subscriptions","organizations_url":"https://api.github.com/users/dgerd/orgs","repos_url":"https://api.github.com/users/dgerd/repos","events_url":"https://api.github.com/users/dgerd/events{/privacy}","received_events_url":"https://api.github.com/users/dgerd/received_events","type":"User","site_admin":false},"labels":[{"id":816839988,"node_id":"MDU6TGFiZWw4MTY4Mzk5ODg=","url":"https://api.github.com/repos/knative/serving/labels/kind/feature","name":"kind/feature","color":"1d76db","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/knative/serving/milestones/23","html_url":"https://github.com/knative/serving/milestone/23","labels_url":"https://api.github.com/repos/knative/serving/milestones/23/labels","id":4264538,"node_id":"MDk6TWlsZXN0b25lNDI2NDUzOA==","number":23,"title":"Serving 0.7","description":"","creator":{"login":"mattmoor","id":2442466,"node_id":"MDQ6VXNlcjI0NDI0NjY=","avatar_url":"https://avatars3.githubusercontent.com/u/2442466?v=4","gravatar_id":"","url":"https://api.github.com/users/mattmoor","html_url":"https://github.com/mattmoor","followers_url":"https://api.github.com/users/mattmoor/followers","following_url":"https://api.github.com/users/mattmoor/following{/other_user}","gists_url":"https://api.github.com/users/mattmoor/gists{/gist_id}","starred_url":"https://api.github.com/users/mattmoor/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mattmoor/subscriptions","organizations_url":"https://api.github.com/users/mattmoor/orgs","repos_url":"https://api.github.com/users/mattmoor/repos","events_url":"https://api.github.com/users/mattmoor/events{/privacy}","received_events_url":"https://api.github.com/users/mattmoor/received_events","type":"User","site_admin":false},"open_issues":27,"closed_issues":17,"state":"open","created_at":"2019-04-26T20:22:26Z","updated_at":"2019-06-03T19:40:34Z","due_on":"2019-06-25T07:00:00Z","closed_at":null},"comments":1,"created_at":"2019-04-23T22:32:54Z","updated_at":"2019-06-03T19:40:34Z","closed_at":"2019-06-03T19:40:34Z","author_association":"CONTRIBUTOR","body":"\r\n## In what area(s)?\r\n\r\n<!-- Remove the '> ' to select -->\r\n\r\n /area API\r\n> /area autoscale\r\n> /area build\r\n> /area monitoring\r\n> /area networking\r\n /area test-and-release\r\n\r\n<!--\r\nOther classifications:\r\n> /kind good-first-issue\r\n> /kind process\r\n /kind spec\r\n /kind proposal\r\n-->\r\n\r\n## Describe the feature\r\n\r\nThe conformance tests for Serving currently all live in `test/conformance`. There are really two classes of tests in here that would be good to separate for readability and organization:\r\n\r\n1.) API Tests - These tests run through user workflows of Knative objects using just the Knative API and an HTTP client. They validate that status changes transition correctly based on updating spec for core Knative objects (Revision, Configuration, and Service).\r\n2.) Runtime Tests - These tests use particular container image(s) to probe at the runtime environment of the container and format them into an HTTP response. The test then validates that the HTTP response against the runtime contract specification.\r\n\r\nAs part of this there is likely some shared logic between tests that should be refactored out to `knative/serving/test` or `pkg/test` so that it is easy to move tests between `e2e`, `conformance/runtime` and `conformance/api`. This will allow us to bias towards writing tests in `e2e` and promote to `conformance` as we evolve the specification."}}
other: {"actor":{"display_login":"knative-prow-robot"}}