payload: {"action":"opened","issue":{"url":"https://api.github.com/repos/hill-a/stable-baselines/issues/645","repository_url":"https://api.github.com/repos/hill-a/stable-baselines","labels_url":"https://api.github.com/repos/hill-a/stable-baselines/issues/645/labels{/name}","comments_url":"https://api.github.com/repos/hill-a/stable-baselines/issues/645/comments","events_url":"https://api.github.com/repos/hill-a/stable-baselines/issues/645/events","html_url":"https://github.com/hill-a/stable-baselines/issues/645","id":546217734,"node_id":"MDU6SXNzdWU1NDYyMTc3MzQ=","number":645,"title":"Can an agent learn valid actions offline from a limited set of available actions ? [question]","user":{"login":"WalterEhren","id":28150577,"node_id":"MDQ6VXNlcjI4MTUwNTc3","avatar_url":"https://avatars0.githubusercontent.com/u/28150577?v=4","gravatar_id":"","url":"https://api.github.com/users/WalterEhren","html_url":"https://github.com/WalterEhren","followers_url":"https://api.github.com/users/WalterEhren/followers","following_url":"https://api.github.com/users/WalterEhren/following{/other_user}","gists_url":"https://api.github.com/users/WalterEhren/gists{/gist_id}","starred_url":"https://api.github.com/users/WalterEhren/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/WalterEhren/subscriptions","organizations_url":"https://api.github.com/users/WalterEhren/orgs","repos_url":"https://api.github.com/users/WalterEhren/repos","events_url":"https://api.github.com/users/WalterEhren/events{/privacy}","received_events_url":"https://api.github.com/users/WalterEhren/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2020-01-07T10:56:03Z","updated_at":"2020-01-07T10:56:03Z","closed_at":null,"author_association":"NONE","body":"Hi,\r\n\r\nCan anyone give me advice on training an RL agent, that can choose actions only from a given data set.\r\n\r\nI am working on a control system problem. I have collected half a year worth of data about a machine that produces parts. The data contains setpoints, measurements and information about the quality of the produces parts.\r\n\r\nFor safety reasons the agent can not learn online. Therefore the agent needs to learn offline on the historical data. However, i can not wrap my head around an agent that produces valid setpoints as actions. \r\n\r\nThere are multiple papers that implement an agent offline, e.g. https://arxiv.org/pdf/1709.05077.pdf, however i do not understand how the agent chooses an action in these implementations.\r\n\r\nCheers,\r\n\r\nWalter Ehren"}}
other: {"actor":{"display_login":"WalterEhren"}}