payload: {"action":"created","issue":{"url":"https://api.github.com/repos/r-lib/vroom/issues/122","repository_url":"https://api.github.com/repos/r-lib/vroom","labels_url":"https://api.github.com/repos/r-lib/vroom/issues/122/labels{/name}","comments_url":"https://api.github.com/repos/r-lib/vroom/issues/122/comments","events_url":"https://api.github.com/repos/r-lib/vroom/issues/122/events","html_url":"https://github.com/r-lib/vroom/issues/122","id":450082361,"node_id":"MDU6SXNzdWU0NTAwODIzNjE=","number":122,"title":"segfault on large zipped csv","user":{"login":"randomgambit","id":8282510,"node_id":"MDQ6VXNlcjgyODI1MTA=","avatar_url":"https://avatars0.githubusercontent.com/u/8282510?v=4","gravatar_id":"","url":"https://api.github.com/users/randomgambit","html_url":"https://github.com/randomgambit","followers_url":"https://api.github.com/users/randomgambit/followers","following_url":"https://api.github.com/users/randomgambit/following{/other_user}","gists_url":"https://api.github.com/users/randomgambit/gists{/gist_id}","starred_url":"https://api.github.com/users/randomgambit/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/randomgambit/subscriptions","organizations_url":"https://api.github.com/users/randomgambit/orgs","repos_url":"https://api.github.com/users/randomgambit/repos","events_url":"https://api.github.com/users/randomgambit/events{/privacy}","received_events_url":"https://api.github.com/users/randomgambit/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2019-05-30T01:03:05Z","updated_at":"2019-05-30T01:10:37Z","closed_at":null,"author_association":"NONE","body":"Hi @jimhester we are not done yet!! :)\r\n\r\nI now get a `segfault` error when I try to load a file very similar to the one we used in https://github.com/r-lib/vroom/issues/119. The only difference is that the file is in a `csv.gz` format (about 1GB on disk). \r\n\r\nI can read the file without issues with `read_csv` and there are approximately 2 million obs and 20 variables. In Rstudio, loading the file triggers an immediate crash. Using the R console prints some information:\r\n\r\n```\r\n\r\n> fs::dir_ls('/mypath/myfiles/', \r\n+            glob = '*good*') %>% magrittr::extract2(3) %>% \r\n+   vroom(., progress = TRUE)\r\n                                                                              \r\n *** caught segfault ***\r\naddress 0x7f1b97beca0d, cause 'memory not mapped'\r\n\r\nTraceback:\r\n 1: vroom_(file, delim = delim, col_names = col_names, col_types = col_types,     id = id, skip = skip, col_select = col_select, na = na, quote = quote,     trim_ws = trim_ws, escape_double = escape_double, escape_backslash = escape_backslash,     comment = comment, locale = locale, guess_max = guess_max,     n_max = n_max, altrep_opts = vroom_altrep_opts(altrep_opts),     num_threads = num_threads, progress = progress)\r\n 2: vroom(., progress = TRUE)\r\n 3: function_list[[k]](value)\r\n 4: withVisible(function_list[[k]](value))\r\n 5: freduce(value, `_function_list`)\r\n 6: `_fseq`(`_lhs`)\r\n 7: eval(quote(`_fseq`(`_lhs`)), env, env)\r\n 8: eval(quote(`_fseq`(`_lhs`)), env, env)\r\n 9: withVisible(eval(quote(`_fseq`(`_lhs`)), env, env))\r\n10: fs::dir_ls(\"/mypath/myfiles/\", glob = \"*good*\") %>%     magrittr::extract2(3) %>% vroom(., progress = TRUE)\r\n\r\nPossible actions:\r\n1: abort (with core dump, if enabled)\r\n2: normal R exit\r\n3: exit R without saving workspace\r\n4: exit R saving workspace\r\nSelection:  \r\n\r\n```\r\n\r\nInterestingly, trying to load the file with `col_types` as characters does not trigger a crash. Unfortunately, a simple `tail()` on the data will create a crash. \r\n\r\nWhat do you think?\r\n- the bug hunter"},"comment":{"url":"https://api.github.com/repos/r-lib/vroom/issues/comments/497163162","html_url":"https://github.com/r-lib/vroom/issues/122#issuecomment-497163162","issue_url":"https://api.github.com/repos/r-lib/vroom/issues/122","id":497163162,"node_id":"MDEyOklzc3VlQ29tbWVudDQ5NzE2MzE2Mg==","user":{"login":"randomgambit","id":8282510,"node_id":"MDQ6VXNlcjgyODI1MTA=","avatar_url":"https://avatars0.githubusercontent.com/u/8282510?v=4","gravatar_id":"","url":"https://api.github.com/users/randomgambit","html_url":"https://github.com/randomgambit","followers_url":"https://api.github.com/users/randomgambit/followers","following_url":"https://api.github.com/users/randomgambit/following{/other_user}","gists_url":"https://api.github.com/users/randomgambit/gists{/gist_id}","starred_url":"https://api.github.com/users/randomgambit/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/randomgambit/subscriptions","organizations_url":"https://api.github.com/users/randomgambit/orgs","repos_url":"https://api.github.com/users/randomgambit/repos","events_url":"https://api.github.com/users/randomgambit/events{/privacy}","received_events_url":"https://api.github.com/users/randomgambit/received_events","type":"User","site_admin":false},"created_at":"2019-05-30T01:10:37Z","updated_at":"2019-05-30T01:10:37Z","author_association":"NONE","body":"@jimhester RAM is not an issue (I have 200GB+) and there is plenty of space on the `tmp` dir"}}
other: {"actor":{"display_login":"randomgambit"}}