payload: {"action":"created","issue":{"url":"https://api.github.com/repos/osirrc/pisa-docker/issues/15","repository_url":"https://api.github.com/repos/osirrc/pisa-docker","labels_url":"https://api.github.com/repos/osirrc/pisa-docker/issues/15/labels{/name}","comments_url":"https://api.github.com/repos/osirrc/pisa-docker/issues/15/comments","events_url":"https://api.github.com/repos/osirrc/pisa-docker/issues/15/events","html_url":"https://github.com/osirrc/pisa-docker/issues/15","id":457170563,"node_id":"MDU6SXNzdWU0NTcxNzA1NjM=","number":15,"title":"Indexing Hangs on v0.1.0","user":{"login":"r-clancy","id":1282383,"node_id":"MDQ6VXNlcjEyODIzODM=","avatar_url":"https://avatars3.githubusercontent.com/u/1282383?v=4","gravatar_id":"","url":"https://api.github.com/users/r-clancy","html_url":"https://github.com/r-clancy","followers_url":"https://api.github.com/users/r-clancy/followers","following_url":"https://api.github.com/users/r-clancy/following{/other_user}","gists_url":"https://api.github.com/users/r-clancy/gists{/gist_id}","starred_url":"https://api.github.com/users/r-clancy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/r-clancy/subscriptions","organizations_url":"https://api.github.com/users/r-clancy/orgs","repos_url":"https://api.github.com/users/r-clancy/repos","events_url":"https://api.github.com/users/r-clancy/events{/privacy}","received_events_url":"https://api.github.com/users/r-clancy/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2019-06-17T22:08:17Z","updated_at":"2019-06-17T23:35:25Z","closed_at":null,"author_association":"MEMBER","body":"Using `v0.1.0`, indexing hangs after printing out lots of messages like:\r\n```\r\n[2019-06-17 21:51:45.668] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADZFT</PROFILE>\r\n[2019-06-17 21:51:45.668] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADYFT</PROFILE>\r\n[2019-06-17 21:51:45.668] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADXFT</PROFILE>\r\n[2019-06-17 21:51:45.668] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADWFT</PROFILE>\r\n[2019-06-17 21:51:45.668] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADVFT</PROFILE>\r\n[2019-06-17 21:51:45.669] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADUFT</PROFILE>\r\n[2019-06-17 21:51:45.669] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADTFT</PROFILE>\r\n[2019-06-17 21:51:45.669] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADSFT</PROFILE>\r\n[2019-06-17 21:51:45.669] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADRFT</PROFILE>\r\n[2019-06-17 21:51:45.669] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADQFT</PROFILE>\r\n[2019-06-17 21:51:45.669] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADPFT</PROFILE>\r\n[2019-06-17 21:51:45.670] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADOFT</PROFILE>\r\n[2019-06-17 21:51:45.670] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADNFT</PROFILE>\r\n[2019-06-17 21:51:45.670] [warning] Skipped invalid record: Could not consume any tag  in context: PROFILE>_AN-EA1CHADMFT</PROFILE>\r\n```\r\n\r\nUsing `v0.0.1` it seems to work properly. Are there changes in `v0.1.0` that might have broken indexing?"},"comment":{"url":"https://api.github.com/repos/osirrc/pisa-docker/issues/comments/502888761","html_url":"https://github.com/osirrc/pisa-docker/issues/15#issuecomment-502888761","issue_url":"https://api.github.com/repos/osirrc/pisa-docker/issues/15","id":502888761,"node_id":"MDEyOklzc3VlQ29tbWVudDUwMjg4ODc2MQ==","user":{"login":"r-clancy","id":1282383,"node_id":"MDQ6VXNlcjEyODIzODM=","avatar_url":"https://avatars3.githubusercontent.com/u/1282383?v=4","gravatar_id":"","url":"https://api.github.com/users/r-clancy","html_url":"https://github.com/r-clancy","followers_url":"https://api.github.com/users/r-clancy/followers","following_url":"https://api.github.com/users/r-clancy/following{/other_user}","gists_url":"https://api.github.com/users/r-clancy/gists{/gist_id}","starred_url":"https://api.github.com/users/r-clancy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/r-clancy/subscriptions","organizations_url":"https://api.github.com/users/r-clancy/orgs","repos_url":"https://api.github.com/users/r-clancy/repos","events_url":"https://api.github.com/users/r-clancy/events{/privacy}","received_events_url":"https://api.github.com/users/r-clancy/received_events","type":"User","site_admin":false},"created_at":"2019-06-17T23:35:25Z","updated_at":"2019-06-17T23:35:25Z","author_association":"MEMBER","body":"I get really low MAP and P.30 with `v0.1.1`:\r\n```\r\nnum_q                   all     149\r\nmap                     all     0.0002\r\nP_30                    all     0.0009\r\n```\r\n\r\n`prepare` log: https://drive.google.com/file/d/1yeqNraJQEPTVtQOfwkHpkTiffRegOA6k/view?usp=drivesdk\r\n`search` log: https://drive.google.com/file/d/19ffJgThztA9_nmVMZbCxvJL874QGZSxP/view?usp=drivesdk\r\nrun file: https://drive.google.com/file/d/1EyW3JUJbfxO3y7oFH5ZJi6qiGQVJ7SgX/view?usp=drivesdk"}}
other: {"actor":{"display_login":"r-clancy"}}