Skip to content

Instantly share code, notes, and snippets.

@devrim
Created February 12, 2018 18:02
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save devrim/d13fd5b854101c012be972faaa3c10fd to your computer and use it in GitHub Desktop.
fail after 12M insertion
<--- Last few GCs --->
[83252:0x102801e00] 10819832 ms: Mark-sweep 1373.1 (1426.8) -> 1373.1 (1426.8) MB, 689.2 / 0.0 ms allocation failure GC in old space requested
[83252:0x102801e00] 10820615 ms: Mark-sweep 1373.1 (1426.8) -> 1373.1 (1425.8) MB, 674.8 / 0.0 ms last resort GC in old space requested
[83252:0x102801e00] 10821423 ms: Mark-sweep 1373.1 (1425.8) -> 1373.1 (1425.8) MB, 807.3 / 0.0 ms last resort GC in old space requested
<--- JS stacktrace --->
==== JS stack trace =========================================
Security context: 0x20a88d6a54d9 <JSObject>
1: write [buffer.js:~896] [pc=0x286b77629410](this=0x20a817633341 <Uint8Array map = 0x20a84e945281>,string=0x20a89d3ff251 <Very long string[195571]>,offset=2128762,length=0x20a88d6b6809 <String[4]: utf8>,encoding=0x20a8474822d1 <undefined>)
2: arguments adaptor frame: 3->4
3: serializeInto(aka serializeInto) [/Users/d/Projects/wikipedia-to-mongodb/node_modules/bson/lib/bson/parser/se...
FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory
1: node::Abort() [/usr/local/bin/node]
2: node::OnFatalError(char const*, char const*) [/usr/local/bin/node]
3: v8::internal::V8::FatalProcessOutOfMemory(char const*, bool) [/usr/local/bin/node]
4: v8::internal::Factory::NewRawTwoByteString(int, v8::internal::PretenureFlag) [/usr/local/bin/node]
5: v8::internal::String::SlowFlatten(v8::internal::Handle<v8::internal::ConsString>, v8::internal::PretenureFlag) [/usr/local/bin/node]
6: v8::String::WriteUtf8(char*, int, int*, int) const [/usr/local/bin/node]
7: node::StringBytes::Write(v8::Isolate*, char*, unsigned long, v8::Local<v8::Value>, node::encoding, int*) [/usr/local/bin/node]
8: void node::Buffer::(anonymous namespace)::StringWrite<(node::encoding)1>(v8::FunctionCallbackInfo<v8::Value> const&) [/usr/local/bin/node]
9: 0x286b77628fc7
10: 0x286b77629410
./wpdump.sh: line 1: 83252 Abort trap: 6 node /Users/d/Projects/wikipedia-to-mongodb/bin/wp2mongo.js /Users/d/Projects/enwiki-20170820.xml --skip_disambig=true --skip_redirects=true --auto_skip --batch_size=1000
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment