Skip to content

Instantly share code, notes, and snippets.

@wcpan
Created November 24, 2015 02:36
Show Gist options
  • Save wcpan/2d1eb7c71153bcb9abd5 to your computer and use it in GitHub Desktop.
Save wcpan/2d1eb7c71153bcb9abd5 to your computer and use it in GitHub Desktop.
/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/bin/java -Dvisualvm.id=181426723119744 -ea -Didea.launcher.port=7545 "-Didea.launcher.bin.path=/Applications/IntelliJ IDEA 15.app/Contents/bin" -Didea.testng.sm_runner -Dfile.encoding=UTF-8 -classpath "/Applications/IntelliJ IDEA 15.app/Contents/lib/idea_rt.jar:/Applications/IntelliJ IDEA 15.app/Contents/plugins/testng/lib/testng-plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/lib/tools.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_25.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Users/wcpan2/git/gondola/containers/jersey2-routing/target/test-classes:/Users/wcpan2/git/gondola/containers/jersey2-routing/target/classes:/Users/wcpan2/.m2/repository/org/apache/httpcomponents/httpclient/4.5.1/httpclient-4.5.1.jar:/Users/wcpan2/.m2/repository/org/apache/httpcomponents/httpcore/4.4.3/httpcore-4.4.3.jar:/Users/wcpan2/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/wcpan2/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/wcpan2/.m2/repository/org/apache/httpcomponents/httpclient/4.5.1/httpclient-4.5.1-tests.jar:/Users/wcpan2/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/containers/jersey-container-jetty-servlet/2.22/jersey-container-jetty-servlet-2.22.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.22/jersey-container-servlet-2.22.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.22/jersey-container-servlet-core-2.22.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/containers/jersey-container-jetty-http/2.22/jersey-container-jetty-http-2.22.jar:/Users/wcpan2/.m2/repository/org/glassfish/hk2/external/javax.inject/2.4.0-b31/javax.inject-2.4.0-b31.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-server/9.1.1.v20140108/jetty-server-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-http/9.1.1.v20140108/jetty-http-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-io/9.1.1.v20140108/jetty-io-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-util/9.1.1.v20140108/jetty-util-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-continuation/9.1.1.v20140108/jetty-continuation-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-webapp/9.1.1.v20140108/jetty-webapp-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-xml/9.1.1.v20140108/jetty-xml-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-servlet/9.1.1.v20140108/jetty-servlet-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/eclipse/jetty/jetty-security/9.1.1.v20140108/jetty-security-9.1.1.v20140108.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/core/jersey-common/2.22/jersey-common-2.22.jar:/Users/wcpan2/.m2/repository/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/bundles/repackaged/jersey-guava/2.22/jersey-guava-2.22.jar:/Users/wcpan2/.m2/repository/org/glassfish/hk2/hk2-api/2.4.0-b31/hk2-api-2.4.0-b31.jar:/Users/wcpan2/.m2/repository/org/glassfish/hk2/hk2-utils/2.4.0-b31/hk2-utils-2.4.0-b31.jar:/Users/wcpan2/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.4.0-b31/aopalliance-repackaged-2.4.0-b31.jar:/Users/wcpan2/.m2/repository/org/glassfish/hk2/hk2-locator/2.4.0-b31/hk2-locator-2.4.0-b31.jar:/Users/wcpan2/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/core/jersey-server/2.22/jersey-server-2.22.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/core/jersey-client/2.22/jersey-client-2.22.jar:/Users/wcpan2/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.22/jersey-media-jaxb-2.22.jar:/Users/wcpan2/.m2/repository/javax/validation/validation-api/1.1.0.Final/validation-api-1.1.0.Final.jar:/Users/wcpan2/.m2/repository/javax/ws/rs/javax.ws.rs-api/2.0.1/javax.ws.rs-api-2.0.1.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch/0.1.53/jsch-0.1.53.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch.agentproxy.usocket-jna/0.0.9/jsch.agentproxy.usocket-jna-0.0.9.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch.agentproxy.core/0.0.9/jsch.agentproxy.core-0.0.9.jar:/Users/wcpan2/.m2/repository/net/java/dev/jna/jna/4.1.0/jna-4.1.0.jar:/Users/wcpan2/.m2/repository/net/java/dev/jna/jna-platform/4.1.0/jna-platform-4.1.0.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch.agentproxy.sshagent/0.0.9/jsch.agentproxy.sshagent-0.0.9.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch.agentproxy.connector-factory/0.0.6/jsch.agentproxy.connector-factory-0.0.6.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch.agentproxy.usocket-nc/0.0.6/jsch.agentproxy.usocket-nc-0.0.6.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch.agentproxy.pageant/0.0.6/jsch.agentproxy.pageant-0.0.6.jar:/Users/wcpan2/.m2/repository/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar:/Users/wcpan2/.m2/repository/com/jcraft/jsch.agentproxy.jsch/0.0.7/jsch.agentproxy.jsch-0.0.7.jar:/Users/wcpan2/.m2/repository/com/google/guava/guava/18.0/guava-18.0.jar:/Users/wcpan2/git/gondola/core/target/classes:/Users/wcpan2/.m2/repository/com/typesafe/config/1.2.1/config-1.2.1.jar:/Users/wcpan2/.m2/repository/mysql/mysql-connector-java/5.1.35/mysql-connector-java-5.1.35.jar:/Users/wcpan2/.m2/repository/com/h2database/h2/1.4.187/h2-1.4.187.jar:/Users/wcpan2/.m2/repository/com/zaxxer/HikariCP/2.3.8/HikariCP-2.3.8.jar:/Users/wcpan2/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/Users/wcpan2/.m2/repository/org/slf4j/slf4j-api/1.7.10/slf4j-api-1.7.10.jar:/Users/wcpan2/.m2/repository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar:/Users/wcpan2/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/wcpan2/.m2/repository/org/testng/testng/6.8.21/testng-6.8.21.jar:/Users/wcpan2/.m2/repository/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar:/Users/wcpan2/.m2/repository/com/beust/jcommander/1.27/jcommander-1.27.jar:/Users/wcpan2/.m2/repository/org/mockito/mockito-all/1.10.8/mockito-all-1.10.8.jar:/Applications/IntelliJ IDEA 15.app/Contents/plugins/testng/lib/jcommander.jar" com.intellij.rt.execution.application.AppMain org.testng.RemoteTestNGStarter -port 55953 -usedefaultlisteners false -socket55954 @w@/private/var/folders/sc/wbydt3v52r75rxps4dbfc9940000gt/T/idea_working_dirs_testng0.tmp -temp /private/var/folders/sc/wbydt3v52r75rxps4dbfc9940000gt/T/idea_testng0.tmp
[TestNG] Running:
/Users/wcpan2/Library/Caches/IntelliJIdea15/temp-testng-customsuite.xml
2015-11-23 18:36:30,551 INFO ------- Gondola start: host5, localhost/127.0.0.1:2185, pid=46681 -------
2015-11-23 18:36:30,563 INFO localhost:2185 is not active: Connection refused
2015-11-23 18:36:30,571 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host5 user=sa
2015-11-23 18:36:30,759 INFO H2DB autoCommit=true
2015-11-23 18:36:30,797 INFO [host5-85] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:30,800 INFO [host5-85] Becomes FOLLOWER of -1
2015-11-23 18:36:30,801 INFO [host5-85] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:30,802 INFO [host5-85] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:30,807 INFO [host5-85] Creating connection to 86
2015-11-23 18:36:30,809 WARN [host5-85] Failed to create socket to 86 (localhost/127.0.0.1:2186): Connection refused
2015-11-23 18:36:30,809 INFO [host5-85] Will retry creating the socket to 86 (localhost/127.0.0.1:2186) every 1000ms
2015-11-23 18:36:30,811 INFO [host5-85] Creating connection to 84
2015-11-23 18:36:30,812 WARN [host5-85] Failed to create socket to 84 (localhost/127.0.0.1:2184): Connection refused
2015-11-23 18:36:30,812 INFO [host5-85] Will retry creating the socket to 84 (localhost/127.0.0.1:2184) every 1000ms
2015-11-23 18:36:30,817 INFO [host5-85] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:30,817 INFO [host5-85] - leader=-1 cterm=1 ci=0 latest=(0,0) votedFor=-1 msgPool=0/4
2015-11-23 18:36:30,817 INFO [host5-85] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:30,818 INFO [host5-85] - peer=86 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:30,818 INFO [host5-85] - peer=84 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:30,818 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,035 INFO ------- Gondola start: host4, localhost/127.0.0.1:2184, pid=46681 -------
2015-11-23 18:36:31,036 INFO localhost:2184 is not active: Connection refused
2015-11-23 18:36:31,036 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host4 user=sa
2015-11-23 18:36:31,041 INFO H2DB autoCommit=true
2015-11-23 18:36:31,044 INFO [host4-84] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,045 INFO [host4-84] Becomes FOLLOWER of -1
2015-11-23 18:36:31,045 INFO [host4-84] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,045 INFO [host4-84] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,047 INFO [host4-84] Creating connection to 86
2015-11-23 18:36:31,047 INFO [host4-84] Creating connection to 85
2015-11-23 18:36:31,048 WARN [host4-84] Failed to create socket to 86 (localhost/127.0.0.1:2186): Connection refused
2015-11-23 18:36:31,048 INFO [host4-84] Will retry creating the socket to 86 (localhost/127.0.0.1:2186) every 1000ms
2015-11-23 18:36:31,048 INFO [host4-84] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:31,048 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:31,049 INFO [host4-84] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,049 INFO [host4-84] - leader=-1 cterm=1 ci=0 latest=(0,0) votedFor=-1 msgPool=0/4
2015-11-23 18:36:31,050 INFO [host4-84] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,050 INFO [host4-84] - peer=86 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,051 INFO [host4-84] - peer=85 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,051 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,052 INFO [host5-85] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:31,052 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:31,054 INFO [host4-84] Socket to 85 is now operational
2015-11-23 18:36:31,054 INFO [host5-85] Socket to 84 is now operational
2015-11-23 18:36:31,060 INFO ------- Gondola start: host7, localhost/127.0.0.1:2187, pid=46681 -------
2015-11-23 18:36:31,061 INFO localhost:2187 is not active: Connection refused
2015-11-23 18:36:31,061 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host7 user=sa
2015-11-23 18:36:31,065 INFO H2DB autoCommit=true
2015-11-23 18:36:31,067 INFO [host7-87] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,068 INFO [host7-87] Becomes FOLLOWER of -1 (primary)
2015-11-23 18:36:31,068 INFO [host7-87] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,069 INFO [host7-87] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,070 INFO [host7-87] Creating connection to 88
2015-11-23 18:36:31,071 INFO [host7-87] Creating connection to 89
2015-11-23 18:36:31,071 WARN [host7-87] Failed to create socket to 88 (localhost/127.0.0.1:2188): Connection refused
2015-11-23 18:36:31,071 INFO [host7-87] Will retry creating the socket to 88 (localhost/127.0.0.1:2188) every 1000ms
2015-11-23 18:36:31,072 WARN [host7-87] Failed to create socket to 89 (localhost/127.0.0.1:2189): Connection refused
2015-11-23 18:36:31,072 INFO [host7-87] Will retry creating the socket to 89 (localhost/127.0.0.1:2189) every 1000ms
2015-11-23 18:36:31,072 INFO [host7-87] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,073 INFO [host7-87] - leader=-1 cterm=73 ci=0 latest=(0,0) votedFor=87 msgPool=0/4
2015-11-23 18:36:31,073 INFO [host7-87] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,073 INFO [host7-87] - peer=88 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,073 INFO [host7-87] - peer=89 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,074 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,081 INFO ------- Gondola start: host6, localhost/127.0.0.1:2186, pid=46681 -------
2015-11-23 18:36:31,082 INFO localhost:2186 is not active: Connection refused
2015-11-23 18:36:31,083 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host6 user=sa
2015-11-23 18:36:31,090 INFO H2DB autoCommit=true
2015-11-23 18:36:31,094 INFO [host6-86] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,094 INFO [host6-86] Becomes FOLLOWER of -1 (primary)
2015-11-23 18:36:31,094 INFO [host6-86] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,095 INFO [host6-86] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,096 INFO [host6-86] Creating connection to 85
2015-11-23 18:36:31,097 INFO [host6-86] Creating connection to 84
2015-11-23 18:36:31,097 INFO [host6-86] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:31,097 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:31,097 INFO [host6-86] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:31,097 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:31,098 INFO [host5-85] Socket to 86 is now operational
2015-11-23 18:36:31,098 INFO [host6-86] Socket to 85 is now operational
2015-11-23 18:36:31,098 INFO [host4-84] Socket to 86 is now operational
2015-11-23 18:36:31,098 INFO [host6-86] Socket to 84 is now operational
2015-11-23 18:36:31,099 INFO [host6-86] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,099 INFO [host6-86] - leader=-1 cterm=1 ci=0 latest=(0,0) votedFor=-1 msgPool=1/5
2015-11-23 18:36:31,099 INFO [host6-86] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,099 INFO [host6-86] - peer=85 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,100 INFO [host6-86] - peer=84 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,100 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,105 INFO ------- Gondola start: host1, localhost/127.0.0.1:2181, pid=46681 -------
2015-11-23 18:36:31,106 INFO localhost:2181 is not active: Connection refused
2015-11-23 18:36:31,106 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host1 user=sa
2015-11-23 18:36:31,110 INFO H2DB autoCommit=true
2015-11-23 18:36:31,114 INFO [host1-81] Initializing save index with latest=(76,75) maxGap=10
2015-11-23 18:36:31,118 INFO [host1-81] Becomes FOLLOWER of -1 (primary)
2015-11-23 18:36:31,118 INFO [host1-81] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,120 INFO [host1-81] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:31,121 INFO [host1-81] Creating connection to 82
2015-11-23 18:36:31,121 INFO [host1-81] Creating connection to 83
2015-11-23 18:36:31,122 WARN [host1-81] Failed to create socket to 82 (localhost/127.0.0.1:2182): Connection refused
2015-11-23 18:36:31,122 INFO [host1-81] Will retry creating the socket to 82 (localhost/127.0.0.1:2182) every 1000ms
2015-11-23 18:36:31,122 WARN [host1-81] Failed to create socket to 83 (localhost/127.0.0.1:2183): Connection refused
2015-11-23 18:36:31,122 INFO [host1-81] Will retry creating the socket to 83 (localhost/127.0.0.1:2183) every 1000ms
2015-11-23 18:36:31,123 INFO [host1-81] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,123 INFO [host1-81] - leader=-1 cterm=76 ci=0 latest=(76,75) votedFor=83 msgPool=0/4
2015-11-23 18:36:31,123 INFO [host1-81] - storage 0.0/s ti=(76,75) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,123 INFO [host1-81] - peer=82 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,123 INFO [host1-81] - peer=83 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,123 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,129 INFO ------- Gondola start: host3, localhost/127.0.0.1:2183, pid=46681 -------
2015-11-23 18:36:31,130 INFO localhost:2183 is not active: Connection refused
2015-11-23 18:36:31,130 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host3 user=sa
2015-11-23 18:36:31,133 INFO H2DB autoCommit=true
2015-11-23 18:36:31,137 INFO [host3-83] Initializing save index with latest=(76,75) maxGap=10
2015-11-23 18:36:31,141 INFO [host3-83] Becomes FOLLOWER of -1
2015-11-23 18:36:31,141 INFO [host3-83] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,142 INFO [host3-83] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:31,144 INFO [host3-83] Creating connection to 81
2015-11-23 18:36:31,144 INFO [host3-83] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:31,144 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:31,144 INFO [host3-83] Creating connection to 82
2015-11-23 18:36:31,145 INFO [host1-81] Socket to 83 is now operational
2015-11-23 18:36:31,145 INFO [host3-83] Socket to 81 is now operational
2015-11-23 18:36:31,145 WARN [host3-83] Failed to create socket to 82 (localhost/127.0.0.1:2182): Connection refused
2015-11-23 18:36:31,145 INFO [host3-83] Will retry creating the socket to 82 (localhost/127.0.0.1:2182) every 1000ms
2015-11-23 18:36:31,146 INFO [host3-83] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,146 INFO [host3-83] - leader=-1 cterm=76 ci=0 latest=(76,75) votedFor=83 msgPool=1/5
2015-11-23 18:36:31,146 INFO [host3-83] - storage 0.0/s ti=(76,75) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,146 INFO [host3-83] - peer=81 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,146 INFO [host3-83] - peer=82 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,146 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,153 INFO ------- Gondola start: host2, localhost/127.0.0.1:2182, pid=46681 -------
2015-11-23 18:36:31,154 INFO localhost:2182 is not active: Connection refused
2015-11-23 18:36:31,154 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host2 user=sa
2015-11-23 18:36:31,158 INFO H2DB autoCommit=true
2015-11-23 18:36:31,161 INFO [host2-82] Initializing save index with latest=(76,75) maxGap=10
2015-11-23 18:36:31,164 INFO [host2-82] Becomes FOLLOWER of -1
2015-11-23 18:36:31,164 INFO [host2-82] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,165 INFO [host2-82] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:31,166 INFO [host2-82] Creating connection to 81
2015-11-23 18:36:31,167 INFO [host2-82] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:31,167 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:31,167 INFO [host2-82] Creating connection to 83
2015-11-23 18:36:31,168 INFO [host1-81] Socket to 82 is now operational
2015-11-23 18:36:31,168 INFO [host2-82] Socket created to 83 (localhost/127.0.0.1:2183)
2015-11-23 18:36:31,168 INFO [host2-82] Socket to 81 is now operational
2015-11-23 18:36:31,168 INFO [host3] Socket accept from /127.0.0.1
2015-11-23 18:36:31,169 INFO [host3-83] Socket created to 82 (localhost/127.0.0.1:2182)
2015-11-23 18:36:31,169 INFO [host2-82] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,170 INFO [host2] Socket accept from /127.0.0.1
2015-11-23 18:36:31,170 INFO [host2-82] - leader=-1 cterm=76 ci=0 latest=(76,75) votedFor=83 msgPool=1/5
2015-11-23 18:36:31,170 INFO [host2-82] - storage 0.0/s ti=(76,75) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,170 INFO [host2-82] - peer=81 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,170 INFO [host2-82] - peer=83 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,171 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,171 INFO [host2-82] Socket to 83 is now operational
2015-11-23 18:36:31,171 INFO [host3-83] Socket to 82 is now operational
2015-11-23 18:36:31,180 INFO ------- Gondola start: host9, localhost/127.0.0.1:2189, pid=46681 -------
2015-11-23 18:36:31,181 INFO localhost:2189 is not active: Connection refused
2015-11-23 18:36:31,181 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host9 user=sa
2015-11-23 18:36:31,187 INFO H2DB autoCommit=true
2015-11-23 18:36:31,191 INFO [host9-89] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,191 INFO [host9-89] Becomes FOLLOWER of -1
2015-11-23 18:36:31,191 INFO [host9-89] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,192 INFO [host9-89] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,194 INFO [host9-89] Creating connection to 87
2015-11-23 18:36:31,206 INFO [host7] Socket accept from /127.0.0.1
2015-11-23 18:36:31,206 INFO [host9-89] Socket created to 87 (localhost/127.0.0.1:2187)
2015-11-23 18:36:31,206 INFO [host9-89] Creating connection to 88
2015-11-23 18:36:31,207 WARN [host9-89] Failed to create socket to 88 (localhost/127.0.0.1:2188): Connection refused
2015-11-23 18:36:31,207 INFO [host9-89] Will retry creating the socket to 88 (localhost/127.0.0.1:2188) every 1000ms
2015-11-23 18:36:31,207 INFO [host7-87] Socket to 89 is now operational
2015-11-23 18:36:31,207 INFO [host9-89] Socket to 87 is now operational
2015-11-23 18:36:31,208 INFO [host9-89] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,209 INFO [host9-89] - leader=-1 cterm=73 ci=0 latest=(0,0) votedFor=87 msgPool=1/5
2015-11-23 18:36:31,209 INFO [host9-89] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,209 INFO [host9-89] - peer=87 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,209 INFO [host9-89] - peer=88 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,209 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,217 INFO ------- Gondola start: host8, localhost/127.0.0.1:2188, pid=46681 -------
2015-11-23 18:36:31,218 INFO localhost:2188 is not active: Connection refused
2015-11-23 18:36:31,218 INFO Initializing H2DB storage. maxCommandSize=1000 url=jdbc:h2:/tmp/gondola-db-host8 user=sa
2015-11-23 18:36:31,222 INFO H2DB autoCommit=true
2015-11-23 18:36:31,224 INFO [host8-88] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,225 INFO [host8-88] Becomes FOLLOWER of -1
2015-11-23 18:36:31,225 INFO [host8-88] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:31,225 INFO [host8-88] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:31,226 INFO [host8-88] Creating connection to 87
2015-11-23 18:36:31,227 INFO [host8-88] Creating connection to 89
2015-11-23 18:36:31,227 INFO [host7] Socket accept from /127.0.0.1
2015-11-23 18:36:31,227 INFO [host8-88] Socket created to 87 (localhost/127.0.0.1:2187)
2015-11-23 18:36:31,227 INFO [host9] Socket accept from /127.0.0.1
2015-11-23 18:36:31,227 INFO [host8-88] Socket created to 89 (localhost/127.0.0.1:2189)
2015-11-23 18:36:31,228 INFO [host7-87] Socket to 88 is now operational
2015-11-23 18:36:31,228 INFO [host8-88] Socket to 87 is now operational
2015-11-23 18:36:31,228 INFO [host8-88] FOLLOWER pid=46681 wait=0ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:31,228 INFO [host9-89] Socket created to 88 (localhost/127.0.0.1:2188)
2015-11-23 18:36:31,228 INFO [host8] Socket accept from /127.0.0.1
2015-11-23 18:36:31,228 INFO [host8-88] - leader=-1 cterm=73 ci=0 latest=(0,0) votedFor=87 msgPool=1/5
2015-11-23 18:36:31,229 INFO [host8-88] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:31,229 INFO [host8-88] - peer=87 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,229 INFO [host9-89] Socket to 88 is now operational
2015-11-23 18:36:31,229 INFO [host8-88] Socket to 89 is now operational
2015-11-23 18:36:31,229 INFO [host8-88] - peer=89 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:31,229 INFO b1=NaN, b2=NaN, b3=NaN, b4=NaN b5=NaN 0.000ms/loop
2015-11-23 18:36:31,812 INFO [host5-85] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:31,812 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:32,052 INFO [host4-84] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:32,052 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:32,075 INFO [host7-87] Socket created to 89 (localhost/127.0.0.1:2189)
2015-11-23 18:36:32,075 INFO [host8] Socket accept from /127.0.0.1
2015-11-23 18:36:32,075 INFO [host7-87] Socket created to 88 (localhost/127.0.0.1:2188)
2015-11-23 18:36:32,075 INFO [host9] Socket accept from /127.0.0.1
2015-11-23 18:36:32,127 INFO [host3] Socket accept from /127.0.0.1
2015-11-23 18:36:32,127 INFO [host1-81] Socket created to 83 (localhost/127.0.0.1:2183)
2015-11-23 18:36:32,127 INFO [host1-81] Socket created to 82 (localhost/127.0.0.1:2182)
2015-11-23 18:36:32,127 INFO [host2] Socket accept from /127.0.0.1
2015-11-23 18:36:32,803 INFO [host5-85] No heartbeat from -1 in 2001ms (timeout=2000ms)
2015-11-23 18:36:32,803 INFO [host5-85] Becomes CANDIDATE
2015-11-23 18:36:32,804 INFO [host5-85] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:32,805 INFO [host5-85] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,050 INFO [host4-84] No heartbeat from -1 in 2004ms (timeout=2000ms)
2015-11-23 18:36:33,050 INFO [host4-84] Becomes CANDIDATE
2015-11-23 18:36:33,050 INFO [host4-84] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,051 INFO [host4-84] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,058 INFO [host5-85] Has majority of pre-votes (2). Incrementing currentTerm to 2 and sending out request vote
2015-11-23 18:36:33,059 INFO [host6-86] Voting for 85 in term 2
2015-11-23 18:36:33,059 INFO [host4-84] Becomes FOLLOWER of -1
2015-11-23 18:36:33,059 INFO [host4-84] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,060 INFO [host4-84] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,060 INFO [host4-84] Became a follower because term 2 from 85 is > currentTerm 1
2015-11-23 18:36:33,060 INFO [host4-84] Voting for 85 in term 2
2015-11-23 18:36:33,060 INFO [host5-85] Becomes LEADER for term 2
2015-11-23 18:36:33,060 INFO [host5-85] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,061 INFO [host5-85] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,062 ERROR
java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at com.yahoo.gondola.container.AdminClientIT.lambda$setUp$0(AdminClientIT.java:80)
at com.yahoo.gondola.container.AdminClientIT$$Lambda$3/932285561.accept(Unknown Source)
at com.yahoo.gondola.Gondola$RoleChangeNotifier.lambda$run$16(Gondola.java:280)
at com.yahoo.gondola.Gondola$RoleChangeNotifier$$Lambda$37/2069187851.accept(Unknown Source)
at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:890)
at com.yahoo.gondola.Gondola$RoleChangeNotifier.run(Gondola.java:280)
2015-11-23 18:36:33,070 INFO [host7-87] No heartbeat from -1 in 2001ms (timeout=2000ms)
2015-11-23 18:36:33,071 INFO [host7-87] Becomes CANDIDATE (primary)
2015-11-23 18:36:33,071 INFO [host7-87] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,071 INFO [host7-87] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,100 INFO [host6-86] No heartbeat from -1 in 2005ms (timeout=2000ms)
2015-11-23 18:36:33,100 INFO [host6-86] Becomes CANDIDATE (primary)
2015-11-23 18:36:33,100 INFO [host6-86] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,102 INFO [host6-86] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,124 INFO [host1-81] No heartbeat from -1 in 2004ms (timeout=2000ms)
2015-11-23 18:36:33,124 INFO [host1-81] Becomes CANDIDATE (primary)
2015-11-23 18:36:33,124 INFO [host1-81] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,126 INFO [host1-81] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:33,146 INFO [host3-83] No heartbeat from -1 in 2003ms (timeout=2000ms)
2015-11-23 18:36:33,146 INFO [host3-83] Becomes CANDIDATE
2015-11-23 18:36:33,147 INFO [host3-83] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,148 INFO [host3-83] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:33,165 INFO [host2-82] No heartbeat from -1 in 2000ms (timeout=2000ms)
2015-11-23 18:36:33,165 INFO [host2-82] Becomes CANDIDATE
2015-11-23 18:36:33,166 INFO [host2-82] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,167 INFO [host2-82] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:33,190 INFO [host3-83] Has majority of pre-votes (2). Incrementing currentTerm to 77 and sending out request vote
2015-11-23 18:36:33,191 INFO [host2-82] Becomes FOLLOWER of -1
2015-11-23 18:36:33,191 INFO [host1-81] Becomes FOLLOWER of -1 (primary)
2015-11-23 18:36:33,191 INFO [host1-81] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,191 INFO [host2-82] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,192 INFO [host1-81] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:33,192 INFO [host2-82] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:33,193 INFO [host1-81] Became a follower because term 77 from 83 is > currentTerm 76
2015-11-23 18:36:33,193 INFO [host1-81] Voting for 83 in term 77
2015-11-23 18:36:33,193 INFO [host2-82] Became a follower because term 77 from 83 is > currentTerm 76
2015-11-23 18:36:33,193 INFO [host2-82] Voting for 83 in term 77
2015-11-23 18:36:33,194 INFO [host3-83] Becomes LEADER for term 77
2015-11-23 18:36:33,194 INFO [host3-83] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,195 INFO [host3-83] Initializing save index with latest=(76,75) maxGap=0
2015-11-23 18:36:33,195 ERROR
java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at com.yahoo.gondola.container.AdminClientIT.lambda$setUp$0(AdminClientIT.java:80)
at com.yahoo.gondola.container.AdminClientIT$$Lambda$3/932285561.accept(Unknown Source)
at com.yahoo.gondola.Gondola$RoleChangeNotifier.lambda$run$16(Gondola.java:280)
at com.yahoo.gondola.Gondola$RoleChangeNotifier$$Lambda$37/2069187851.accept(Unknown Source)
at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:890)
at com.yahoo.gondola.Gondola$RoleChangeNotifier.run(Gondola.java:280)
2015-11-23 18:36:33,198 INFO [host9-89] No heartbeat from -1 in 2005ms (timeout=2000ms)
2015-11-23 18:36:33,199 INFO [host9-89] Becomes CANDIDATE
2015-11-23 18:36:33,199 INFO [host9-89] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,200 INFO [host9-89] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,225 INFO [host7-87] Has majority of pre-votes (2). Incrementing currentTerm to 74 and sending out request vote
2015-11-23 18:36:33,226 INFO [host8-88] No heartbeat from -1 in 2000ms (timeout=2000ms)
2015-11-23 18:36:33,226 INFO [host8-88] Becomes CANDIDATE
2015-11-23 18:36:33,226 INFO [host8-88] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,226 INFO [host9-89] Becomes FOLLOWER of -1
2015-11-23 18:36:33,226 INFO [host9-89] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,227 INFO [host8-88] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,227 INFO [host9-89] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,227 INFO [host9-89] Became a follower because term 74 from 87 is > currentTerm 73
2015-11-23 18:36:33,227 INFO [host9-89] Voting for 87 in term 74
2015-11-23 18:36:33,227 INFO [host8-88] Becomes FOLLOWER of -1
2015-11-23 18:36:33,227 INFO [host8-88] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,227 INFO [host7-87] Becomes LEADER for term 74 (primary)
2015-11-23 18:36:33,227 INFO [host8-88] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,227 INFO [host7-87] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,228 INFO [host8-88] Became a follower because term 74 from 87 is > currentTerm 73
2015-11-23 18:36:33,228 INFO [host8-88] Voting for 87 in term 74
2015-11-23 18:36:33,228 INFO [host7-87] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,228 ERROR
java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at com.yahoo.gondola.container.AdminClientIT.lambda$setUp$0(AdminClientIT.java:80)
at com.yahoo.gondola.container.AdminClientIT$$Lambda$3/932285561.accept(Unknown Source)
at com.yahoo.gondola.Gondola$RoleChangeNotifier.lambda$run$16(Gondola.java:280)
at com.yahoo.gondola.Gondola$RoleChangeNotifier$$Lambda$37/2069187851.accept(Unknown Source)
at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:890)
at com.yahoo.gondola.Gondola$RoleChangeNotifier.run(Gondola.java:280)
2015-11-23 18:36:33,232 INFO Executing assign buckets=[0‥10] from shard1 to shard2
2015-11-23 18:36:33,232 INFO Initializing slaves on shard2 ...
2015-11-23 18:36:33,232 INFO [host6] shardId=shard2 follows shardId=shard1 as slave
2015-11-23 18:36:33,233 WARN [host5-85] recv(86): end-of-file
2015-11-23 18:36:33,233 INFO [host5-85] Reconnecting socket Socket[addr=/127.0.0.1,port=55974,localport=2185] to 86
2015-11-23 18:36:33,234 WARN [host4-84] recv(86): end-of-file
2015-11-23 18:36:33,234 INFO [host4-84] Reconnecting socket Socket[addr=/127.0.0.1,port=55975,localport=2184] to 86
2015-11-23 18:36:33,234 INFO [host5-85] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:33,234 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:33,234 INFO [host6-86] Becomes FOLLOWER of 81 (primary)
2015-11-23 18:36:33,234 INFO [host4-84] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:33,234 INFO [host6-86] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,234 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:33,235 INFO [host6-86] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,235 INFO [host6-86] Creating connection to 81
2015-11-23 18:36:33,236 INFO [host6-86] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:33,236 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:33,237 INFO [host1-81] Creating connection to 86
2015-11-23 18:36:33,237 INFO [host1-81] Socket to 86 is now operational
2015-11-23 18:36:33,237 INFO [host1-81] Slave request from 86 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:33,237 WARN [host6-86] Failed to create socket to 81 (localhost/127.0.0.1:2181): End-of-file
2015-11-23 18:36:33,237 INFO [host6-86] Will retry creating the socket to 81 (localhost/127.0.0.1:2181) every 1000ms
2015-11-23 18:36:33,238 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:33,238 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:33,238 WARN [host1-81] Failed to create socket to 86 (localhost/127.0.0.1:2186): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:33,238 INFO [host1-81] Will retry creating the socket to 86 (localhost/127.0.0.1:2186) every 1000ms
2015-11-23 18:36:33,238 WARN Broken pipe
2015-11-23 18:36:33,239 INFO [host5] shardId=shard2 follows shardId=shard1 as slave
2015-11-23 18:36:33,239 WARN [host4-84] recv(85): end-of-file
2015-11-23 18:36:33,239 INFO [host4-84] Reconnecting socket Socket[addr=/127.0.0.1,port=55965,localport=2184] to 85
2015-11-23 18:36:33,240 INFO [host4-84] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:33,240 INFO [host5-85] Becomes FOLLOWER of 81
2015-11-23 18:36:33,240 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:33,240 INFO [host5-85] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,240 INFO [host5-85] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,241 INFO [host5-85] Creating connection to 81
2015-11-23 18:36:33,241 INFO [host5-85] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:33,241 INFO [host4] shardId=shard2 follows shardId=shard1 as slave
2015-11-23 18:36:33,241 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:33,242 INFO [host4-84] Becomes FOLLOWER of 81
2015-11-23 18:36:33,242 INFO [host4-84] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:33,242 INFO [host1-81] Creating connection to 85
2015-11-23 18:36:33,242 INFO [host4-84] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:33,243 INFO [host1-81] Socket to 85 is now operational
2015-11-23 18:36:33,243 INFO [host1-81] Slave request from 85 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:33,243 WARN [host5-85] Failed to create socket to 81 (localhost/127.0.0.1:2181): End-of-file
2015-11-23 18:36:33,243 INFO [host5-85] Will retry creating the socket to 81 (localhost/127.0.0.1:2181) every 1000ms
2015-11-23 18:36:33,243 INFO [host4-84] Creating connection to 81
2015-11-23 18:36:33,243 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:33,243 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:33,243 WARN [host1-81] Failed to create socket to 85 (localhost/127.0.0.1:2185): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:33,243 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:33,243 INFO All nodes in shard2 are in slave mode, waiting for slave logs approaching to leader's log position.
2015-11-23 18:36:33,243 INFO [host4-84] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:33,243 INFO Waiting for slaves logs approaching...
2015-11-23 18:36:33,243 INFO [host1-81] Will retry creating the socket to 85 (localhost/127.0.0.1:2185) every 1000ms
2015-11-23 18:36:33,244 WARN End-of-file
2015-11-23 18:36:33,244 INFO [host1-81] Creating connection to 84
2015-11-23 18:36:33,244 INFO [host1-81] Socket to 84 is now operational
2015-11-23 18:36:33,244 INFO [host1-81] Slave request from 84 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:33,245 WARN [host4-84] Failed to create socket to 81 (localhost/127.0.0.1:2181): End-of-file
2015-11-23 18:36:33,245 INFO [host4-84] Will retry creating the socket to 81 (localhost/127.0.0.1:2181) every 1000ms
2015-11-23 18:36:33,245 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:33,245 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:33,245 WARN [host1-81] Failed to create socket to 84 (localhost/127.0.0.1:2184): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:33,245 INFO [host1-81] Will retry creating the socket to 84 (localhost/127.0.0.1:2184) every 1000ms
2015-11-23 18:36:33,245 WARN Broken pipe
2015-11-23 18:36:33,252 INFO [host5] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:33,252 INFO [host6] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:33,252 INFO [host4] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:34,242 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:34,242 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:34,242 INFO [host6-86] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:34,242 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:34,243 WARN End-of-file
2015-11-23 18:36:34,243 INFO [host1-81] Creating connection to 86
2015-11-23 18:36:34,244 INFO [host1-81] Socket to 86 is now operational
2015-11-23 18:36:34,244 INFO [host1-81] Slave request from 86 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:34,244 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:34,244 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:34,244 INFO [host5-85] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:34,244 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:34,244 WARN [host1-81] Failed to create socket to 86 (localhost/127.0.0.1:2186): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:34,245 INFO [host1-81] Will retry creating the socket to 86 (localhost/127.0.0.1:2186) every 1000ms
2015-11-23 18:36:34,246 WARN End-of-file
2015-11-23 18:36:34,246 INFO [host1-81] Creating connection to 85
2015-11-23 18:36:34,246 INFO [host1-81] Socket to 85 is now operational
2015-11-23 18:36:34,246 INFO [host1-81] Slave request from 85 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:34,247 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:34,247 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:34,247 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:34,247 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:34,247 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:34,247 WARN [host1-81] Failed to create socket to 85 (localhost/127.0.0.1:2185): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:34,247 INFO [host1-81] Will retry creating the socket to 85 (localhost/127.0.0.1:2185) every 1000ms
2015-11-23 18:36:34,247 INFO [host4-84] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:34,248 WARN Broken pipe
2015-11-23 18:36:34,247 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:34,247 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:34,248 WARN Broken pipe
2015-11-23 18:36:34,249 WARN End-of-file
2015-11-23 18:36:34,250 INFO [host1-81] Creating connection to 84
2015-11-23 18:36:34,250 INFO [host1-81] Socket to 84 is now operational
2015-11-23 18:36:34,250 INFO [host1-81] Slave request from 84 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:34,252 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:34,252 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:34,252 WARN [host1-81] Failed to create socket to 84 (localhost/127.0.0.1:2184): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:34,252 INFO [host1-81] Will retry creating the socket to 84 (localhost/127.0.0.1:2184) every 1000ms
2015-11-23 18:36:34,252 WARN End-of-file
2015-11-23 18:36:34,254 INFO [host4] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:34,254 INFO [host5] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:34,254 INFO [host6] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:35,238 INFO [host6-86] No heartbeat from 81 in 2003ms (timeout=2000ms)
2015-11-23 18:36:35,238 INFO [host6-86] Becomes CANDIDATE (primary)
2015-11-23 18:36:35,238 INFO [host6-86] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:35,239 INFO [host6-86] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:35,244 INFO [host4-84] No heartbeat from 81 in 2001ms (timeout=2000ms)
2015-11-23 18:36:35,244 INFO [host4-84] Becomes CANDIDATE
2015-11-23 18:36:35,244 INFO [host5-85] No heartbeat from 81 in 2003ms (timeout=2000ms)
2015-11-23 18:36:35,244 INFO [host4-84] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:35,244 INFO [host5-85] Becomes CANDIDATE
2015-11-23 18:36:35,244 INFO [host5-85] Settling storage. workQ=0 busy=0 maxGap=0
2015-11-23 18:36:35,244 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:35,245 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:35,245 INFO [host6-86] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:35,245 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:35,246 INFO [host4-84] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:35,246 INFO [host5-85] Initializing save index with latest=(0,0) maxGap=0
2015-11-23 18:36:35,246 WARN End-of-file
2015-11-23 18:36:35,247 INFO [host1-81] Creating connection to 86
2015-11-23 18:36:35,247 INFO [host1-81] Socket to 86 is now operational
2015-11-23 18:36:35,247 INFO [host1-81] Slave request from 86 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:35,248 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:35,248 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:35,248 WARN [host1-81] Failed to create socket to 86 (localhost/127.0.0.1:2186): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:35,248 INFO [host1-81] Will retry creating the socket to 86 (localhost/127.0.0.1:2186) every 1000ms
2015-11-23 18:36:35,249 WARN Broken pipe
2015-11-23 18:36:35,251 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:35,251 INFO [host5-85] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:35,251 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:35,251 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:35,251 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:35,251 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:35,251 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:35,251 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:35,251 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:35,251 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:35,253 WARN End-of-file
2015-11-23 18:36:35,253 WARN End-of-file
2015-11-23 18:36:35,253 WARN End-of-file
2015-11-23 18:36:35,254 WARN Broken pipe
2015-11-23 18:36:35,255 INFO [host1-81] Creating connection to 85
2015-11-23 18:36:35,255 INFO [host4-84] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:35,255 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:35,255 INFO [host1-81] Socket to 85 is now operational
2015-11-23 18:36:35,255 INFO [host1-81] Slave request from 85 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:35,256 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:35,256 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:35,256 WARN [host1-81] Failed to create socket to 85 (localhost/127.0.0.1:2185): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:35,256 INFO [host1-81] Will retry creating the socket to 85 (localhost/127.0.0.1:2185) every 1000ms
2015-11-23 18:36:35,256 INFO [host4] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:35,256 INFO [host5] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:35,256 INFO [host6] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:35,256 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:35,256 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:35,256 INFO [host1-81] Creating connection to 84
2015-11-23 18:36:35,257 INFO [host1-81] Socket to 84 is now operational
2015-11-23 18:36:35,257 INFO [host1-81] Slave request from 84 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:35,258 WARN Broken pipe
2015-11-23 18:36:35,258 WARN End-of-file
2015-11-23 18:36:35,259 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:35,259 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:35,259 WARN [host1-81] Failed to create socket to 84 (localhost/127.0.0.1:2184): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:35,259 INFO [host1-81] Will retry creating the socket to 84 (localhost/127.0.0.1:2184) every 1000ms
2015-11-23 18:36:35,259 WARN End-of-file
2015-11-23 18:36:35,934 INFO [host5-85] CANDIDATE pid=46681 wait=202ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:35,935 INFO [host5-85] - leader=-1 cterm=1 ci=0 latest=(0,0) votedFor=85 msgPool=2/6
2015-11-23 18:36:35,935 INFO [host5-85] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:35,937 INFO [host5-85] - peer=81 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:35,938 INFO b1=0.1, b2=0.1, b3=0.1, b4=99.7 b5=99.7 213.260ms/loop
2015-11-23 18:36:36,103 INFO [host6-86] CANDIDATE pid=46681 wait=7ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:36,104 INFO [host6-86] - leader=-1 cterm=1 ci=0 latest=(0,0) votedFor=85 msgPool=2/6
2015-11-23 18:36:36,104 INFO [host6-86] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:36,104 INFO [host6-86] - peer=81 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,104 INFO b1=0.0, b2=0.1, b3=0.0, b4=99.8 b5=99.8 185.356ms/loop
2015-11-23 18:36:36,150 INFO [host4-84] CANDIDATE pid=46681 wait=298ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:36,150 INFO [host4-84] - leader=-1 cterm=1 ci=0 latest=(0,0) votedFor=85 msgPool=1/5
2015-11-23 18:36:36,151 INFO [host4-84] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:36,151 INFO [host4-84] - peer=81 D in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,151 INFO b1=0.0, b2=0.1, b3=0.0, b4=99.8 b5=99.8 204.054ms/loop
2015-11-23 18:36:36,224 INFO [host2-82] FOLLOWER pid=46681 wait=250ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/3.018ms
2015-11-23 18:36:36,225 INFO [host3-83] LEADER pid=46681 wait=249ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/5.386ms
2015-11-23 18:36:36,225 INFO [host3-83] - leader=83 cterm=77 ci=76 latest=(77,76) votedFor=83 msgPool=3/7
2015-11-23 18:36:36,225 INFO [host2-82] - leader=83 cterm=77 ci=76 latest=(77,76) votedFor=83 msgPool=2/6
2015-11-23 18:36:36,225 INFO [host3-83] - storage 0.0/s ti=(77,76) saveQ=0 gap=10 done=0
2015-11-23 18:36:36,224 INFO [host1-81] FOLLOWER pid=46681 wait=250ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/3.018ms
2015-11-23 18:36:36,225 INFO [host2-82] - storage 0.0/s ti=(77,76) saveQ=0 gap=10 done=0
2015-11-23 18:36:36,225 INFO [host1-81] - leader=83 cterm=77 ci=76 latest=(77,76) votedFor=83 msgPool=2/6
2015-11-23 18:36:36,225 INFO [host1-81] - storage 0.0/s ti=(77,76) saveQ=0 gap=10 done=0
2015-11-23 18:36:36,225 INFO [host3-83] - peer=81 U in=3.0/s|42.7B/s out=0|2.8/s|70.9B/s ni=77 mi=76 vf=(-1,-1) lat=3.335ms
2015-11-23 18:36:36,225 INFO [host2-82] - peer=81 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,225 INFO [host1-81] - peer=82 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,225 INFO [host3-83] - peer=82 U in=3.0/s|42.7B/s out=0|2.8/s|70.9B/s ni=77 mi=76 vf=(-1,-1) lat=3.310ms
2015-11-23 18:36:36,225 INFO [host2-82] - peer=83 U in=2.8/s|71.2B/s out=0|3.0/s|42.9B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,225 INFO [host1-81] - peer=83 U in=2.7/s|70.6B/s out=0|2.9/s|42.5B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,225 INFO b1=0.0, b2=0.1, b3=0.1, b4=99.8 b5=99.8 203.155ms/loop
2015-11-23 18:36:36,225 INFO b1=0.0, b2=0.0, b3=0.1, b4=99.9 b5=99.9 148.681ms/loop
2015-11-23 18:36:36,226 INFO b1=0.0, b2=0.1, b3=0.1, b4=99.8 b5=99.8 154.606ms/loop
2015-11-23 18:36:36,249 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:36,249 INFO [host6-86] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:36,249 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:36,249 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:36,250 WARN End-of-file
2015-11-23 18:36:36,251 INFO [host1-81] Creating connection to 86
2015-11-23 18:36:36,251 INFO [host1-81] Socket to 86 is now operational
2015-11-23 18:36:36,251 INFO [host1-81] Slave request from 86 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:36,251 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:36,251 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:36,251 WARN [host1-81] Failed to create socket to 86 (localhost/127.0.0.1:2186): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:36,252 INFO [host1-81] Will retry creating the socket to 86 (localhost/127.0.0.1:2186) every 1000ms
2015-11-23 18:36:36,252 WARN Broken pipe
2015-11-23 18:36:36,252 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:36,252 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:36,253 WARN End-of-file
2015-11-23 18:36:36,254 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:36,254 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:36,255 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:36,254 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:36,254 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:36,255 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:36,255 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:36,256 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:36,256 WARN End-of-file
2015-11-23 18:36:36,256 WARN End-of-file
2015-11-23 18:36:36,256 WARN End-of-file
2015-11-23 18:36:36,257 WARN Broken pipe
2015-11-23 18:36:36,258 INFO [host5] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:36,258 INFO [host6] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:36,258 INFO [host4] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:36,258 INFO [host5-85] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:36,258 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:36,258 INFO [host4-84] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:36,259 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:36,259 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:36,258 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:36,259 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:36,259 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:36,259 WARN End-of-file
2015-11-23 18:36:36,259 WARN End-of-file
2015-11-23 18:36:36,260 INFO [host1-81] Creating connection to 85
2015-11-23 18:36:36,260 INFO [host1-81] Socket to 85 is now operational
2015-11-23 18:36:36,260 INFO [host1-81] Creating connection to 84
2015-11-23 18:36:36,260 INFO [host1-81] Slave request from 85 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:36,261 INFO [host1-81] Socket to 84 is now operational
2015-11-23 18:36:36,261 INFO [host1-81] Slave request from 84 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:36,261 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:36,261 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:36,261 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:36,261 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:36,261 WARN [host1-81] Failed to create socket to 85 (localhost/127.0.0.1:2185): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:36,261 WARN [host1-81] Failed to create socket to 84 (localhost/127.0.0.1:2184): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:36,261 WARN Broken pipe
2015-11-23 18:36:36,261 INFO [host1-81] Will retry creating the socket to 85 (localhost/127.0.0.1:2185) every 1000ms
2015-11-23 18:36:36,262 WARN Protocol wrong type for socket
2015-11-23 18:36:36,262 INFO [host1-81] Will retry creating the socket to 84 (localhost/127.0.0.1:2184) every 1000ms
2015-11-23 18:36:36,264 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:36,264 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:36,264 WARN End-of-file
2015-11-23 18:36:36,266 INFO [host7-87] LEADER pid=46681 wait=249ms cmdQ=0 waitQ=0 in=0|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:36,266 INFO [host7-87] - leader=87 cterm=74 ci=0 latest=(0,0) votedFor=87 msgPool=3/7
2015-11-23 18:36:36,267 INFO [host7-87] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:36,267 INFO [host7-87] - peer=88 U in=2.3/s|33.9B/s out=0|2.5/s|64.1B/s ni=1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,267 INFO [host7-87] - peer=89 U in=2.5/s|36.0B/s out=0|2.5/s|64.1B/s ni=1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,267 INFO b1=0.0, b2=0.0, b3=0.0, b4=99.9 b5=99.9 225.806ms/loop
2015-11-23 18:36:36,267 INFO [host8-88] FOLLOWER pid=46681 wait=250ms cmdQ=0 waitQ=0 in=1|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:36,267 INFO [host9-89] FOLLOWER pid=46681 wait=250ms cmdQ=0 waitQ=0 in=1|0.0/s out=0.0/s lat=NaNms/NaNms
2015-11-23 18:36:36,267 INFO [host8-88] - leader=87 cterm=74 ci=0 latest=(0,0) votedFor=87 msgPool=1/6
2015-11-23 18:36:36,267 INFO [host8-88] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:36,267 INFO [host9-89] - leader=87 cterm=74 ci=0 latest=(0,0) votedFor=87 msgPool=1/6
2015-11-23 18:36:36,267 INFO [host9-89] - storage 0.0/s ti=(0,0) saveQ=0 gap=0 done=0
2015-11-23 18:36:36,267 INFO [host8-88] - peer=87 U in=2.8/s|71.5B/s out=0|2.4/s|34.9B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,267 INFO [host8-88] - peer=89 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,268 INFO [host9-89] - peer=87 U in=2.8/s|71.2B/s out=0|2.6/s|37.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,268 INFO [host9-89] - peer=88 U in=0.0/s|0.0B/s out=0|0.0/s|0.0B/s ni=-1 mi=0 vf=(-1,-1) lat=NaNms
2015-11-23 18:36:36,268 INFO b1=0.0, b2=0.0, b3=0.0, b4=99.9 b5=99.9 162.547ms/loop
2015-11-23 18:36:36,268 INFO b1=0.0, b2=0.0, b3=0.0, b4=99.9 b5=99.9 158.092ms/loop
2015-11-23 18:36:37,252 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:37,252 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:37,253 WARN End-of-file
2015-11-23 18:36:37,256 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:37,256 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:37,256 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:37,256 INFO [host6-86] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:37,256 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:37,256 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:37,257 WARN End-of-file
2015-11-23 18:36:37,258 WARN End-of-file
2015-11-23 18:36:37,258 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:37,258 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:37,258 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:37,258 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:37,258 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:37,258 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:37,258 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:37,268 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:37,268 WARN End-of-file
2015-11-23 18:36:37,269 INFO [host4] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:37,269 INFO [host6] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:37,269 INFO [host5] shard2 Log status=DOWN, currentDiff=0, targetDiff=1000
2015-11-23 18:36:37,269 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:37,269 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:37,269 WARN End-of-file
2015-11-23 18:36:37,269 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:37,269 INFO [host1-81] Creating connection to 86
2015-11-23 18:36:37,269 WARN End-of-file
2015-11-23 18:36:37,269 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:37,269 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:37,269 INFO [host1-81] Socket to 86 is now operational
2015-11-23 18:36:37,269 INFO [host1-81] Slave request from 86 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:37,269 INFO [host5-85] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:37,269 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:37,269 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:37,269 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:37,269 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:37,269 INFO [host4-84] Socket created to 81 (localhost/127.0.0.1:2181)
2015-11-23 18:36:37,270 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:37,270 WARN End-of-file
2015-11-23 18:36:37,270 WARN End-of-file
2015-11-23 18:36:37,270 INFO [host1] Socket accept from /127.0.0.1
2015-11-23 18:36:37,270 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:37,270 WARN End-of-file
2015-11-23 18:36:37,270 WARN End-of-file
2015-11-23 18:36:37,270 INFO [host1-81] Socket created to 86 (localhost/127.0.0.1:2186)
2015-11-23 18:36:37,270 WARN End-of-file
2015-11-23 18:36:37,270 WARN [host1-81] Failed to create socket to 86 (localhost/127.0.0.1:2186): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:37,270 INFO [host1-81] Will retry creating the socket to 86 (localhost/127.0.0.1:2186) every 1000ms
2015-11-23 18:36:37,270 WARN End-of-file
2015-11-23 18:36:37,270 INFO [host6] Socket accept from /127.0.0.1
2015-11-23 18:36:37,271 WARN End-of-file
2015-11-23 18:36:37,271 INFO [host1-81] Creating connection to 85
2015-11-23 18:36:37,271 INFO [host1-81] Creating connection to 84
2015-11-23 18:36:37,271 INFO [host1-81] Socket to 85 is now operational
2015-11-23 18:36:37,271 INFO [host1-81] Slave request from 85 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:37,271 INFO [host1-81] Socket to 84 is now operational
2015-11-23 18:36:37,271 INFO [host1-81] Slave request from 84 rejected: not a leader (FOLLOWER)
2015-11-23 18:36:37,272 INFO [host1-81] Socket created to 85 (localhost/127.0.0.1:2185)
2015-11-23 18:36:37,272 INFO [host5] Socket accept from /127.0.0.1
2015-11-23 18:36:37,272 INFO [host1-81] Socket created to 84 (localhost/127.0.0.1:2184)
2015-11-23 18:36:37,272 INFO [host4] Socket accept from /127.0.0.1
2015-11-23 18:36:37,272 WARN [host1-81] Failed to create socket to 85 (localhost/127.0.0.1:2185): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:37,272 WARN [host1-81] Failed to create socket to 84 (localhost/127.0.0.1:2184): null
java.lang.AssertionError
at com.yahoo.gondola.impl.SocketNetwork$Hello.makeCall(SocketNetwork.java:366)
at com.yahoo.gondola.impl.SocketChannel$SocketCreator.run(SocketChannel.java:357)
2015-11-23 18:36:37,272 INFO [host1-81] Will retry creating the socket to 84 (localhost/127.0.0.1:2184) every 1000ms
2015-11-23 18:36:37,272 INFO [host1-81] Will retry creating the socket to 85 (localhost/127.0.0.1:2185) every 1000ms
2015-11-23 18:36:37,272 WARN End-of-file
2015-11-23 18:36:37,272 WARN Broken pipe
Process finished with exit code 130
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment