Sumanyu Sharma sumanyu
sumanyu
/ knnimpute.scala
Created
September 1, 2016 19:00
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| class KNNImpute(k: Int) { | |
| def impute(data: Array[Array[Double]]) = { | |
| checkRowsAndColumnsAreNotEntirelyNAN(data) | |
| //skip rows which are perfect | |
| for (x <- data if nrOfMissingValues(x) != 0) { | |
| val distanceBetweenXAndY = distanceBetweenRowAndAllOtherRows(data, x) | |
| } | |
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ... 4 common frames omitted | |
| Caused by: me.prettyprint.hector.api.exceptions.HectorException: [localhost(127.0.0.1):9160] All host pools marked down. Retry burden pushed out to client. | |
| at me.prettyprint.cassandra.connection.HConnectionManager.getClientFromLBPolicy(HConnectionManager.java:401) ~[hector-core-2.0-0.jar:na] | |
| at me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:232) ~[hector-core-2.0-0.jar:na] | |
| at me.prettyprint.cassandra.service.AbstractCluster.describeKeyspace(AbstractCluster.java:199) ~[hector-core-2.0-0.jar:na] | |
| at org.kairosdb.datastore.cassandra.CassandraDatastore.<init>(CassandraDatastore.java:135) ~[kairosdb-0.9.5-0.2beta.jar:0.9.5-0.2beta.20150403071141] | |
| ... 41 common frames omitted | |
| 00:02:13.749 [Thread-1] INFO [Main.java:461] - Shutting down | |
| 00:02:13.754 [Thread-1] ERROR [Main.java:300] - Shutdown exception: | |
| com.google.inject.ProvisionException: Guice provision errors: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 1078 [main] INFO io.vpsi.adapter.ICEBlockSpecsAdapter - Starting Kafka Consumer on topic .*iceblkSpecs.* | |
| finished setting up | |
| 1117 [pool-4-thread-1] DEBUG io.vpsi.adapter.ICEBlockSpecsAdapter - Reading full spec: {"name":"inactivee87a2545-e37a-4ebb-b1c2-f59a9f259405","host":"http://10.10.10.10:8080","psuBlock":[],"cacheBlock":[],"state":"Inactive"} | |
| 1351 [pool-4-thread-1] DEBUG io.vpsi.utils.RetryFunction$ - sendICEBlockSpecs to: ICEBlockSpecMessage(inactivee87a2545-e37a-4ebb-b1c2-f59a9f259405,http://10.10.10.10:8080,List(),List(),None,None,None,None,None,Some(Inactive),71aac295-06e1-4bc8-8b68-9f4967a0b25b,1429309877771) | |
| ---> HTTP GET http://10.6.22.2:8089/vps/v1/iceBlock/inactivee87a2545-e37a-4ebb-b1c2-f59a9f259405 | |
| <--- HTTP 400 http://10.6.22.2:8089/vps/v1/iceBlock/inactivee87a2545-e37a-4ebb-b1c2-f59a9f259405 (9ms) | |
| 1495 [pool-4-thread-1] DEBUG io.vpsi.utils.RetryFunction$ - Posting new ICE Block: inactivee87a2545-e37a-4ebb-b1c2-f59a9f259405 | |
| ---> HTTP POST http://10.6.22.2:8089/vps/v1/iceBlock | |
| <--- HTTP 40 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [2015-03-30 20:16:46,375] INFO Will not load MX4J, mx4j-tools.jar is not in the classpath (kafka.utils.Mx4jLoader$) | |
| [2015-03-30 20:16:46,559] INFO conflict in /brokers/ids/0 data: {"jmx_port":-1,"timestamp":"1427746606536","host":"10.6.3.2","version":1,"port":9092} stored data: {"jmx_port":-1,"timestamp":"1427746516895","host":"10.6.3.2","version":1,"port":9092} (kafka.utils.ZkUtils$) | |
| [2015-03-30 20:16:46,590] INFO I wrote this conflicted ephemeral node [{"jmx_port":-1,"timestamp":"1427746606536","host":"10.6.3.2","version":1,"port":9092}] at /brokers/ids/0 a while back in a different session, hence I will backoff for this node to be deleted by Zookeeper and retry (kafka.utils.ZkUtils$) | |
| [2015-03-30 20:16:48,012] ERROR Error handling event ZkEvent[Data of /controller changed sent to kafka.server.ZookeeperLeaderElector$LeaderChangeListener@21bbc3eb] (org.I0Itec.zkclient.ZkEventThread) | |
| java.lang.IllegalStateException: Kafka scheduler has not been started | |
| at kafka.utils.KafkaScheduler.ensureStarted(KafkaSchedule |
sumanyu
/ gist:c7b87a61d8b7f2e076d3
Created
December 3, 2014 19:54
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| java.lang.AbstractMethodError | |
| at org.json4s.DefaultFormats$class.$init$(Formats.scala:324) | |
| at org.scalatra.swagger.SwaggerSerializers$$anon$10.<init>(SwaggerSerializers.scala:149) | |
| at org.scalatra.swagger.SwaggerSerializers$.<init>(SwaggerSerializers.scala:149) | |
| at org.scalatra.swagger.SwaggerSerializers$.<clinit>(SwaggerSerializers.scala) | |
| at org.scalatra.swagger.SwaggerBase$class.jsonFormats(SwaggerBase.scala:102) | |
| at com.virtualpowersystems.specs.ResourcesApp.jsonFormats(ResourcesApp.scala:22) | |
| at org.scalatra.swagger.SwaggerBaseBase$$anonfun$renderIndex$7.apply(SwaggerBase.scala:89) | |
| at org.scalatra.swagger.SwaggerBaseBase$$anonfun$renderIndex$7.apply(SwaggerBase.scala:89) | |
| at scala.Option.map(Option.scala:145) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| super.validatePowerSource match { | |
| case Success(_) => this.successNel | |
| case f@Failure(_) => f | |
| } | |
| Attemt | |
| def singleValidation [A] (objectRef: A)(validation: ValidationNel[ValidationFailure, A]) = validation match { | |
| case Success(_)=> objectRef.successNel | |
| case f@Failure(_) => f |
sumanyu
/ kafka service
Created
November 24, 2014 18:06
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "id": "kafka-service", | |
| "kind": "Service", | |
| "apiVersion": "v1beta1", | |
| "port": 9092, | |
| "containerPort": 9092, | |
| "selector": { | |
| "name": "kafka-pod" | |
| } | |
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "id": "kafka-pod", | |
| "kind": "Pod", | |
| "apiVersion": "v1beta1", | |
| "desiredState": { | |
| "manifest": { | |
| "version": "v1beta1", | |
| "id": "kafka-pod", | |
| "containers": [{ | |
| "name": "kafka1", |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "id": "zk-service", | |
| "kind": "Service", | |
| "apiVersion": "v1beta1", | |
| "port": 2181, | |
| "containerPort": 2181, | |
| "selector": { | |
| "name": "zk-pod" | |
| } | |
| } |
sumanyu
/ zoo keeper pod
Created
November 24, 2014 18:04
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "id": "zk-pod", | |
| "kind": "Pod", | |
| "apiVersion": "v1beta1", | |
| "desiredState": { | |
| "manifest": { | |
| "version": "v1beta1", | |
| "id": "zk-pod", | |
| "containers": [ | |
| { |
NewerOlder