Skip to content

Instantly share code, notes, and snippets.

View M2shad0w's full-sized avatar
🎯
Focusing

Deyong Zhu M2shad0w

🎯
Focusing
52 followers · 94 following
View GitHub Profile
@M2shad0w
M2shad0w / 升级npm 和node的shell 命令
Created December 18, 2015 06:03 — forked from apprentice1988/升级npm 和node的shell 命令
升级 npm 和 node 版本
sudo npm update npm -g
sudo npm cache clean -f
sudo npm install -g n
sudo n stable
@M2shad0w
M2shad0w / gist:e225d20a051eff23dff3
Created December 28, 2015 06:00 — forked from jimbojsb/gist:1630790
Code highlighting for Keynote presentations

Step 0:

Get Homebrew installed on your mac if you don't already have it

Step 1:

Install highlight. "brew install highlight". (This brings down Lua and Boost as well)

Step 2:

@M2shad0w
M2shad0w / test_pyspark.ipynb
Created January 22, 2016 10:47
notebook pyspark
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@M2shad0w
M2shad0w / txt
Created January 30, 2016 17:08
build_crosstools-ng_error
This file has been truncated, but you can view the full file.
[INFO ] Performing some trivial sanity checks
[DEBUG] Testing '! ( -n )'
[DEBUG] Testing '! ( -n )'
[DEBUG] Testing '! ( -n )'
[DEBUG] Testing '! ( -n )'
[DEBUG] Testing '! ( -n )'
[DEBUG] Testing '! ( -n )'
[DEBUG] ==> Executing: 'mkdir' '-p' '/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build'
[DEBUG] ==> Executing: 'rm' '-f' '/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/backtrace'
[DEBUG] ==> Executing: 'touch' '/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/foo'
@M2shad0w
M2shad0w / config.log
Created February 2, 2016 06:41
esp 8266 crosstool-ng config log
This file contains any messages produced by compilers while
running configure, to aid debugging if configure makes a mistake.
It was created by GNU C Runtime Library configure 1.0, which was
generated by GNU Autoconf 2.64. Invocation command line was
$ /Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/src/gcc-4.8.2/libgcc/configure --cache-file=./config.cache --with-cross-host=x86_64-build_apple-darwin15.2.0 --prefix=/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/xtensa-lx106-elf/buildtools --with-local-prefix=/Volumes/esp-open-sdk/esp-open-sdk/xtensa-lx106-elf/xtensa-lx106-elf/sysroot --with-sysroot=/Volumes/esp-open-sdk/esp-open-sdk/xtensa-lx106-elf/xtensa-lx106-elf/sysroot --with-newlib --enable-threads=no --disable-shared --with-pkgversion=crosstool-NG 1.20.0 --disable-__cxa_atexit --with-isl=/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/xtensa-lx106-elf/buildtools --with-libelf=/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/xtensa-lx106-elf/buildtools --enable-lto --ena
@M2shad0w
M2shad0w / spark_package$TreeNodeException: execute
Created February 2, 2016 06:55
spark sql error
Caused by: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree:
TungstenExchange hashpartitioning(additional#3,200), None
+- TungstenAggregate(key=[additional#3], functions=[(count(additional#3),mode=Partial,isDistinct=false)], output=[additional#3,count#81L])
+- Project [additional#3]
+- Filter (((created_at#0 >= 2016-01-25) && (created_at#0 < 2016-01-26)) && (action#2 = search))
+- InMemoryColumnarTableScan [additional#3,created_at#0,action#2], [(created_at#0 >= 2016-01-25),(created_at#0 < 2016-01-26),(action#2 = search)], InMemoryRelation [created_at#0,eventable_type#1,action#2,additional#3,track_id#4,device#5,city_code#6], true, 10000, StorageLevel(true, true, false, true, 1), ConvertToUnsafe, Some(tracklogs)
at org.apache.spark.sql.catalyst.errors.package$.attachTree(package.scala:49)
@M2shad0w
M2shad0w / config_test_log.txt
Created February 3, 2016 02:14
config test log
Reading specs from /Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/xtensa-lx106-elf/build/build-cc-core-pass-2/./gcc/specs
COLLECT_GCC=/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/xtensa-lx106-elf/build/build-cc-core-pass-2/./gcc/xgcc
Target: xtensa-lx106-elf
Configured with: /Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/src/gcc-4.8.2/configure --build=x86_64-build_apple-darwin15.2.0 --host=x86_64-build_apple-darwin15.2.0 --target=xtensa-lx106-elf --prefix=/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/xtensa-lx106-elf/buildtools --with-local-prefix=/Volumes/esp-open-sdk/esp-open-sdk/xtensa-lx106-elf/xtensa-lx106-elf/sysroot --disable-libmudflap --with-sysroot=/Volumes/esp-open-sdk/esp-open-sdk/xtensa-lx106-elf/xtensa-lx106-elf/sysroot --with-newlib --enable-threads=no --disable-shared --with-pkgversion='crosstool-NG 1.20.0' --disable-__cxa_atexit --with-gmp=/Volumes/esp-open-sdk/esp-open-sdk/crosstool-NG/.build/xtensa-lx106-elf/buildtools --with-mpfr=/Volumes/esp-open-sdk/es
@M2shad0w
M2shad0w / zeppelin-emr-bootstrap-action.sh
Created May 27, 2016 01:47 — forked from snowindy/zeppelin-emr-bootstrap-action.sh
This is bootstrap action script for Amazon EMR helping installing Apache Zeppelin to work with Apache Spark. Works fine with [EMR Release label:emr-4.0.0 Hadoop distribution:Amazon 2.6.0 Applications:Hive 1.0.0, Spark 1.4.1]
#!/bin/bash
#Zeppelin installation on Spark EMR cluster
sudo yum update -y
sudo yum install -y git
# Installing maven: https://gist.github.com/sebsto/19b99f1fa1f32cae5d00
sudo wget http://repos.fedorapeople.org/repos/dchen/apache-maven/epel-apache-maven.repo -O /etc/yum.repos.d/epel-apache-maven.repo
sudo sed -i s/\$releasever/6/g /etc/yum.repos.d/epel-apache-maven.repo
sudo yum install -y apache-maven
@M2shad0w
M2shad0w / build.sbt
Created July 9, 2016 08:33 — forked from mumoshu/build.sbt
DES and AES encryption in Scala
name := "DES and AES encryption in Scala"
version := "1.0"
scalaVersion := "2.9.1"
libraryDependencies += "commons-codec" % "commons-codec" % "1.6"
@M2shad0w
M2shad0w / flume-tail-log
Created July 21, 2016 05:32
flume数据传输到Avro sink
# Define source, channel, sink
agent1.sources = r1
agent1.channels = ch2
agent1.sinks = avro-sink1
# Configure channel
agent1.channels.ch2.type = file
agent1.channels.ch2.capacity = 1000000
agent1.channels.ch2.transactionCapacity = 500000