blinsay

Do you really want to exit ([y]/n)? y
^CError in atexit._run_exitfuncs:
Traceback (most recent call last):
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/atexit.py", line 24, in _run_exitfuncs
    func(*targs, **kargs)
  File "/Library/Python/2.6/site-packages/IPython/core/history.py", line 498, in stop
    self.join()
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/threading.py", line 634, in join
    self.__block.wait()
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/threading.py", line 237, in wait

blinsay

$ ant
Buildfile: /Users/benl/Projects/python/pycascading/java/build.xml

init:
    [mkdir] Created dir: /Users/benl/Projects/python/pycascading/build/classes

compile:
     [echo] Cascading version: ${cascading.release.major}.${cascading.release.minor}
    [javac] /Users/benl/Projects/python/pycascading/java/build.xml:64: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
    [javac] Compiling 19 source files to /Users/benl/Projects/python/pycascading/build/classes

blinsay

$ ant -Dcascading.release.major=2.0 -Dcascading.release.minor=0
Buildfile: /Users/benl/Projects/python/pycascading/java/build.xml

init:

compile:
     [echo] Cascading version: 2.0.0
    [javac] /Users/benl/Projects/python/pycascading/java/build.xml:64: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
    [javac] Compiling 15 source files to /Users/benl/Projects/python/pycascading/build/classes
    [javac] /Users/benl/Projects/python/pycascading/java/src/com/twitter/pycascading/MetaScheme.java:45: com.twitter.pycascading.MetaScheme is not abstract and does not override abstract method sink(cascading.flow.FlowProcess,cascading.scheme.SinkCall) in cascading.scheme.Scheme

blinsay

$ git diff build.xml 
diff --git a/java/build.xml b/java/build.xml
index 8aed339..519a84f 100644
--- a/java/build.xml
+++ b/java/build.xml
@@ -38,7 +38,7 @@
        <path id="java.classpath">
         <pathelement location="${build.classes}"/>
                <path>
-                   <fileset dir="${cascading.home}" includes="cascading-core-*.jar" />

blinsay

$ ../local_run.sh word_count.py 
*** this cp: ['/Users/benl/Projects/python/pycascading/python/pycascading', '/Users/benl/Projects/python/pycascading/python', '/usr/local/Cellar/jython/2.5.2/libexec/Lib', '__classpath__', '__pyclasspath__/', '/usr/local/Cellar/jython/2.5.2/libexec/Lib/site-packages', u'/usr/local/cascading-2.0.0-wip-262-hadoop-0.20.2+/cascading-core-2.0.0-wip-262.jar', u'/usr/local/cascading-2.0.0-wip-262-hadoop-0.20.2+/cascading-hadoop-2.0.0-wip-262.jar', '.', u'/usr/local', u'/usr/local/python', u'/usr/local/python/Lib']
Traceback (most recent call last):
  File "../python/pycascading/bootstrap.py", line 83, in <module>
    m = imp.load_source('main', sys.argv[2])
  File "word_count.py", line 22, in <module>
    from pycascading.helpers import *
  File "/Users/benl/Projects/python/pycascading/python/pycascading/helpers.py", line 32, in <module>
    from pycascading.decorators import *
  File "/Users/benl/Projects/python/pycascading/python/pycascading/decorators.py", line 57, in <module>

blinsay

import java.io.IOException;

import org.junit.Test;

import cascading.PlatformTestCase;
import cascading.flow.Flow;
import cascading.flow.FlowDef;
import cascading.pipe.HashJoin;
import cascading.pipe.Merge;
import cascading.pipe.Pipe;

blinsay

  1) Error:
test_create_union(TC_Aggregations):
NameError: no constructorfor arguments (cascading.flow.Scope) on Java::CascadingFlowPlanner::Scope
  available overloads:
    (java.lang.String)
    (cascading.tuple.Fields)
    (cascading.flow.planner.Scope)
    /Users/benl/Projects/cascading.jruby/lib/cascading/scope.rb:10:in `copy'
    /Users/benl/Projects/cascading.jruby/lib/cascading/assembly.rb:25:in `initialize'
    /Users/benl/Projects/cascading.jruby/lib/cascading/assembly.rb:206:in `branch'

blinsay

benl@bivalve: jading$ hadoop jar jade.jar com.etsy.jading.Main fuckery.rb
Warning: $HADOOP_HOME is deprecated.

Aug 1, 2012 6:34:39 PM com.etsy.jading.Main run
INFO: Main.run() properties:
Aug 1, 2012 6:34:40 PM com.etsy.jading.Main run
INFO: JRUBY_HOME set to: /Users/benl/.rvm/rubies/jruby-1.6.5.1/
Aug 1, 2012 6:34:40 PM com.etsy.jading.Main run
INFO: cascading.jruby script ARGV:
Aug 1, 2012 6:34:41 PM com.etsy.jading.Main run

blinsay

benl@bivalve: jading$ ./jade -g json -g jruby-openssl -l /Users/benl/Projects/cascading.jruby/sandbox/lib /Users/benl/Projects/cascading.jruby/sandbox/{fuckery,sleep,external}.rb && yes | gem uninstall cascading.jruby
Ivy dependencies already resolved
Buildfile: /Users/benl/Projects/jading/build.xml
     [echo] Resolved?: true

download-ivy:

init-ivy:

retrieve-ivy:

blinsay

>>> {k2:{k1: d[k1][k2]} for k1 in d for k2 in d[k1]}
 {'numbers': {'this': {'one': 1, 'two': 2}}}