Hey out there! Still not tired of my Hadoop experiments? Not yet? That’s another one for you! What’d you think the difference is between two snippets of code? Say, this: … and this: No difference, you say? Not quite right, sir: the difference is that whatever you do to (and I spent a couple of hours trying to understand why distributed cache works properly in one app and doesn’t work at all in another). So you know now. Be warned.SomeCodeWhichChangesConfig.initialise(getConf());
Job job = new Job(conf, "MyHadoopJob");
// ... setting the job details if (!job.waitForCompletion(true))
{
System.err.println("FAILED, cannot continue");
} Job job = new Job(conf, "MyHadoopJob");
// ... setting the job details SomeCodeWhichChangesConfig.initialise(getConf());
if (!job.waitForCompletion(true))
{
System.err.println("FAILED, cannot continue");
} conf after creating a job will have no further effect. That is, Job constructor apparently copies all the data and doesn’t link your copy of Configuration object with it’s copy. Brilliant, no?
One of the reasons I love Rev3 so much is because of the diversity of their shows. This is a prime example. Can't miss my weekly fix of scam school. Genius.
Really enjoyed this episode of Digg Dialogg. Tony Hawk is such a genuine beast!
http://crave.cnet.co.uk/cnetuk/crave/gadgets/0,39029552,49303764,00.htm
Exactement ce qu'il me faut, et j'en connais d'autres pour lesquels ce sera utile !