hadoop - Apache Pig - ERROR 6007: Unable to check name -


i'm trying run bare bones basic script in pig tutorial (http://pig.apache.org/docs/r0.11.1/start.html#pig-scripts) looks this:

/* myscript.pig script simple. includes 3 pig latin statements. */  = load 'student' using pigstorage() (name:chararray, age:int, gpa:float); -- loading data b = foreach generate name;  -- transforming data dump b;  -- retrieving results

output:

2013-05-13 15:26:55,864 [main] error org.apache.pig.tools.grunt.grunt - error 6007: unable check name hdfs://stage-hadoop101.cluster:8020/user/myusername details @ logfile: /volumes/nimue/environment/pig-0.11.1/pig_1368473213767.log macbook-3:pig myusername$ cat /volumes/nimue/environment/pig-0.11.1/pig_1368473213767.log

this results in:

pig stack trace --------------- error 6007: unable check name hdfs://stage-hadoop101.cluster:8020/user/myusername  org.apache.pig.impl.logicallayer.frontendexception: error 1000: error during parsing. unable check name hdfs://stage-hadoop101.cluster:8020/user/myusername     @ org.apache.pig.pigserver$graph.parsequery(pigserver.java:1607)     @ org.apache.pig.pigserver$graph.registerquery(pigserver.java:1546)     @ org.apache.pig.pigserver.registerquery(pigserver.java:516)     @ org.apache.pig.tools.grunt.gruntparser.processpig(gruntparser.java:991)     @ org.apache.pig.tools.pigscript.parser.pigscriptparser.parse(pigscriptparser.java:412)     @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:194)     @ org.apache.pig.tools.grunt.gruntparser.parsestoponerror(gruntparser.java:170)     @ org.apache.pig.tools.grunt.grunt.exec(grunt.java:84)     @ org.apache.pig.main.run(main.java:604)     @ org.apache.pig.main.main(main.java:157)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:39)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:25)     @ java.lang.reflect.method.invoke(method.java:597)     @ org.apache.hadoop.util.runjar.main(runjar.java:212) caused by: failed parse: pig script failed parse:  <file test/myscript.pig, line 6, column 4> pig script failed validate: org.apache.pig.backend.datastorage.datastorageexception: error 6007: unable check name hdfs://stage-hadoop101.cluster:8020/user/myusername     @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:191)     @ org.apache.pig.pigserver$graph.parsequery(pigserver.java:1599)     ... 14 more caused by:  <file test/myscript.pig, line 6, column 4> pig script failed validate: org.apache.pig.backend.datastorage.datastorageexception: error 6007: unable check name hdfs://stage-hadoop101.cluster:8020/user/myusername     @ org.apache.pig.parser.logicalplanbuilder.buildloadop(logicalplanbuilder.java:835)     @ org.apache.pig.parser.logicalplangenerator.load_clause(logicalplangenerator.java:3236)     @ org.apache.pig.parser.logicalplangenerator.op_clause(logicalplangenerator.java:1315)     @ org.apache.pig.parser.logicalplangenerator.general_statement(logicalplangenerator.java:799)     @ org.apache.pig.parser.logicalplangenerator.statement(logicalplangenerator.java:517)     @ org.apache.pig.parser.logicalplangenerator.query(logicalplangenerator.java:392)     @ org.apache.pig.parser.queryparserdriver.parse(queryparserdriver.java:184)     ... 15 more caused by: org.apache.pig.backend.datastorage.datastorageexception: error 6007: unable check name hdfs://stage-hadoop101.cluster:8020/user/myusername     @ org.apache.pig.backend.hadoop.datastorage.hdatastorage.iscontainer(hdatastorage.java:207)     @ org.apache.pig.backend.hadoop.datastorage.hdatastorage.aselement(hdatastorage.java:128)     @ org.apache.pig.backend.hadoop.datastorage.hdatastorage.aselement(hdatastorage.java:138)     @ org.apache.pig.parser.queryparserutils.getcurrentdir(queryparserutils.java:91)     @ org.apache.pig.parser.logicalplanbuilder.buildloadop(logicalplanbuilder.java:827)     ... 21 more caused by: java.io.ioexception: failed on local exception: com.google.protobuf.invalidprotocolbufferexception: message missing required fields: callid, status; host details : local host is: "macbook-3.local/192.168.2.2"; destination host is: "stage-hadoop101.cluster":8020;      @ org.apache.hadoop.net.netutils.wrapexception(netutils.java:761)     @ org.apache.hadoop.ipc.client.call(client.java:1239)     @ org.apache.hadoop.ipc.protobufrpcengine$invoker.invoke(protobufrpcengine.java:202)     @ com.sun.proxy.$proxy9.getfileinfo(unknown source)     @ sun.reflect.nativemethodaccessorimpl.invoke0(native method)     @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:39)     @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:25)     @ java.lang.reflect.method.invoke(method.java:597)     @ org.apache.hadoop.io.retry.retryinvocationhandler.invokemethod(retryinvocationhandler.java:164)     @ org.apache.hadoop.io.retry.retryinvocationhandler.invoke(retryinvocationhandler.java:83)     @ com.sun.proxy.$proxy9.getfileinfo(unknown source)     @ org.apache.hadoop.hdfs.protocolpb.clientnamenodeprotocoltranslatorpb.getfileinfo(clientnamenodeprotocoltranslatorpb.java:630)     @ org.apache.hadoop.hdfs.dfsclient.getfileinfo(dfsclient.java:1559)     @ org.apache.hadoop.hdfs.distributedfilesystem.getfilestatus(distributedfilesystem.java:811)     @ org.apache.hadoop.fs.filesystem.exists(filesystem.java:1345)     @ org.apache.pig.backend.hadoop.datastorage.hdatastorage.iscontainer(hdatastorage.java:200)     ... 25 more caused by: com.google.protobuf.invalidprotocolbufferexception: message missing required fields: callid, status     @ com.google.protobuf.uninitializedmessageexception.asinvalidprotocolbufferexception(uninitializedmessageexception.java:81)     @ org.apache.hadoop.ipc.protobuf.rpcpayloadheaderprotos$rpcresponseheaderproto$builder.buildparsed(rpcpayloadheaderprotos.java:1094)     @ org.apache.hadoop.ipc.protobuf.rpcpayloadheaderprotos$rpcresponseheaderproto$builder.access$1300(rpcpayloadheaderprotos.java:1028)     @ org.apache.hadoop.ipc.protobuf.rpcpayloadheaderprotos$rpcresponseheaderproto.parsedelimitedfrom(rpcpayloadheaderprotos.java:986)     @ org.apache.hadoop.ipc.client$connection.receiveresponse(client.java:946)     @ org.apache.hadoop.ipc.client$connection.run(client.java:844)

searching on unable check name , invalidprotocolbufferexception: message missing required fields turned nothing.

if starting off pig, suggest run script in local mode first. 

 pig -x local myscript.pig

if want run in mapreduce mode, make sure you've followed mapreduce mode instructions first.


Comments

Post a Comment

Popular posts from this blog

php - cannot display multiple markers in google maps v3 from traceroute result -

i'm newbie in php mysql , google maps v3. have problems in google maps v3. made traceroute web based , map traceroute's result in google maps v3 final project of college education. have try many tutorials didn't work. have tried tutorials in forum nothing worked. problem cannot display multiple markers got location data database. maybe because i'm newbie , not know how do. confuse looping show markers. here code <?php error_reporting(e_all ^ (e_notice)); ini_set('max_execution_time', 360); $enable_log_user = false; global $ip, $host_name, $host_ip; $host = @$_post['host']; $trace = @$_post['trace']; $self = $_server['php_self']; include("phpsqlajax_dbinfo.php"); $connection = mysql_connect ('127.0.0.1', $username, $password); if (!$connection) { die('not connected : ' . mysql_error());} $db_selected = mysql_select_db($database, $connection); if (!$db_selected) { die ('can\'t use db : ...
Read more

c# - DetailsView in ASP.Net - How to add another column on the side/add a control in each row? -

i have detailsview control on page used edit various fields of record, works in respect. i looking way add 1 column (and if works, why not more) right, absolutely read-only, show same fields of record comparison purposes. i aware there no obvious way such thing out of box detailsview . have looked other controls (transposed gridview , recommended formview , listview ), nothing satisfies. have special data binding setup using detailsview , can't out of without losing features. anyone on how "hack in" additional columns (for display only) on detailsview ? the solution have now, use second detailsview , visible set false in aspx. in code, make sure databind hidden detailsview hosts data third column first, initial detailsview named itemdetails . and in item created event, pass third column html rendering of hidden controls (in last code block) : protected void itemdetails_itemcreated(object sender, eventargs e) { if (dataite...
Read more

javascript - firefox memory leak -

i have following script (i use raphaeljs also) draws circle, waits 1 second, draws circle again, etc (you can copy paste - functional, need include raphael raphaeljs.com): <div id="holder"> </div> <script src="raphael.js" type="text/javascript"></script> <script> var paper = raphael(10, 50, 320, 200); var rad = math.pi / 180; var finangle = 0; function sector(cx, cy, r, startangle, endangle, params) { var x1 = cx + r * math.cos(-startangle * rad), x2 = cx + r * math.cos(-endangle * rad), y1 = cy + r * math.sin(-startangle * rad), y2 = cy + r * math.sin(-endangle * rad); return ["m", cx, cy, "l", x1, y1, "a", r, r, 0, +(endangle - startangle > 180), 0, x2, y2]; } var path = sector(100,100,50,0,180); var arc = paper.path(path); function draw() { path = sector(100,100,50,0,finangle); ...
Read more