Error 1002 Unable To Store Alias
Contents |
Sign frontendexception error 1002 unable to store alias in Pricing Blog Support Search GitHub pig error 2117 This repository Watch 86 Star 376 Fork 285 Parquet/parquet-mr Code Issues pig lang 74 Pull requests 0 Projects 0 Wiki Pulse Graphs New issue "Unable to store alias C" with ParquetStorer error org.apache.pig.tools.grunt.grunt - error 1002: unable to store alias for PIG with Datetime fields #450 Open beeva-luisgonzalez opened this Issue Dec 1, 2015 · 0 comments Projects None yet Labels None yet Milestone No milestone Assignees No one assigned 1 participant beeva-luisgonzalez
Unable To Store Alias Pig
commented Dec 1, 2015 I think found a posible bug when using the parquet storer in pig! When I want to save a PIG bag with ParquetStorer that has a DateTime field I always get this error. ================================================================================ Pig Stack Trace --------------- ERROR 1002: Unable to store alias C org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias C at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1694) at org.apache.pig.PigServer.registerQuery(PigServer.java:623) at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1061) at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205) at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66) at org.apache.pig.Main.run(Main.java:560) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.UnsupportedOperationException at parquet.pig.PigSchemaConverter.convertWithName(PigSchemaConverter.java:366) at parquet.pig.PigSchemaConverter.convert(PigSchemaConverter.java:341) at parquet.pig.PigSchemaConverter.convert(PigSchemaConverter.java:378) at parquet.pig.PigSchemaConverter.convertTypes(PigSchemaConverter.java:334) at parquet.pig.PigSchemaConverter.convert(PigSchemaConverter.java:327) at parquet.pig.TupleWriteSupport.
'right_rel.txt' AS (var1, var3);=0AC =3D JOIN A B= Y var1 LEFT OUTER, B BY var1;=0AD =3D FILTER C BY $2 is null;=0ADUMP D;=0A= =0ABut when I dump D I get the error
Org.apache.pig.impl.logicallayer.frontendexception: Error 1002: Unable To Store Alias
"Unable to store alias D".=0AI suppose= there is something going wrong with the Filter unable to open iterator for alias vor null-values (is not nul= l also doesn't work).=0AWhat I want to do is to filter for the tuples in A = which do not find a Join partner in B=0AInput files are attached.=0A=0ADoes= anybody know what's going on and how to fix this?=0ABy the way, I'm using = Cloudera Distribution for Hadoop 3 Beta https://github.com/Parquet/parquet-mr/issues/450 with pig 0.5.0.=0A=0AThx in advance= ,=0AAlex=0A=0A pigfilterjoinstorealiasload asked Jun 7 2010 at 07:27 in Pig-User by Alexander Schätzle Facebook Google+ Twitter 3 Answers Offhand I think its dump faulty behavior after join combined with datatype misinterpretation, you can use store and that might work. However I would try using a foreach generate stmt after C and then filter..D = foreach C generate $0 as fvar1, $1 as fvar2, (chararray)$2 as https://qnalist.com/questions/7730/unable-to-store-alias fvar3;E = filter D by fvar3 is null;Dump E; //verify result at nullE = filter D by fvar3 is not null;Dump E; //Verify results for not nullCheers,/R answered Jun 7 2010 at 08:22 by Rekha Joshi I can reproduce this in 0.6, and it appears to have nothing to do with your data or with the DUMP operator -- a simple "explain" on D causes the same problem. Looks like there is something wrong with how the query plan gets compiled:Caused by: java.lang.NullPointerException at org.apache.pig.impl.plan.OperatorPlan.add(OperatorPlan.java:152) at org.apache.pig.impl.logicalLayer.parser.QueryParser.generateStorePlan(Query= Parser.java:128) at org.apache.pig.PigServer.store(PigServer.java:552) ... 7 moreHaven't tried on 0.7-D answered Jun 7 2010 at 17:48 by Dmitriy Ryaboy I am using Pig 0.7 w/ stock Apache Hadoop 0.20.2. Works on both local and mapreduce mode.$ pig -d WARN test.pig ... (c,x,,)$ cat left_rel.txt a x a y b x b y c x$ cat right_rel.txt a 5 a 10 b 5 b 10$ cat test.pig A = LOAD 'left_rel.txt' AS (var1, var2); B = LOAD 'right_rel.txt' AS (var1, var3); C = JOIN A BY var1 LEFT OUTER, B BY var1; D = FILTER C BY $2 is null; DUMP D;- Sandip answered Jun 8 2010 at 11:10 by Sandip Bhattacharya Related Discussions Error: Unable To Store Alias Null -
help others org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias A Stack Overflow | Krishna Kalyan | 2 years ago https://samebug.io/exceptions/118835/org.apache.pig.impl.logicalLayer.FrontendException/error-1002-unable-to-store-alias-a 1 mark Bulk loading from pig is throwing org.apache.pig.impl.logicalLayer.FrontendException? Stack Overflow | 2 years ago | Krishna Kalyan org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias A find similars org.apache.pig https://www.dezyre.com/questions/4176/pig-execution-dump-is-throwing-exception-would-you-please-help 1 0 mark Re: hadoop pig issues Google Groups | 4 years ago | Paul DeCoursey org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias raw find similars org.apache.pig unable to 0 0 mark [PARQUET-334] UT TestSummary failed with "java.lang.RuntimeException: Usage: B = FOREACH (GROUP A ALL) GENERATE Summary(A); Can not get schema from null" when Pig >=0.15 - ASF JIRA apache.org | 1 year ago org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias B find similars org.apache.pig parquet.pig.summary 0 Speed up your debug routine! Automated exception search integrated into your IDE unable to store Test Samebug Integration for IntelliJ IDEA 0 mark Defining schema only after first projection: what am I doing wrong? pig-user | 6 years ago | Marcos Medrado Rubinelli org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1000: Error during parsing. Invalid alias: associate in null find similars org.apache.pig 0 0 mark Defining schema only after first projection: what am I doing wrong? pig-user | 6 years ago | Marcos Medrado Rubinelli org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1000: Error during parsing. Invalid alias: associate in null find similars org.apache.pig 0 See more Not finding the right solution? Take a tour to get the most out of Samebug. Tired of useless tips? Automated exception search integrated into your IDE Test Samebug Integration for IntelliJ IDEA Root Cause Analysis org.apache.pig.impl.logicalLayer.FrontendException ERROR 1002: Unable to store alias A at org.apache.pig.PigServer$Graph.registerQuery() 0 similar org.apache.pig GruntParser.processPig org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1635) org.apache.pig.PigServer.registerQuery(PigServer.java:575) org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1093) 3 similar 3 frames About Us Explore Tour Blog Privacy Policy Terms Of Use ©2016 Samebug, Inc. This site uses cookies, as explained in our cookie policy. If you agree to our use of cookies, please close this message and continue to use this site. Acce
Hadoop Administration for Big Data Certificate in NoSQL Databases for Big Data Advanced MS Excel with Macro, VBA and Dashboards Blog Tutorials Online Hackathons Create personalized offers for customers base... Analysis of Community Interactions using Spar... Student Portfolios Sign In Build Projects, Learn Skills, Get Hired Request Info Learn how you can build Big Data Projects PIG Execution # DUMP is throwing exception , Would you please help? 0 Karuna grunt> dump X 2015-09-01 11:07:48,145 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: UNKNOWN 2015-09-01 11:07:48,304 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false 2015-09-01 11:07:48,329 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 1 2015-09-01 11:07:48,329 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 1 2015-09-01 11:07:48,495 [main] WARN org.apache.pig.backend.hadoop23.PigJobControl - falling back to default JobControl (not using hadoop 0.23 ?) java.lang.NoSuchFieldException: jobsInProgress at java.lang.Class.getDeclaredField(Class.java:1882) at org.apache.pig.backend.hadoop23.PigJobControl.(PigJobControl.java:58) at org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:102) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:285) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177) at org.apache.pig.PigServer.launchPlan(PigServer.java:1266) at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1251) at org.apache.pig.PigServer.storeEx(PigServer.java:933) at org.apache.pig.PigServer.store(PigServer.java:900) at org.apache.pig.PigServer.openIterator(PigServer.java:813) at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:696) at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:320) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170) at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69) at org.apache.pig.Main.run(Main.java:538) at org.apache.pig.Main.main(Main.java:157)