Hive Error Creating Transactional Connection Factory
Contents |
here for a quick overview of the site Help Center Detailed answers to spark javax.jdo.jdofatalinternalexception: error creating transactional connection factory any questions you might have Meta Discuss the workings and policies error creating transactional connection factory spark of this site About Us Learn more about Stack Overflow the company Business Learn more
Spark-shell:error Creating Transactional Connection Factory
about hiring developers or posting ads with us Stack Overflow Questions Jobs Documentation Tags Users Badges Ask Question x Dismiss Join the Stack Overflow Community Stack
Error Creating Transactional Connection Factory Datanucleus
Overflow is a community of 4.7 million programmers, just like you, helping each other. Join them; it only takes a minute: Sign up Error creating transactional connection factory during running Spark on Hive project in IDEA up vote 6 down vote favorite I am trying to setup a develop environment for class org datanucleus api jdo jdopersistencemanagerfactory was not found a Spark Streaming project which requires write data into Hive. I have a cluster with 1 master, 2 slaves and 1 develop machine (coding in Intellij Idea 14). Within the spark shell, everything seems working fine and I am able to store data into default database in Hive via Spark 1.5 using DataFrame.write.insertInto("testtable") However when creating a scala project in IDEA and run it using same cluster with same setting, Error was thrown when creating transactional connection factory in the metastore database which suppose to be "metastore_db" in mysql. Here's the hive-site.xml:
here for a quick overview of the site Help Center Detailed answers to any questions you might have
The Specified Datastore Driver ("com.mysql.jdbc.driver") Was Not Found In The Classpath
Meta Discuss the workings and policies of this site About Us javax.jdo.jdofatalinternalexception: unexpected exception caught Learn more about Stack Overflow the company Business Learn more about hiring developers or posting ads with could not connect to meta store using any of the uris provided us Stack Overflow Questions Jobs Documentation Tags Users Badges Ask Question x Dismiss Join the Stack Overflow Community Stack Overflow is a community of 4.7 million programmers, just http://stackoverflow.com/questions/32730731/error-creating-transactional-connection-factory-during-running-spark-on-hive-pro like you, helping each other. Join them; it only takes a minute: Sign up Error while creating tables on Hive up vote 0 down vote favorite I created this table in Hive: hive> CREATE TABLE twitter_data(datePosted TIMESTAMP , userId BIGINT , userName STRING , tweets STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'; But it displays this http://stackoverflow.com/questions/14643954/error-while-creating-tables-on-hive error message: FAILED: Error in metadata: javax.jdo.JDOFatalInternalException: Error creating transactional connection factory NestedThrowables: java.lang.reflect.InvocationTargetException FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask Does anyone know what this error message means? hadoop hive share|improve this question edited Sep 19 '15 at 1:54 spenibus 3,328111526 asked Feb 1 '13 at 10:11 Sherry Leann 11 what is the version of hive you are using? –WR10 Feb 1 '13 at 12:19 A similar issue is discussed here: stackoverflow.com/questions/6853445/hive-doesnt-work-on-install –Lorand Bendig Feb 3 '13 at 11:08 add a comment| 1 Answer 1 active oldest votes up vote 0 down vote I recently met with this problem and the issue was related to the Hive JDBC driver which was not available to the client while making the request to Hive. This is what I did to solve my problem: I did verify that I do have the Hive JDBC connector installed in my cluster I modified the following settings in hive-site.xml correctly depending on my local settings:
help others javax.jdo.JDOFatalInternalException: https://samebug.io/exceptions/493583/javax.jdo.JDOFatalInternalException/error-creating-transactional-connection-factory?soft=false Error creating transactional connection factory Stack Overflow | Shirui https://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/Spark-sql-with-existing-Hive-table/td-p/29333 Tang | 1 year ago 0 mark Error creating transactional connection factory during running Spark on Hive project in IDEA Stack Overflow | 1 year ago | Shirui Tang javax.jdo.JDOFatalInternalException: Error creating transactional connection factory find similars error creating DataNucleus JDO API plugin Java RT JDO API Java RT JDO API 0 0 mark Spark submit on yarn-cluster - Hive error Stack Overflow | 6 months ago | Ankit javax.jdo.JDOFatalInternalException: Error creating transactional connection factory find similars DataNucleus JDO API plugin Java RT JDO API Java error creating transactional RT JDO API 0 0 mark Spark submit - yarn-cluster giving derby exception - Hortonworks hortonworks.com | 2 months ago javax.jdo.JDOFatalInternalException: Error creating transactional connection factory find similars DataNucleus JDO API plugin Java RT JDO API Java RT JDO API 0 Speed up your debug routine! Automated exception search integrated into your IDE Test Samebug Integration for IntelliJ IDEA 0 mark GitHub comment 141#157620830 GitHub | 11 months ago | jerryivanhoe javax.jdo.JDOFatalInternalException: Error creating transactional connection factory find similars DataNucleus JDO API plugin Java RT 0 Root Cause Analysis javax.jdo.JDOFatalInternalException Error creating transactional connection factory at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException() 0 similar DataNucleus JDO API plugin JDOPersistenceManagerFactory.getPersistenceManagerFactory org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587) org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788) org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) 7 similar 4 frames Java RT Method.invoke sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) 10 similar 4 frames JDO API JDOHelper$16.run javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) 9 similar 1 frame Java RT AccessController.doPrivileged java.security.AccessController.do
Portal Partners Developers Community Community CommunityCategoryBoardKnowledge BaseUsers turn on suggestions Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type. Showing results for Search instead for Do you mean Browse Cloudera Community News News & Announcements Getting Started Hadoop 101 Beta Releases Configuring and Managing Cloudera Manager Cloudera Director CDH Topics (w/o CM) Using the Platform Batch (MR, YARN, Oozie) Data Ingest (Sqoop, Flume... Storage (HDFS, HBase... Hue Hive Impala Data Science Search (SolrCloud) Spark Cloudera Labs Data Management Data Discovery, Optimization Security/Sentry Building on the Platform Kite SDK Suggestions Off Topic and Suggestions Cloudera AMA Cloudera Community : Using the Platform : Spark : Spark sql with existing Hive table Register · Sign In · Help Reply Topic Options Subscribe to RSS Feed Mark Topic as New Mark Topic as Read Float this Topic to the Top Bookmark Subscribe Printer Friendly Page « Topic Listing « Previous Topic Next Topic » buntu Expert Contributor Posts: 121 Registered: 07-21-2014 Spark sql with existing Hive table Options Mark as New Bookmark Subscribe Subscribe to RSS Feed Highlight Print Email to a Friend Report Inappropriate Content 07-07-2015 06:21 AM I'm just attempting to use the existing Hive tables using HiveContext in spark-shell (on CDH 5.4.2) but keep running into these errors when I run: sqlContext.sql("show tables")~~~~java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:472) at org.apache.spark.sql.hive.HiveContext.sessionState$lzycompute(HiveContext.scala:229) at org.apache.spark.sql.hive.HiveContext.sessionState(HiveContext.scala:225) at org.apache.spark.sql.hive.HiveContext.hiveconf$lzycompute(HiveContext.scala:241) at org.apache.spark.sql.hive.HiveContext.hiveconf(HiveContext.scala:240) at org.apache.spark.sql.hive.HiveContext.sql(HiveContext.scala:86) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.