2015년 1월 10일 토요일

[cdh-user] Re: RuntimeException running the hdfs command (core-site.xml not found)

I had the same problem.  When I try 'hadoop fs -ls /', the java runtime error occurs 'cannot find core-site.xml'.  Yet I could access the hdfs via text browser elinks.

Weirdly enough a restart of the machine the next day solved the issue. I was playing around with hadoop and spark classpaths mainly for slf4j purposes and I'm guessing some link change messed up the hadoop configuration.  It returned back to normal now, everything running 'smoothly'.


On Thursday, 29 May 2014 08:45:58 UTC+1, Manish wrote:
Yes, I checked /etc/hadoop/conf/ configuration. 

Directory contains container-executor.cfg, core-site.xml, hadoop-env.sh, hdfs-site.xml, log4j.properties, mapred-site.xml, and taskcontroller.cfg configuration files.

In core-site.xml contains correct path for HDFS:

<property>
    <name>fs.defaultFS</name>
    <value>hdfs://------:8020</value>
  </property>

I have deployed the client configuration also from CM UI but still same error.

On Thursday, May 29, 2014 12:53:06 PM UTC+5:30, Harsh J wrote:
Can you please check if your /etc/hadoop/conf/ carries all cluster
configs, with proper contents? If not, can you perform a Deploy Client
Configuration from the CM UI?

On Thu, May 29, 2014 at 12:49 PM, Manish Verma <manis...@gmail.com> wrote:
> I have installed via automated installation.
>
> All component works fine, if i will run HDFS command in terminal throws an
> error regarding core-site.xml not found.
>
>
> On Thursday, May 29, 2014 11:43:25 AM UTC+5:30, Rinku Garg wrote:
>>
>> How did you installed via automated installation or manual installation?
>> Please share complte logs.
>>
>> Thanks
>> Rinku Garg
>>
>>
>> On Thu, May 29, 2014 at 11:03 AM, Manish Verma <manis...@gmail.com> wrote:
>>>
>>> I am also facing same problem.
>>>
>>> After running the command, following is the error message:
>>>
>>> Exception in thread "main" java.lang.RuntimeException: core-site.xml not
>>> found
>>> at
>>> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2257)
>>> at
>>> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
>>> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
>>> at org.apache.hadoop.conf.Configuration.set(Configuration.java:979)
>>> at org.apache.hadoop.conf.Configuration.set(Configuration.java:953)
>>> at
>>> org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1289)
>>> at
>>> org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:320)
>>> at
>>> org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:478)
>>> at
>>> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:171)
>>> at
>>> org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:154)
>>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)
>>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>>> at org.apache.hadoop.fs.FsShell.main(FsShell.java:308)
>>>
>>>
>>> On Wednesday, April 23, 2014 2:19:30 AM UTC+5:30,jlwi...@gmail.com
>>> wrote:
>>>>
>>>> Just installed CDH 5.  Install went fine.  Console looks good.  But,
>>>> when I run the hdfs command I get the following:
>>>>
>>>> ...RuntimeException: core-site.xml not found.
>>>>
>>>>
>>>> Any ideas?
>>>>
>>>>
>>>> Thanks,
>>>> Jim
>>>
>>> --
>>>
>>> ---
>>> You received this message because you are subscribed to the Google Groups
>>> "CDH Users" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an
>>> email to cdh-user+u...@cloudera.org.
>>>
>>> For more options, visit
>>> https://groups.google.com/a/cloudera.org/d/optout.
>> 



댓글 없음:

댓글 쓰기