Skip to main content

Cloudera Distribution Hadoop (CDH)

Following Manually Install JuiceFS Java Client, and then change the configuration of the components:

  • Hadoop

    CDH 5.x

    Modify core-site.xml in the ClouderaManager:

    Configuration detail at Parameter Configuration.

    CDH 6.x and above(CDP included)

    In addition to the above for 5.x version. You also need to add the following path to mapreduce.application.classpath at YARN service interface:

    $HADOOP_COMMON_HOME/lib/juicefs-hadoop.jar
    $HADOOP_COMMON_HOME/lib/tools.jar
  • HBase

    Modify hbase-site.xml at HBase service interface:

    Add the following lines:

    <property>
    <name>hbase.rootdir</name>
    <value>jfs://{JFS_NAME}/hbase</value>
    </property>
    <property>
    <name>hbase.wal.dir</name>
    <value>hdfs://your-hdfs-uri/hbase-wal</value>
    </property>

    Delete znode(default /hbase) zookeeper.znode.parent

    Notice:this operation will empty HBase data

  • Hive

    Modify hive.metastore.warehouse.dir at Hive service interface,change the default location for table creation in Hive(optional):

    jfs://your-jfs-name/your-warehouse-dir
  • Impala

    Modify Impala Commandline Advanced Configuration at Impala service interface.

    For increase the number of I/O threads, you could change the following parameter as 20/Number-of-Mounted-Disks.

    -num_io_threads_per_rotational_disk=4
  • Solr

    Modify Solr Advanced COnfiguration Code Snippets at Solr service interface:

    hdfs_data_dir=jfs://your-jfs/solr

Finally, restart the cluster to take effect changes.