Docstoc

Cloudera Manager FAQ

Document Sample
Cloudera Manager FAQ Powered By Docstoc
					               Cloudera Manager Frequently Asked
               Questions




Cloudera, Inc.
210 Portage Avenue
Palo Alto, CA 94306
info@cloudera.com
US: 1-888-789-1488
Intl: 1-650-362-0488
www.cloudera.com
Important Notice
© 2010-2012 Cloudera, Inc. All rights reserved.
Cloudera, the Cloudera logo, and any other product or service names or slogans contained in this
document are trademarks of Cloudera and its suppliers or licensors, and may not be copied, imitated or
used, in whole or in part, without the prior written permission of Cloudera or the applicable trademark
holder.
Hadoop and the Hadoop elephant logo are trademarks of the Apache Software Foundation. All other
trademarks, registered trademarks, product names and company names or logos mentioned in this
document are the property of their respective owners. Reference to any products, services, processes or
other information, by trade name, trademark, manufacturer, supplier or otherwise does not constitute
or imply endorsement, sponsorship or recommendation thereof by us.
Complying with all applicable copyright laws is the responsibility of the user. Without limiting the rights
under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval
system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or
otherwise), or for any purpose, without the express written permission of Cloudera.
Cloudera may have patents, patent applications, trademarks, copyrights, or other intellectual property
rights covering subject matter in this document. Except as expressly provided in any written license
agreement from Cloudera, the furnishing of this document does not give you any license to these
patents, trademarks copyrights, or other intellectual property.
The information in this document is subject to change without notice. Cloudera shall not be liable for
any damages resulting from technical errors or omissions which may be present in this document, or
from use of this document.
Version: 3.7.3
Date: February 10, 2012
Contents
GENERAL QUESTIONS ...................................................................................................................................................1

   WHAT ARE THE DIFFERENCES BETWEEN THE FREE EDITION AND THE ENTERPRISE EDITION?........................................................... 1

   WHAT VERSION OF CDH IS REQUIRED FOR CLOUDERA MANAGER 3.7? .................................................................................... 1
   CAN I UPGRADE CDH USING CLOUDERA MANAGER? ............................................................................................................ 1

   WHAT VERSION OF CDH DOES CLOUDERA MANAGER 3.7 INSTALL?......................................................................................... 1

   WHAT UPGRADE PATHS ARE AVAILABLE FOR CLOUDERA MANAGER, AND WHAT'S INVOLVED? ....................................................... 2
   WHAT ARE THE NEW FEATURES OF CLOUDERA MANAGER 3.7 (ENTERPRISE EDITION) COMPARED TO CLOUDERA MANAGEMENT SUITE
   3.5? ............................................................................................................................................................................ 4
   CAN I USE THE SERVICE MONITORING FEATURES OF CLOUDERA MANAGER 3.7 (ENTERPRISE EDITION) WITHOUT USING THE SERVICE
   AND CONFIGURATION MANAGEMENT PIECE? ...................................................................................................................... 4

   WHAT OPERATING SYSTEMS ARE SUPPORTED? ..................................................................................................................... 4
   HOW DO I INSTALL 3.7 IN A WALLED OFF ENVIRONMENT (NO INTERNET ACCESS)?....................................................................... 4

USING CLOUDERA MANAGER .......................................................................................................................................5
   HOW DO I LOOK AT THE GENERATED CONFIGURATION FOR A PROCESS? ..................................................................................... 5

   HOW DO I SET THE RACK TOPOLOGY SCRIPT? ....................................................................................................................... 5

   HOW DO I CONFIGURE MY DAEMONS TO USE A CUSTOM GC PARAMETER? ................................................................................ 5
                                                                                    General Questions


The following FAQs apply to both the Free Edition and the Enterprise Edition of Cloudera Manager.


General Questions

What are the differences between the Free Edition and the Enterprise Edition?
Cloudera Manager Free Edition is a free version of the commercially-available Cloudera Manager
product. Cloudera Manager Free Edition automates the installation and configuration of CDH3 on an
entire cluster (up to 50 hosts). Cloudera Manager supports installation on an unlimited number of hosts
and provides additional functionality.
See the matrix at How to Upgrade the Free Edition to Cloudera Manager for a comparison of the two
versions. You can also view a discussion of the differences at http://www.cloudera.com/products-
services/tools/.
The full-featured version of Cloudera Manager is available as part of the Cloudera Enterprise
subscription offering, and requires a license.
If you are not an existing Cloudera customer, contact Cloudera Sales here for information about
obtaining the full-featured version of Cloudera Manager.
If you are already a Cloudera customer and you need to upgrade the Free Edition to Cloudera Manager,
contact Cloudera Support here to obtain a license.

What version of CDH is required for Cloudera Manager 3.7?
Cloudera Manager 3.7 has been tested with CDH3 Update 1 (cdh3u1), CDH3 Update 2 (cdh3u2) and
CDH3 Update 3 (cdh3u3). If you want to use Cloudera Manager to manage Oozie, CDH3 Update 2 or
later is required. In general, CDH3 Update 2 or 3 is strongly recommended.
See Requirements for Cloudera Manager for more detailed information.

Can I upgrade CDH using Cloudera Manager?
The Cloudera Manager upgrade wizard does not upgrade CDH. For instructions on upgrading CDH, see
Upgrading to CDH3u3 in the Cloudera Manager Free Edition Installation Guide.

What version of CDH does Cloudera Manager 3.7 install?
Cloudera Manager always installs the most recent version of CDH for a new installation. When a
subsequent new version of CDH is released, you must manually upgrade your hosts to the new release.
When you add a host to a cluster, Cloudera Manager will install the most current version, so if the
current version is newer than the version installed on the rest of the cluster, an incompatibility error will
result. To force installation of an older version of CDH, you'll need to build a local repo and point
Cloudera Manager to that, then follow the instructions for "Installation Path B" in the Enterprise version
of the Cloudera Manager Installation Guide.
For information on creating a local repo, see Creating a Local Yum Repository.


                                                       Cloudera Manager Frequently Asked Questions | 1
General Questions


The instructions for Installation Path B are here: Installation Path B - Installation Using Your Own
Method

What upgrade paths are available for Cloudera Manager, and what's involved?
There are several paths for upgrading Cloudera Manager, depending on your starting point:

Upgrade              Hadoop Down           Cloudera         Agent        Notes
                     Time                  Management       Upgrade
                                           Application
                                           Downtime

From: SCM            Not during the        N/A              Yes          Use yum update to upgrade to
Express 3.6          upgrade. Services                                   Cloudera Manager, then run the
                     must eventually                                     upgrade wizard to upgrade the
To: Cloudera         be restarted to                                     cluster.
Manager 3.7.x        take advantage of
(Free)               new features.

From: SCM            Not during the        N/A              Yes          License Required.
Express 3.6          upgrade. Services                                   Upgrade to the new server, create
                     must eventually                                     the new databases, then run the
 To: Cloudera        be restarted to                                     upgrade wizard to upgrade the
Manager 3.7.x        take advantage of                                   cluster. After you have installed the
(Enterprise)         new features.                                       Cloudera Manager Server, but have
                                                                         not yet upgraded the 3.6 Agents,
                                                                         you will still have some
                                                                         interoperability; for example
                                                                         heartbeats will be detected.

From:                Not during the        Yes              Yes          License Required.
Cloudera Manage      upgrade. Services                                   Your SCM 3.5.x data stays intact,
ment Suite 3.5.x     must eventually                                     but obtain guidance from Cloudera
                     be restarted to                                     to avoid losing some activity and
To: Cloudera         take advantage of                                   reports data.
Manager 3.7.x        new features.
                                                                         Create the new databases, upgrade
                                                                         the Server and Agents, then run the
                                                                         upgrade wizard to install, configure
                                                                         and start the 3.7.x services.




2 | Cloudera Manager Frequently Asked Questions
                                                                            General Questions


Upgrade              Hadoop Down          Cloudera      Agent     Notes
                     Time                 Management    Upgrade
                                          Application
                                          Downtime

From: Cloudera       Not during the       N/A           No        License Required.
Manager 3.7.x        upgrade. Services                            Create the new databases, enter
(Free)               must eventually                              the license key, then restart the
                     be restarted to                              server and run the upgrade wizard
To: Cloudera         take advantage of                            to upgrade the cluster.
Manager 3.7.x        new features.
(Enterprise)

From: Cloudera       No                   Yes           Yes       Stop the Cloudera Management
Manager 3.7.0                                                     Service, and the Server and Agents.
                                                                  Upgrade and restart the Server and
To: Cloudera                                                      Agents, then use Cloudera
Manager 3.7.x                                                     Manager to upgrade the tables for
                                                                  the Cloudera Management Service.

From: CDH3           Not during the       N/A           N/A       License Required.
Update 1 or later    upgrade. Must be                             Install the databases and Cloudera
with no Enterprise   restarted to                                 Manager and run the install wizard
Product ever         transition control                           to install and configure the Agents
installed            to Cloudera                                  and cluster management services.
                     Manager.                                     Import of existing cluster
To: Cloudera                                                      configuration must be done under
Manager 3.7.x                                                     Cloudera Support supervision.

 Fresh Install of    N/A                  N/A           N/A       License Required.Install the
Enterprise Edition                                                databases and Cloudera Manager
(no CDH)                                                          and run the install wizard -- it will
                                                                  push CDH packages out to all hosts.




                                                   Cloudera Manager Frequently Asked Questions | 3
General Questions


What are the new features of Cloudera Manager 3.7 (Enterprise Edition)
compared to Cloudera Management Suite 3.5?
       Service Monitoring

       Event Management
       Alerts

       Log Management
       Consolidated UI
       Support Integration
       Configuration roll back, Audit trails
       Global Time Control

       Hue and Oozie Management
       Cluster Autoconfiguration
See the blog post at http://www.cloudera.com/blog/2011/12/cloudera-manager-3-7-released/ for more
details on the new features of Cloudera Manager 3.7.

Can I use the Service Monitoring features of Cloudera Manager 3.7 (Enterprise
Edition) without using the Service and Configuration Management piece?
No. To understand the desired state of the system, we need the global configuration that the service
management feature of Cloudera Manager gathers and provides. The Cloudera Manager agent doubles
as both the agent for supervision and for monitoring.

What operating systems are supported?
The following platforms are supported:
       RHEL5/CentOS/Oracle 5, 64-bit
       RHEL6/CentOS 6, 64-bit
       SuSE/SLES 11, 64-bit, SP1 or later
        Notably, Ubuntu is not currently supported (as of Cloudera Manager 3.7.3).
See Requirements for Cloudera Manager for more detailed information.

How do I install 3.7 in a walled off environment (no Internet access)?
It is possible to do this; please contact Cloudera support for more information and guidance.




4 | Cloudera Manager Frequently Asked Questions
                                                                             Using Cloudera Manager


Using Cloudera Manager

How do I look at the generated configuration for a process?
You can see the generated configuration files through the "Role instance" page for a given role/process:
    1. Select the appropriate service under the Services tab.
    2. Click the Instances link to show all the role instances for the service.
    3. Select the role instance you want to see; this will open the Role Instance page for this role.
    4. In the Processes section of the display, click Show under the Configuration Files/Environment
       column. This displays links to all the configuration files for this service, as well as the settings of
       the relevant environment variables.

How do I set the rack topology script?
Cloudera Manager includes internal rack awareness scripts, but you must specify the racks where the
hosts in your cluster are located. If your cluster contains more than 10 hosts, Cloudera recommends that
you specify the rack for each host. HDFS and MapReduce will automatically use the racks you specify.
For instructions, see Specifying the Racks for Hosts.

How do I configure my daemons to use a custom GC parameter?
Every Java-based role in Cloudera Manager has a configuration setting called "Additional Java
configuration options for <role>" where you can enter command line options. Commonly, garbage
collection flags or extra debugging flags would be passed here.
To find the appropriate configuration setting, select the service you want to modify in the Cloudera
Manager UI, then use the keyword search to search for the Additional Java configuration options.
You can add configuration options for all instances of a given role by making this configuration change at
the Service level. For example, to modify the setting for all DataNodes, select the HDFS service, then
modify the "Additional Java configuration options for Datanode" setting).
To modify a configuration option for a given instance of a role, select the service, then select the
particular role instance (e.g. a specific DataNode) you want to modify. The configuration settings you
modify will apply to the selected role instance only.
For detailed instructions see the Changing Service Configurations section of the Cloudera Manager User
Guide.




                                                        Cloudera Manager Frequently Asked Questions | 5

				
DOCUMENT INFO
Shared By:
Stats:
views:40
posted:3/15/2012
language:Latin
pages:9