How Do I Connect to Spark Shell from MRS?

  1. Log in to the Master node in the cluster as user root.
  2. Run the following command to configure environment variables:

    source Client installation directory/bigdata_env

  3. If Kerberos authentication is enabled for the cluster, authenticate the user. If Kerberos authentication is disabled, skip this step.

    Command: kinit MRS cluster user

    Example:

    • If the user is a machine-machine user, run kinit -kt user.keytab sparkuser.
    • If the user is a human-machine user, run kinit sparkuser.
  4. Run the following command to connect to Spark shell:

    spark-shell

Parent topic: Big Data Service Development