

If it takes you a long time to get home from work your session between your node1 and node2 could idle out and close.

Most firewalls will close down sessions that are idle too long for security measures. Use netstat command to verify that port 7777 is still up and listening for a connection coming only from our local loopback IP address. We now have an SSH tunnel created between our node1 and node2 and all that is left for us to do is to go home to our node2 and connect back to our node1, which would normally be blocked by corporate firewall. This option is useful if you just want to forward ports and not execute any commands on the remote host after you create your SSH tunnel. SSH version 2 introduced the “ -N” option which prevents execution of commands on the remote host. In this example, 10.0.0.11 is the IP address of the headnode that hosts the Livy service.You can add –v option for verbose debug mode. Service for running statements, jobs, and applications Service for connecting to Spark SQL (Thrift/JDBC) The port that clients use to connect to Zookeeper

The port that clients use to connect to ZooKeeper The port for the HBase Region server Web UI Transfers intermediate Map outputs to requesting Reducers Web API on top of HCatalog and other Hadoop services Service for connecting to Hive metadata (Thrift/JDBC) Service for connecting to Hive (Thrift/JDBC) Ambari Serviceįor application submissions (Hive, Hive server, Pig, and so on.)Īddress of the applications manager interface If you attempt to connect to the service on the primary headnode and receive an error, retry using the secondary headnode. Some services only run on one headnode at a time.

REMOTESIGHT PORT PASSWORD
The login name (default: admin) and password that were set during cluster creation The SSH user credentials specified during cluster creation See Interact with Apache Kafka clusters in Azure HDInsight using a REST proxyĪll services publicly exposed on the internet must be authenticated: Port See Use Beeline with Apache Hive on HDInsight Spark Thrift server used to submit Hive queries. See Submit Apache Spark jobs remotely using Apache Livy The following are available for specific cluster types: Service
REMOTESIGHT PORT DRIVER
See Connect to Apache Hive on HDInsight using the Hive JDBC driver See Connect Excel to HDInsight with the Microsoft ODBC driver.Ĭonnects to ApacheHive using JDBC. See Use MapReduce with CurlĬonnects to Hive using ODBC. See Manage HDInsight using the Apache Ambari REST API See Manage HDInsight using the Apache Ambari Web UIĪmbari REST API. For more information, see Use SSH with HDInsight.Īmbari web UI. For more information, see Use SSH with HDInsight.Ĭonnects clients to sshd on the secondary headnode. For more information, see Use SSH with HDInsight.Ĭonnects clients to sshd on the edge node. ServiceĬonnects clients to sshd on the primary headnode. A public gateway provides internet access to the following ports, which are common across all HDInsight cluster types. The nodes can't be directly accessed from the internet. Public portsĪll the nodes in an HDInsight cluster are located in an Azure Virtual Network. For more information, see Plan a virtual network for HDInsight. To join additional machines to the virtual network, you must create the virtual network first, and then specify it when creating your HDInsight cluster. However, you can't join other machines (such as other Azure Virtual Machines or your client development machine) to this virtual network. If you do not specify an Azure Virtual Network as a configuration option for HDInsight, one is created automatically.
