Updates from March, 2015 Toggle Comment Threads | Keyboard Shortcuts

  • arjunmantri 3:34 am on March 17, 2015 Permalink | Reply  

    gRPC – Some Thoughts 


    Google recently released gRPC, an Open Source framework for handling remote procedure calls. The announcement is timely due to several reasons, some of which include the rise of IoT (and the need for small/tight/less resource hungry protocols), the announcement of HTTP/2 standard and a current favorite topic among developers : microservices.

    I am definitely excited at the announcement and did devote some time to looking around the project, sample apps, interface definitions and much more. It does interest and you can bet that I will be spending some time on it this year, no doubt about that.

    The release of gRPC seems to have triggered a series of thoughts in my mind: technical and otherwise. Here they go (in no order of importance):

    View original post 849 more words

  • arjunmantri 2:17 am on March 7, 2015 Permalink | Reply  

    Run basic PIG latin, commands for the same,

    >hdfs dfs -copyFromLocal /”filename” :hdfs:/
    >pig sample.pig

    where in sample.pig is the script for pig file created by you and filename is the input file created.

  • arjunmantri 7:37 am on March 4, 2015 Permalink | Reply  

    Setting up Hadoop multi-node cluster on Amazon EC2 Part 2 

    Let's Do Big Data...

    In Part-1 we have successfully created, launched and connected to Amazon Ubuntu Instances. In Part-2 I will show how to install and setup Hadoop cluster. If you are seeing this page first time, I would strongly advise you to go over Part-1.

    In this article

    • HadoopNameNode will be referred as master,
    • HadoopSecondaryNameNode will be referred as SecondaryNameNode or SNN
    • HadoopSlave1 and HadoopSlave2 will be referred as slaves (where data nodes will reside)

    So, let’s begin.

    1. Apache Hadoop Installation and Cluster Setup

    1.1 Update the packages and dependencies.

    Let’s update the packages , I will start with master , repeat this for SNN and 2 slaves.

    $ sudo apt-get update

    Once its complete, let’s install java

    1.2 Install Java

    Add following PPA and install the latest Oracle Java (JDK) 7 in Ubuntu

    $ sudo add-apt-repository ppa:webupd8team/java

    $ sudo apt-get update && sudo apt-get install oracle-jdk7-installer

    Check if Ubuntu uses JDK 7


    View original post 2,213 more words

Compose new post
Next post/Next comment
Previous post/Previous comment
Show/Hide comments
Go to top
Go to login
Show/Hide help
shift + esc