Posts

Showing posts with the label Hadoop Training
Image
Apche Hadoop Flume Tutorial What is Apache Flume? Apache Flume is one tool and used to moving data from one place to another place.Flume is the distributed systems that transporting the data at reliable manner. Flume is most important part of hadoop ecosystem. In Apache flume all data unit consider as one event. It collecting log data from various  web servers to HDFS. Features of Apache Flume: Main Feature of flume is collected data from multiple web servers It import large amount of data that produced by facebook,twitter. It supports Fan-in-Fan-out flows and more amount of sources and destination types. It collects the data from multiple sources and move to destination. Main Components of apche Flume: Event Agent Source Sink Channel Client Click Here to Read Full Explained Article about Flume
Image
Apache Hadoop Hive Tutorial What is Hive? Hive is Datawarehousing tool and used to process the data in hadoop and HDFS.Hive is similar to SQL because it analyze and process the data with querying language.  Hive runs on MapReduce  and top of the hadoop. Hive also known as HiveQL.Main Fuctions of the hive is data summarisation,querying and analysis. Features of Hive: Hive processed data from hadoop and hdfs Hive designed by OLAP It Supports Sql and HiveQl Data Storage of Hive: Metastore Tables Partitions Buckets Click Here to Read Full Explained Article
Top Five Hadoop Interview Questions 1. What do the four V’s of Big Data denote? Volume : The volume represents the amount of data which is growing at an exponential rate i.e. in Petabytes and Exabytes. Velocity : Velocity refers to the rate at which data is growing, which is very fast. Today, yesterday’s data are considered as old data. Nowadays, social media is a major contributor in the velocity of growing data. Variety : Variety refers to the heterogeneity of data types. In another word, the data which are gathered has a variety of formats like videos, audios, csv, etc. So, these various formats represent the variety of data. Veracity : Veracity refers to the data in doubt or uncertainty of data available due to data inconsistency and incompleteness. 2. What are the most common Input Formats in Hadoop? There are three most common input formats in Hadoop: Text Input Format:  Default input format in Hadoop. Key Value Input Format:  used for plain text...
Image
Difference Between NoSql Cassandra and Apache Hadoop What is Cassandra? Cassandra is the NoSql Database and it handles the more amount of data between multiple servers. It serves data from database to online transactional applications and business intelligence because cassandra is the open source database. Cassandra created by facebook and designed for peer to peer nodes. It partitions the data across hadoop cluster and counts the copy of data from the database. What is Hadoop? Hadoop is an open source framework which is used to store large amount of data sets.Hadoop is provided for data storage,data access,data processing and security operations. Many organizations are used hadoop for storage purpose because Hadoop storing large amount of data quickly. Difference Between NoSql Cassandra and Apache Hadoop: S.No NoSql Cassandra Apache Hadoop 1 Cassandra is the no NoSql database and mainly used for architecture and handle more amount of data between multiple ...
Image
CAP Theorem in Hadoop What is CAP Theorem? CAP theorem is designed for distributed file systems(collection of interconnected nodes).CAP Theorem also known as Brewer’s theorem and used to distributed consistency.It contains follwing three technical terms for distributed systems. C  – Consistency A  – Availability P  – Partition Tolerance Consistency: When you read data it will give same data how many times read and server send response each and every request but systems always consistent when read data.(all node having same data) Availability: It means all requests give response and no error accured in this systems. Partition Tolerance: All functions run all time when more nodes not responsive and commnication break between two nodes Distributed systems statisfy any two terms only and not satisfy three terms Selecting Two options in CAP Theorem: CP – Consistency/Partition Tolerance: It wait for response form partioned nodes and that ...
Image
Scope of Hadoop Introduction: The Most Reasons to learn Hadoop is to boost your career in Information technology .Most of the people are looking forward in making their career in Hadoop .In this article we discuss about the scope of Hadoop. Hadoop: Hadoop is an open source software framework that stores data and can run applications on clusters of commodity hardware. Hadoop has the ability to handle large set of structured and unstructured data than the traditional enterprise data warehouse. Career with Hadoop: Top companies looking for people with hadoop skills. Hadoop is a good skill for IT professionals with database management experience to pursue . Freshers who can show their expertise in Hadoop through hands-on project experience are hired easily. Hadoop has the main potential to improve job opportunities whether you are a fresher or an experienced professional. Hadoop is a booming trend right now and many developing sta...