Apche Hadoop Flume Tutorial

What is Apache Flume?
Apache Flume is one tool and used to moving data from one place to another place.Flume is the distributed systems that transporting the data at reliable manner. Flume is most important part of hadoop ecosystem. In Apache flume all data unit consider as one event. It collecting log data from various web servers to HDFS.
Features of Apache Flume:
  • Main Feature of flume is collected data from multiple web servers
  • It import large amount of data that produced by facebook,twitter.
  • It supports Fan-in-Fan-out flows and more amount of sources and destination types.
  • It collects the data from multiple sources and move to destination.

Main Components of apche Flume:
  • Event
  • Agent
  • Source
  • Sink
  • Channel
  • Client

Comments

Post a Comment

Popular posts from this blog

Image
CAP Theorem in Hadoop What is CAP Theorem? CAP theorem is designed for distributed file systems(collection of interconnected nodes).CAP Theorem also known as Brewer’s theorem and used to distributed consistency.It contains follwing three technical terms for distributed systems. C  – Consistency A  – Availability P  – Partition Tolerance Consistency: When you read data it will give same data how many times read and server send response each and every request but systems always consistent when read data.(all node having same data) Availability: It means all requests give response and no error accured in this systems. Partition Tolerance: All functions run all time when more nodes not responsive and commnication break between two nodes Distributed systems statisfy any two terms only and not satisfy three terms Selecting Two options in CAP Theorem: CP – Consistency/Partition Tolerance: It wait for response form partioned nodes and that data are timeo
Read more
Image
How to Get Hadoop Developer Jobs Who is Hadoop Developer? Hadoop Developer  role is similar to Software Developer.Responsible of hadoop developer is programming and develop the hadoop applications and all components of hadoop ecosystem.Here we discuss about main roles and responsibilities to become a hadoop Developer. Click Here to Re ad Full Article
Read more