Hadoop is an open source, a Java-based programming framework that supports the processing and storage of extremely large data sets in a distributed computing environment.
Hadoop is capable to work on the cluster(thousand of interconnected machines) and handle to thousand of terabytes data.
Hadoop provides rapid data transfer rate.
Hadoop is capable to work on a cluster(thousand of interconnected machines) and handle to thousand of terabytes data.
It is developed by doug cutting and Mike cafarella in 2006.
It was inspired by Google’s MapReduce programming framework.
1. HDFS( Hadoop Distributed file system)- HDFS Architecture: It has 2 Types of Nodes-
1. NameNode
2. Data Node
3. YARN(Yet another resource Negotiator)
NameNode is also known as the Master
NameNode only stores the metadata of HDFS .
NameNode does not store the actual data or the dataset. The data stored in the DataNodes physically.
NameNode knows the list of the blocks and its location for any given file in HDFS. With this information, NameNode knows how to construct the file from blocks.
NameNode is a single point of failure in Hadoop cluster.
NameNode is usually configured with a lot of memory (RAM). Because the block locations help in main memory.
DataNode is responsible for storing the actual data in HDFS.
DataNode is also known as the Slave
NameNode and DataNode are in constant communication.
When a DataNode is down, it does not affect the availability of data or the cluster. NameNode will arrange for replication for the blocks managed by the DataNode that is not available.
Apache Hadoop 2.0 includes YARN, which separates the resource management and processing components.
Please visit my website https://www.yogeshdotnet.com
Facebook Page Url: https://www.facebook.com/yogeshdotnet
Online Training – Yogeshdotnet also provides online training on the front-end technologies(MEAN/MERN Stack, Web Designing – HTML5, JS, Jquery, Bootstrap, NodeJS, Express, Angular 13 with typescript, React & Redux, etc. and backend technologies like( .Net Core 6, .Net Core REST API, ASP.NET MVC ), Deployment(Docker, Kubernetes, Git, GraphQL, Microservices, etc). For more details visit our website https://www.yogeshdotnet.com or call 09887575540. Our training programs covered basics and advanced concepts and real-time project scenarios. I designed various case studies and assignments which may help candidates to explore themselves in learning technologies. I take alternate days classes and problem-solving classes also where we solve problems individually by desktop sharing. The student will get all recorded sessions with lifetime access to all training sessions and study material. Our quality training programs are not more expensive. We provide training in Hindi & English language, depending on learner interest and comfort.
My Youtube gears:
Headphone with Mic : http://amzn.to/2kUXHSq
Best USB Micro phone : http://amzn.to/2gogjsR
Another option(cheap) asUSB microphone : http://amzn.to/2yrOsME
Microphone with mic under 500: http://amzn.to/2gogV1D
Antivirus under 500 : http://amzn.to/2ieKPFV Flipkart
Headphone with mic : http://fkrt.it/TVSKWTuuuN
Another Option Headphone with mic : http://fkrt.it/!Rt50!NNNN
Bluetooth Speakers : http://fkrt.it/Tg4nuTuuuN Flipkart
Headphone with mic : http://fkrt.it/TVSKWTuuuN
Another Option Headphone with mic : http://fkrt.it/!Rt50!NNNN
Bluetooth Speakers : http://fkrt.it/Tg4nuTuuuN Flipkart
Headphone with mic : http://fkrt.it/TVSKWTuuuN
Another Option Headphone with mic : http://fkrt.it/!Rt50!NNNN
Bluetooth Speakers : http://fkrt.it/Tg4nuTuuuN What’s app group for latest technologies and trends : https://chat.whatsapp.com/AtlkVqbxOrp…
source
Thanku sir …. It's really too easy to understand Hadoop ……🌍thanku and I like your way of teaching ..
wah bhai
I hate yogesh name people. on other hand, everything is good.
Start learning bigdata and hadoop from this top training center https://www.grafx-itsolutions.com/courses/latestcourses/hadoop.html
Please share the PPT link also Thanks for this vidio
Thanku sir
Speak slow pls
bht accha sir
This help me a lot in exam, Thank You bhai 🙏
Clear and great video. Thanks http://bit.ly/2IJn1G0
sir ap ki website open ni ho rhi
I liked your video 🙂 … thanks for sharing your knowledge
preetam kumar joshi from M.L.V.TEXTILE & ENGINEERING COLLEGE BHILWARA sir video excellent, SUBSCRIBE to banta he
Thank u sir, your video are really nice… I request you sir, plz make more videos about hadoop and big data.
thanku
Very useful… Thanks
Nice one video sir, Hadoop related query, I want to job of view Hadoop developer or Hadoop administrator in best job opportunities ?
Please guide me.
Very helpful video.. Plzz add more video on these technologies.👍
YE CHANNEL BHOOT UPPER JAEGA 🖒🖒
i beg you please tell difference between semi structure data and Quasi structure data in hindi with easy example ?