Book Detail : Scaling Big Data with Hadoop and Solr

Book Title: 
Scaling Big Data with Hadoop and Solr
Resource Category: 
Publisher: 
Publication Year: 
2 013
Number of Pages: 
144
ISBN: 
978-1-78328-137-4
Language: 
English
WishList: 
yes
Available at Shelf: 
No
Description: 

Learn exciting new ways to build efficient, high performance enterprise search repositories for Big Data using Hadoop and Solr

Table of Contents (Summary): 
  1. Processing Big Data Using Hadoop MapReduce  

  2. Understanding Solr 

  3. Making Big Data Work for Hadoop and Solr 

  4. Using Big Data to Build Your Large Indexing 

  5. Improving Performance of Search while Scaling with Big Data

Table of Contents (Expanded): 
  1. Processing Big Data Using Hadoop MapReduce  

    • Understanding Apache Hadoop and its ecosystem  

      • The ecosystem of Apache Hadoop 

    • Storing large data in HDFS  

      • HDFS architecture

      • Organizing data 

      • Accessing HDFS 

    • Creating MapReduce to analyze Hadoop data 

      • MapReduce architecture  

    • Installing and running Hadoop  

      • Prerequisites  

      • Setting up SSH without passphrases 

      • Installing Hadoop on machines 

      • Hadoop configuration 

      • Running a program on Hadoop  

    • Managing a Hadoop cluster 

  2. Understanding Solr

    • Installing Solr  

    • Apache Solr architecture 

      • Storage 

      • Solr engine 

    • Configuring Apache Solr search 

      • Defining a Schema for your instance 

      • Configuring a Solr instance 

      • Request handlers and search components  

    • Loading your data for search  

      • ExtractingRequestHandler/Solr Cell  

      • SolrJ 

  3. Making Big Data Work for Hadoop and Solr 

    • The problem 

    • Understanding data-processing workflows 

      • The standalone machine  

      • Distributed setup 

      • The replicated mode 

      • The sharded mode 

    • Using Solr 1045 patch – map-side indexing 

      • Benefits and drawbacks 

    • Using Solr 1301 patch – reduce-side indexing 

      • Benefits and drawbacks 

    • Using SolrCloud for distributed search 

      • SolrCloud architecture  

      • Configuring SolrCloud  

      • Using multicore Solr search on SolrCloud 

      • Benefits and drawbacks 

    • Using Katta for Big Data search (Solr-1395 patch) 

      • Katta architecture  

      • Configuring Katta cluster  

      • Creating Katta indexes 

      • Benefits and drawbacks 

  4. Using Big Data to Build Your Large Indexing 

    • Understanding the concept of NOSQL 

    • The CAP theorem 

      • What is a NOSQL database? 

      • Why NOSQL databases for Big Data? 

      • How Solr can be used for Big Data storage? 

    • Understanding the concepts of distributed search 

      • Distributed search architecture 

      • Distributed search scenarios 

    • Lily – running Solr and Hadoop together

      • The architecture

      • Installing and running Lily  

    • Deep dive – shards and indexing data of Apache Solr

      • The sharding algorithm 

      • Adding a document to the distributed shard 

    • Configuring SolrCloud to work with large indexes 

      • Setting up the ZooKeeper ensemble 

      • Setting up the Apache Solr instance 

      • Creating shards, collections, and replicas in SolrCloud  

  5. Improving Performance of Search while Scaling with Big Data

    • Understanding the limits 

    • Optimizing the search schema 

      • Specifying the default search field  

      • Configuring search schema fields  

      • Stop words 

      • Stemming 

    • Index optimization  

      • Limiting the indexing buffer size  

      • When to commit changes? 

      • Optimizing the index merge 

      • Optimize an option for index merging

      • Optimizing the container  

      • Optimizing concurrent clients  

      • Optimizing the Java virtual memory 

    • Optimization the search runtime 

      • Optimizing through search queries 

      • Optimizing the Solr cache 

      • Optimizing search on Hadoop

    • Monitoring the Solr instance 

      • Using SolrMeter 

 

Appendix A: Use Cases for Big Data Search  

  • E-commerce websites 

  • Log management for banking 

Appendix B: Creating Enterprise Search Using Apache Solr  

  • schema.xml  

  • solrconfig.xml  

  • spellings.txt  

  • synonyms.txt 

  • protwords.txt 

  • stopwords.txt 

Appendix C: Sample MapReduce Programs to Build the Solr Indexes 

  • The Solr-1045 patch – map program

  • The Solr-1301 patch – reduce-side indexing Katta 

Index

2.958075
Average: 3 (161 votes)

Search the Web

Custom Search

Searches whole web. Use the search in the right sidebar to search only within javajee.com!!!