Who Can Learn
Course Outline

  • Understanding of Big Data Concepts and Hadoop ecosystems.
  • HDFS architecture, flow of data, data replication, Namenode and Datanode
  • Validation of MapReduce Jobs in Java and Python.
  • Testing of Hadoop Mapper on a Mapreduce application
  • How to Query Data using Apache Hive and analyse the data on hadoop.
  • Ingesting Data using Apache Sqoop.
  • Processing and transforming Data using Apache Pig
  • Understanding of Hadoop Testing and the Workflow process
  • Big data testing tools
  • How to work with NoSQL Databases

  • Freshers
  • Manual and Automation Test Engineers
  • Database Developers/testers/Analysts
  • Proficient IT professionals who are willing to switch their field of work towards Big Data Testing field.

  • Module 1: Data warehousing, ETL & Big Data concepts

  • Need for Data Warehousing
  • What is Data Warehousing?
  • Advantages of Data Warehouse
  • Properties of A Data Warehouse
  • Data Warehouse Architecture
  • Concepts of OLTP and OLAP
  • What is ETL?
  • What is Big Data?
  • 5 V's of Big Data
  • Types of Data
  • What is Hadoop?
  • History of Hadoop
  • Architecture of Hadoop
  • Hadoop Ecosystem

  • Module 2: Linux Basics

  • Unix/Linux commands
  • Shell scripting

  • Module 3: Hadoop HDFS & MapReduce

  • Introduction to HDFS & MapReduce
  • HDFS Architecture
  • HDFS Commands
  • MapReduce Architecture
  • MapReduce Examples in Java & Python
  • Validating MAP Reduce jobs

  • Module 4: Querying Data using Apache Hive

  • Hive Overview
  • Hive Characteristics and Features
  • Different Hive Tables and its Differences
  • How Hive different with RDBMS
  • Hive Components & Clients
  • Creating and dropping Hive database
  • Hive Data Types
  • Hive Managed Tables
  • Hive External Tables
  • Altering Hive Table
  • Collections - Array, Map & Struct
  • Processing XML & JSON files in Hive
  • Hive Partitions & Buckets
  • Indexes and Views
  • Hive Queries: Order By, Group By, Distribute By and Cluster By clauses
  • Hive Aggregation Functions
  • Hive Joins
  • Hive UDF's and UDAF's
  • Working with Hue
  • Creating and Querying hive tables in Hue

  • Module 5: Ingesting Data using Apache Sqoop

  • Sqoop Overview
  • Sqoop Components and Architecture
  • Importing data from RDBMS tables to HDFS
  • Exporting data from HDFS to RDBMS Tables
  • Sqoop Commands
  • Working with Sqoop Jobs
  • codegen
  • Mini project on Hive and Sqoop

  • Module 6: Processing and transforming Data using Apache Pig

  • Overview on Pig
  • Pig Shell Types
  • Load and Store operators
  • Diagnostic Operators
  • Grouping and Joining
  • Combining and Splitting
  • Filtering
  • Sorting
  • Pig Latin Built-in functions
  • Pig UDF’s
  • Understanding the test cases of pig & Testing Pig Jobs
  • Mini Project on Pig and Sqoop

  • Module 7: NoSQL

  • What is NoSQL?
  • Challenges of RDBMS
  • Benefits to adopting a NoSQL database over RDBMS
  • Concepts and characteristics of NoSQL databases
  • Popular NoSQL Databases
  • CAP theorem
  • Working with NOSQL Databases

  • HBase

  • What is HBase?
  • HBase Vs RDBMS
  • Features of HBase
  • HBase Architecture
  • HBase Shell
  • HBase Commands
  • Create, Listing, Disabling and Enabling a Table
  • Describe & Alter
  • Exists
  • Drop a Table
  • Create, update,read and delete Data
  • Scan
  • Count & Truncate
  • HBase Admin API

  • MongoDB

  • Introduction to MongoDB
  • Creating Database in MongoDB
  • Dropping a Database
  • Creating Collections and Documents
  • CRUD Operations - Create, Read, Update and Delete

  • Module 8: Big Data/Hadoop Testing

  • Test Strategy And Steps For Testing Big Data Applications
  • Database Testing Of Big Data Applications
  • Functional Testing of Big Data Applications
  • Roles and Responsibilities Of A Tester In Big Data Applications
  • The Big Data Testing Challenges
  • Big Data Tools / Common Terminologies
  • Big Data Automation Testing Tools

  • Average
    (6 Ratings)

    Provide Your Rating

    Learning Expectations
    Very good
    Very good
    Very good
    Very good

    Your Feedback


    Hi I am Rohini, I did my web services testing training course.Pavan is well trained about the all concepts in web service and he was fully focused about the unique techniques about the web service testing…Thank for teaching.


    I really feel blessed to have PAVAN as my testing tutor. As a science background student I have no idea about programming skills, but he is making it so simple for me to understand each and every concept of java programming step by step for better understanding.Its totally worthy to choose him #Thank you sir#


    Pavan is really good at teaching new concepts. Explains in a fashion that you do not have to memorize anything. And the flow of course is so well planned. I find his courses immensely helpful in self learning. He also keeps his courses up to date by adding new content from time to time. There may be very experienced people who would like to teach but not everyone is good at teaching what they know. He is also very prompt in getting back to you if you have questions. I highly recommend him. Keep up the good work, Pavan!

    Siva Prasad

    The concepts that were explained about SOAP UI is very understandable and very clear. I got enough confidence that I can easily face the interview.


    Instructor have given a clear explanation of every topic with real time scenarios.He is responding to my queries as soon as possible.


    Very good course to learn about web services testing using SOAPUI. Detailed explanation of all the required concepts is given.The instructor is very professional in explaining all the details from scratch.


    Pavan is an excellent tutor who is very knowledgeable and conveys his knowledge in a very understandable manner. He has an art of making complex things easy and smooth to understand by repeating the concepts over and over again until we get it properly. Individual approach, great advice, positive attitude, generous and humble, very easy going are Pavan's qualities to name a few.Highly recommended!!

    Visit our Blog for Study Materials