Learn Data with Bash Shell

About

Introduction

1. What is Bash ?
2. When Bash is useful?
3. Bash in data mining
4. Who is this book for?
5. How to read this book?
6. Part 1: Projects

Project 1: The ‘US News’ Uni Ranks

1. Learning objectives
2. Data download
3. Dataset Preview
4. Data Analysis
5. Find the colleges
6. Finding the percent of colleges in the ranklist
7. Listing the Institutes from a given state
8. Finding the number of Institutes from each state
9. Finding a correlation between ranks and tuition fees?
10. Chapter Summary

Project 2: Facebook Data Mining

1. Data download
2. Learning objectives
3. Dataset Preview
4. How many colums and rows?
5. How the data looks like?
6. Data Analysis
7. How many status, in each status type?
8. Find the most popular status entry
9. Chapter Summary

Project 3: Best Australian Cities - Least Crimes

1. Learning objectives
2. Data download
3. Data Preview
4. Finding the number of rows and columns
5. The hard way
6. The easy way
7. Data Analysis
8. Finding the top most crime in the whole country
9. Finding the top most crime per city
10. Finding the best city in Australia!
11. Chapter Summary

Project 4: Mining Shakespear-era Plays and Poems

1. Learning objectives
2. Data download
3. Data Preview
4. Analysis
5. How many plays/poems?
6. How many plays/poems by each author?
7. What are the most frequent words?
8. Chapter Summary
9. Part 2: Tutorials

Hello Bash!

1. Important Information
2. which bash?
3. Hello world! bash
4. Bash variables
5. Bash functions
6. Bash meta characters
7. Bash quotation basics
8. Read and store user input
9. Bash redirections
10. Bash if-else (conditional statements)
11. Bash case statement
12. Bash loop statements
13. Bash arithmatic
14. Bash arrays

Hello ! Regular Expressions

1. Important Information
2. REGEX Types
3. Basic Regular Expressions
4. Metachar .
5. Metachar [ ]
6. Metachar [^ ]
7. Metachar ^
8. Metachar $
9. Metachar ( )
10. Metachar *
11. Metachar {m,n}
12. Extended Regular Expressions
13. Metachar ?
14. Metachar +
15. Metachar |
16. REGEX Character Classes
17. REGEX Look Arounds
18. REGEX Atomic Groups (?>)
19. How to Use REGEX in Bash?

Hello! AWK

1. Important Information
2. AWK Built-in Variables
3. AWK statements
4. AWK built-in functions
5. AWK Examples
6. Example 1. AWK print function
7. Example 2. AWK print specific field
8. Example 3. AWK’s BEGIN and END Actions
9. Example 4. AWK fields variable ($1, $2 and so on)
10. Example 5. AWK built-in variables
11. Example 6. AWK fields comparison >
12. Self-contained AWK scripts

Hello! SED, GREP and Find

1. SED - Stream Editor
2. Important Information
3. SED substitution
4. Some important SED options
5. SED substitute and regular expressions
6. SED delete
7. SED print
8. SED grouping
9. GREP
10. GREP and regular expressions
11. Find command find
12. Part 3: Hello Big Data!
13. Big Data Terminologies
14. HDFS
15. Map Reduce
16. YARN
17. Flume
18. SOOOP
19. Hive
20. Pig
21. Spark
22. HBase
23. Big Data file formats

Conclusion

1. References
2. Bash
3. REGEX
4. AWK
5. SED
6. GREP
7. Big data
8. A companion book