|
View Weekly Course Schedule
View Course Resources.
|
Other interesting links: Visit linux.ctyme.com for searchable Linux man pages in HTML format, docs.sum.com for searchable Solaris man pages and other Solaris documentation, Visit the Tampa-St. Pete Linux User's Group (SLUG). This group holds monthly meetings. See also the Pinellas Unix People (PUP) group. Most Unix and Linux software is actually GNU software (www.gnu.org), a project of the Free Software Foundation. Download free Unix and Linux distributions from distrowatch.com. Download The PuTTY suite of Internet tools: SSH, scp, sFTP, and others, from www.chiark.greenend.org.uk/~sgtatham/putty. Download the WinSCP GUI wrapper for the PuTTY scp and sFTP tools from sourceforge.net/projects/winscp/. Visit www.unix.org for the OpenGroup's Unix site, including the Single Unix Specification. View Solaris certification FAQ and Oracle's Solaris Certification information, including Sun Certified System Administrator (SCSA) exam objectives part 1 and part2. View Linux LPI certification and View LPI-1 exam objectives. |
| Time & Place: | Ref No. 22171: Monday & Wednesday, 7:00–8:15 PM, Dale Mabry Room DTEC–461 | ||||||
|---|---|---|---|---|---|---|---|
| Instructor: |
Name: Wayne Pollock E-mail: Internet: Office & Phone: DTEC–404, 253–7213 DM Office Hours: Monday–Thursday, 3:55–5:25 & 8:30–9:00; On-line Office Hours: Tuesday–Friday, 12:00 PM (noon)–1:00 PM; or by appointment.
| ||||||
| Text: |
Stephen G. Kochan, Patrick Wood,
Unix Shell Programming,
©2003 Sams Pub.
ISBN: 0-672-32490-3.
Optional: Hahn, Harley, Harley Hahn's Guide to Unix and Linux, ©2009 Harley Hahn, Pub. by McGraw-Hill. ISBN # 978-0-07-313361-4. | ||||||
| Description: |
(This course is 3 credit hours long.)
This course is intended for students who have mastered the basic Linux/Unix
operating environment and who would like to read and understand the various
administrative scripts, and to write scripts to automate day-to-day
tasks.
This course is designed to teach students the skills they need to
effectively read, write and debug shell scripts.
This course explores in detail the Bash shell scripting language.
Major topics covered include reading, writing, modifying, and debugging
shell scripts, the shell environment, regular expressions, text filtering
with grep, sed, and the awk commands,
conditional control statements and loops, interactive scripts, the use of
other shell features such as variables, parameters, argument lists,
shell functions, shell traps.
The basic Unix/Linux environment is taught in the course CTS 1106 (Introduction to Unix / Linux). | ||||||
| Objectives: | The student will demonstrate a knowledge of the following
topics through objective tests, hands-on activities, and/or projects:
| ||||||
| Prerequisites: | CTS 1106 (Introduction to Unix / Linux), or permission of the instructor. Students enrolled in a degree or college credit certificate program program must complete all prerequisites. Note! HCC registration computers may not check for prerequisites before allowing you to enroll. Be certain you have all required prerequisites or you won't have much of a chance of success. Also you may be dropped from the class. | ||||||
| Facilities: | Assignments must be completed on
YborStudent.hccfl.edu (a Linux server), which can be
accessed from on or off campus using any ssh capable
terminal emulator such as PuTTY.
(Your user ID and password will be provided in
class, along with instructions on how to use this.)
From off-campus you can practice using any Unix/Linux system
available (or install Unix or Linux at home).
You will need your own floppy/flash disk, writing materials, and three Scantron 882–E or 882–ES forms. You can use HawkNet (WebAdvisor) or FACTS.org to obtain your final grade for the course. Most college systems now use (or will in the future) a single sign-on user ID, known as HCC “NetID”. Visit netid.hccfl.edu to register and to update your credentials. (Your initial password is your uppercase first name initial, lowercase last name initial, and your seven digit student ID number.) Note the quickest way to resolve login issues is the HCC Live Web Portal (hcclive.hccfl.edu). Hawk Alert text messaging service allows you to receive important information regarding campus closures or emergencies. You may also sign up for financial aid notifications and registration and payment deadlines. This is a free service, although some fees may be applied by your cellular service provider or plan for text messages. To sign up, or for more information, visit www.hccfl.edu/alerts/. HCC DM
Open Lab
| ||||||
| Grading: |
Grading scale:
A=90-100, B=80-89, C=70-79, D=65-69,
F=0-64 | ||||||
| Policies: |
| ||||||
| Projects: |
Projects will be assigned at various times.
You will have sufficient time to complete the projects,
at least a week but usually two weeks.
Although there may be in-class group exercises, you must work
individually on projects, typically outside of regular class hours,
except when a project is designated as a group project.
(Currently, all projects are designated group projects.)
You may work together in small groups on group projects
provided the names of all who worked together are listed.
Each student must still submit their own copy of the assignment.
Projects are graded on the following scale:
A = 95% (Excellent:
Good design with good comments, style, and extras) Minor extras worth +5 points, minor omissions or poor design worth -5. Projects are not graded when turned in. They are graded all at once, sometime after the project deadline has passed (usually the next weekend). Every effort will be make to grade projects within a week of the due date, or as soon thereafter as possible. (See also submitting assignments below.) | ||||||
| Submitting Assignments: |
In general you won't need to submit projects.
Sometime after the due date I will examine your files
in your home directory on YborStudent.
(DO NOT remove group read or execute permissions
from your files and directories, or I won't be able to grade your
work!)
Do not remove or edit project files, until after you are certain
the grade for that project has been recorded correctly.
(Even then, it pays to keep a backup copy of all your work.)
Other assignments should be submitted by email to
.
Please use a subject such as In the event a student submits more than once for the same assignment, I will ignore all but the last one received up to the deadline. Assignments submitted after the deadline will not count toward your grade except as allowed by the course late policy.
The HCC email server automatically accepts and
silently discards email with certain types of attachments.
If you must send email to my Internet (non-YborStudent) email
account please avoid using any attachments, but especially
To avoid having your submitted work rejected as
If you have an email problem you may turn in a printout instead.
Be sure your name is clearly written on the top of any pages
turned in.
Please staple multiple pages together (at the upper left). |
| HCC Academic Calendar: | |
|---|---|
| Classes Begin: | Monday 1/9/2012 (First class meeting: Monday 1/9/2012) |
| Add-Drop Ends: | Friday 1/13/2012 |
| Last Day to Withdraw: | Monday 3/26/2012 |
| Classes End: | Monday 5/7/2012 (Last regularly scheduled day of class: Monday 5/7/2012) |
| Grades Available: | Wednesday 5/9/2012 (from FACTS.org or HawkNet) |
| HCC is closed on: |
Monday 1/16/2012 (Martin Luther King Jr. Day), Monday 2/20/2012 (Presidents' Day), Monday–Friday 3/19/2012–3/23/2012 (Mid-Term Break), Friday 4/6/2012 (Spring Day), Thursday 4/12/2011 (Faculty In-Service Day) |
If, to participate in this course, you require an accommodation due to a physical disability or learning impairment, you must contact the Office of Services to Students with Disabilities, Dale Mabry campus: Student Services Building (DSTU) Room 204, voice phone: (813) 259–6035, TTD: (813) 253–7035, FAX: (813) 253–7336. Brandon campus: voice phone: (813) 253–7914.
HCC has a religious observance policy that accommodates the religious observance, practices, and beliefs of students. Should students need to miss class or postpone examinations and assignments due to religious observances, they must notify their instructor at least one week prior to a religious observance.
| Quotes: | Tell me and I'll listen. | — Lakota Indian saying | |
|---|---|---|---|
Learning is not a spectator sport! | — Chickering & Gamson |
| Dates
Mon Wed |
Topics and Assigned Readings |
|---|---|
| 1/9 |
Course introduction,
assign User ID, discuss passwords.
What is shell scripting?
Why is it important to know?
POSIX and portability.
File, directory, and pathname concept review. Review basic commands: cd, pwd, pathchk,
mkdir, rmdir,
passwd, cp, mv,
rm, ln, ls -laRd,
who, echo, cat,
more and less,
tac and rev.
Useful non-standard utilities include:
pwgen and apg,
script and screen,
and readlink.
Using man, info, and other resources.
Readings: Chapters 1, 2, Appendix B, man pages for listed commands |
| 1/11 |
The vi/vim (and other) text editor.
Readings: online vi/vim resources, (Chapter 22 in Hahn) |
| 1/16 | Martin Luther King Jr. Day — HCC Closed |
|
1/18
1/23
|
Shell features (part 1): globbing (wildcards),
locales
(I18N),
I/O redirection, pipelines.
Using here documents.
Understanding processes.
Project 1 due: 1/18 Readings: Chapters 2 (pages 24–38), 3, 295-297, 352-360, on-line locale resources, (465-471 in Hahn book) |
|
1/25
1/30 2/1
2/6
|
Regular Expressions
(BREs,
EREs,
PREs,
and POSIX).
Some common filter commands:
sed, cut, paste,
tr, wc, grep,
sort, uniq,
od and xxd, strings,
diff (and cmp, vimdiff
sdiff, comm, and patch),
and XML utilities (xmlgrep,
xmldiff, and others).
Project 2 due: 2/6 Readings: Chapter 4, on-line regular expression resources |
| 2/8 | Exam #1 |
| 2/13 2/15 |
Python basics.
Comparison with Perl.
Readings: on-line Python and Perl resources, |
| 2/20 | Presidents' Day — HCC Closed |
|
2/22
2/27 2/29
3/5 3/7 |
Using awk to simplify data processing and
report generation.
Additional useful commands:
find, file, dd,
wget, curl, rsync,
tee, xargs, expect,
and sendmail/mail/mailx.
Selecting the right tool for the job.
Project 3 (filters) due: 2/22 Readings: on-line awk resources, find command resources, xargs, expect (and Tcl/Tk) command resources |
| 3/12 3/14 |
Command line processing steps (input, tokenizing, parsing,
various expansions, command substitution, arithmetic expansion,
field splitting (and IFS), quote removal,
I/O redirections).
Tilde substitution, quoting, aliases.
Project 4 (awk) due: 3/14 Readings: Chapters 6, 11, pages 103-110, 280-283, 326-328, 330-339, 352-359, on-line permissions and octal number reference, on-line command line processing resources |
| 3/19 – 3/25 | Mid-Term Break — HCC Closed |
| 3/26 |
Interactive (login) shell use: login scripts, the environment,
history, auto-completion, job control, using nohup,
command grouping, sub-shells, restricted shell.
Using shell variables, shell built-in commands.
Readings: Chapters 6, 11, pages 103-110, 280-283, 326-328, 330-339, 352-359, on-line permissions and octal number reference, on-line command line processing resources |
| 3/28 | Exam #2 |
| 4/2 4/4 |
Shell scripting concepts and features (mostly review):
environment variables, permissions, PATH,
comments, she-bang line, sourcing scripts.
Command substitution.
shell arithmetic, expr, and bc.
Dealing with octal and hex numbers: numbers with leading zeros.
Project 5 (parse access log) due: 4/4 Readings: Pages 99-103, 110-111, 340-346, on-line permissions and octal number reference, on-line command line processing resources |
| 4/9 |
Positional and other special parameters, parameter substitution.
shift, using set.
Exit status and $?.
Readings: Chapters 7, 12, pages 145-149, 274-280 |
| 4/11 |
Using if statements and the test
command, the && and
|| operators.
The exit command.
Using case statements
(and bash extended pattern-matching).
Readings: Chapter 8 |
| 4/16 4/18 |
Using loops: while, until,
and for loops.
Using break and continue.
Parsing the command line with getopts.
Using seq (Linux only).
Project 6 (Perl) due: 4/18 Readings: Chapter 9 |
| 4/23 |
Using read for interactive shell scripts.
echo and printf.
Using named pipes.
Temporary files.
Readings: Chapter 10, on-line resources for temporary files, on-line resources for named pipes |
|
4/25
4/30
|
Using signals: kill and trap commands.
eval, wait.
Creating and using shell functions.
Project 7 (find) due: 4/25 Readings: Pages 301-305, 339-340 |
| 5/2 |
Optional (time and interest permitting):
Creating TUI
menu-driven scripts (mention select loops/menus).
Shell archive files.
Advanced I/O redirection techniques.
Working with shell arrays, lists.
Customizing output with tput.
Creating progress bars.
Using stty to control input.
Using readline.
Using the Linux dialog command to add a
GUI to scripts.
Using scripts for Website support, management,
and web page generation (MRTG scripts).
Using MySQL, PostgreSQL
databases with shell scripts.
Readings: on-line resources TBD |
| 5/7 |
Exam #3
Project 8 (getopts) due: 5/7 |
| Resources | |||||
|---|---|---|---|---|---|
| PuTTY home | Recommended Windows SSH client | Copy and Paste Help | How to use PuTTY's copy and Paste | ||
| Csh Programming Considered Harmful | A famous article from Tom Christiansen posted in 1996 | Soft Skills | Information about Soft Skills, Professional affiliations and certifications, and job hunting and interviewing tips. | ||
| www.unix.org | The OpenGroup's Unix site, include the Single Unix Specification | comp.unix.shell newsgroup | An active discussion netnews group; you can post questions here and get anwsers | ||
| Linux Standard Base (LSB) | Standard tools, DLLs, etc., common to all Linux distros; Current spec maintained by The Linux Foundation | Single Unix Specification | The current Unix reference, including for the shell and utilities | ||
| docs.sun.com | Solaris man pages, administrator guides, and more | linux.ctyme.com | Searchable Linux man pages in HTML format | ||
| Various system shells | Sven Mascheck's page describing the standard shells found on many systems | The Unix Heritage Society | Preserves historical versions of Unix (including source code) and Unix history | ||
| Vi lovers home | Tutorials, FAQs, and references for vi | vim home | Home page for VIM (Vi, IMproved) | ||
| Vim documentation project | Tutorials, FAQs, and references for vim | vim quick reference (PDF) | A two-page reference to vim | ||
| Vim Graphical Cheat-sheet (PDF) | A nice quick reference graphic ( Preview), from www.viemu.com | Why use vi | An article explaining why vi/vim is a great editor | ||
| Locales | Brief overview of locales and text encoding | ||||
| Regular Expressions | Shows Regular Expression (regex) syntax |
RegularExpression.jar | Download Regular Expression Lab (a Java program); (See also Java Regular Expression syntax summary) | ||
| www.regular-expressions.info | On-line tutorial and reference for regular expressions | regexlib.com | On-line cookbook (library) of standard regular expressions | ||
| regular expression cartoon | The importance of learning regular expressions (Source: xkcd.com) | ||||
| Gnu AWK User Guide | A tutorial and reference manual for Gnu AWK | AWK FAQ | AWK Frequently Asked Questions | ||
| AWK Overview | A copy of my lecture notes for AWK | POSIX AWK Reference and description | The AWK man page from The Open Group POSIX document SUSv4 | ||
A perl tutorial |
A short tutorial, with examples (work in progress) | CPAN | Comprehensive Perl Archive Network | ||
| learn.perl.org | Perl tutorials from Perl.org | Beginning Perl | An on-line book for learning Perl | ||
| PerlMonks.org tutorials | Another site with Perl resources | Perl.com | A portal for all things Perl | ||
| PerlMeme.org tutorials | Good site with Perl resources | Perl's here documents | A description of Perl here documents | ||
A find tutorial |
A short tutorial, with examples | find command tip | Shows how to use find to locate files modified
by an administration tool |
||
An xargs tutorial |
From www.unixreview.com | Shell Scripting Introduction | Shows the basics of shell scripting | ||
An expect tutorial |
From the O'Reilly book Exploring Expect | Tcl tutorial | Shows the basics of Tcl scripting (See also Tk tutorial) | ||
| Command Line Processing | The steps the shell performs when parsing input | Variables, Control Structures, and Funtions | A mini-tutorial for non-programmers | ||
| Octal Number Chart | Shows how to use octal numbers with chmod and
umask |
Filesystem Hierarchy Standard (FHS) | A description of the standard directories on Linux
(for Unix systems, see also man filesystem) |
||
| Using temporary files, trap | How to create, use, and clean up temporary files using trap | Using named pipes | How to use named pipes (a.k.a. FIFOs) | ||
| flock-demo | A script showing advisory file locking with
flock |
timestamp.sh | A POSIX script to display Unix Time (See also timestamp.c) | ||
| crontab reference | Shows crontab file syntax | at command syntax | Some at samples of entering times and dates,
and other info |
||
| StartupScript.txt | Sample startup shell scripts (/etc/init.d/foo) for a foo server | System V init files | From /usr/share/doc/initscripts-7.42.2 on Fedora | ||
| RCS Demo | A sample session using RCS with a shell script | Here documents | An overview of the Unix/Linux shell's here document | ||
| Shell Scripts (and Other Demos) | |||||
| LDP: Bash scripting guide and reference) | Shows how to write Bash shell scripts. complete Bash man page | SSC's Bash shell reference card | (Posted here by permission of SSC, Inc.) | ||
| fancyio | Shows how to write interactive shell scripts | fortune | A fortune cookie script (plus some sample fortunes) | ||
| nusers | Shows a simple shell script | nusers.1 | Sample man page for nusers, using troff/man macros | ||
| getopts Demo | A demo of the POSIX getopts utility |
getopt Demo | A demo of the Gnu getopt utility |
||
| backup-etc.sh | A simple shell script to backup /etc directory | httpd.sh | Apache script for use in rc.d/init.d |
||
| .bashrc | Some useful bash shell aliases and functions | .bash_profile | A simple Bash login script | ||
| .procmailrc | A sample .procmailrc that auto-replies and filters spam | add-users | A complex script used to add users in batches | ||
| expect-demo | Using expect to script changing a user's password. |
||||
| todo | A simple todo listshell script |
didit | Simple shell script, used with todoscript |
||
| didit2 | Shell script, used with todoscript |
didit3 | Fancy shell script, used with todoscript |
||
| pick | interactive selection script | watch | Shows how to write shell and awk scripts | ||
| suidDemo.tgz | Shows how suid can be used to control access to files | Sample .vimrc | A basic ~/.vimrc file | ||
| exec Demo | A demo using exec to emulate BASIC's
READ and DATA statements |
find-IP | A script to locate files in /etc containing the host's IP address | ||
| sttydemo.sh | A script using stty for fancy I/O | find-dups.sh | A highly portable script that shows many advanced techniques, that finds duplicate files by comparing MD5 checksums | ||
| Perl CGI (Database) Scripts | |||||
| filter.pl | Model Perl script to ask as a standard *nix filter | hellotk.pl | A Perl/Tk GUI script (Hello, World) | ||
| HccDump | The SQL statements needed to create the HCC MySQL database | graphics.tgz | The gzipped tar file containing the sample gif files for the hcc.com postcard system; (Unpack in the directory: DocumentRoot/graphics) | ||
| send-postcard.pl | Perl script to send an e-card; uses CGI and DBI (DB access) | show-postcard.pl | Perl script to retrieve an e-card; uses CGI and DBI | ||