Bash

Networking, Debugging, Misc

wget

  • wget is a non-interactive downloader
    • Only supports HTTP, HTTPS, and FTP
    • Depending on the website you are downloading from, may support continuing a paused download
    • Also has options to create an entire local copy of a website
      wget [OPTIONS] URL
      
In [1]:
wget www.umbc.edu
--2017-09-28 11:32:27--  http://www.umbc.edu/
Resolving www.umbc.edu (www.umbc.edu)... 130.85.12.160
Connecting to www.umbc.edu (www.umbc.edu)|130.85.12.160|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘index.html.1’

index.html.1            [ <=>                  ]  40.82K  --.-KB/s   in 0.005s 

2017-09-28 11:32:27 (7.87 MB/s) - ‘index.html.1’ saved [41795]

In [2]:
head index.html.1
<!DOCTYPE html>
<html lang="en">
  <head>
    <meta charset="UTF-8" />
    <title>UMBC: An Honors University In Maryland</title>

    <!-- Always force latest IE rendering engine (even in intranet) & Chrome Frame -->
    <!-- <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> -->

    <!-- Sets the viewport width to the width of the device, so media queries work -->

Common Courtesy with wget

  • wget, and many other command line tools can theoretically launch 100s of request a second
    • This is mean, potentially illegal, and a good way to get your IP blocked
  • wget has many options to prevent this if you are downloading multiple files at once
    • --limit-rate sets a maximum bandwidth to use
    • --wait sets the number of seconds to wait between each request
    • --random-wait will jitter the amount of time the wait actually is
In [3]:
wget --mirror ‐‐page-requisites \
‐‐convert-links ‐‐adjust-extension  \
-P./local_443-2 --wait 1 --random-wait \
https://www.csee.umbc.edu/~bwilk1/433/
--2017-09-28 11:36:42--  http://xn--page-requisites-zs9ha/
Resolving ‐‐page-requisites (xn--page-requisites-zs9ha)... failed: Name or service not known.
wget: unable to resolve host address ‘xn--page-requisites-zs9ha’
--2017-09-28 11:36:43--  http://xn--convert-links-9l6ga/
Resolving ‐‐convert-links (xn--convert-links-9l6ga)... failed: Name or service not known.
wget: unable to resolve host address ‘xn--convert-links-9l6ga’
--2017-09-28 11:36:43--  http://xn--adjust-extension-ue6ia/
Resolving ‐‐adjust-extension (xn--adjust-extension-ue6ia)... failed: Name or service not known.
wget: unable to resolve host address ‘xn--adjust-extension-ue6ia’
--2017-09-28 11:36:45--  https://www.csee.umbc.edu/~bwilk1/433/
Resolving www.csee.umbc.edu (www.csee.umbc.edu)... 130.85.36.80
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 29262 (29K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/index.html’

www.csee.umbc.edu/~ 100%[=====================>]  28.58K  --.-KB/s   in 0.002s 

2017-09-28 11:36:45 (13.1 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/index.html’ saved [29262/29262]

Loading robots.txt; please ignore errors.
--2017-09-28 11:36:46--  https://www.csee.umbc.edu/robots.txt
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 558 [text/plain]
Saving to: ‘./local_443-2/www.csee.umbc.edu/robots.txt’

www.csee.umbc.edu/r 100%[=====================>]     558  --.-KB/s   in 0s     

2017-09-28 11:36:46 (35.0 MB/s) - ‘./local_443-2/www.csee.umbc.edu/robots.txt’ saved [558/558]

--2017-09-28 11:36:47--  https://www.csee.umbc.edu/~bwilk1/433/assignments/regex.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 30993 (30K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/assignments/regex.html’

www.csee.umbc.edu/~ 100%[=====================>]  30.27K  --.-KB/s   in 0.003s 

2017-09-28 11:36:47 (11.4 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/assignments/regex.html’ saved [30993/30993]

--2017-09-28 11:36:48--  https://www.csee.umbc.edu/~bwilk1/433/Lecture00.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 263529 (257K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture00.html’

www.csee.umbc.edu/~ 100%[=====================>] 257.35K  --.-KB/s   in 0.05s  

2017-09-28 11:36:48 (5.30 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture00.html’ saved [263529/263529]

--2017-09-28 11:36:49--  https://www.csee.umbc.edu/~bwilk1/433/Lecture01.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 374471 (366K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture01.html’

www.csee.umbc.edu/~ 100%[=====================>] 365.69K  --.-KB/s   in 0.03s  

2017-09-28 11:36:50 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture01.html’ saved [374471/374471]

--2017-09-28 11:36:50--  https://www.csee.umbc.edu/~bwilk1/433/Lecture02.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 320828 (313K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture02.html’

www.csee.umbc.edu/~ 100%[=====================>] 313.31K  --.-KB/s   in 0.03s  

2017-09-28 11:36:50 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture02.html’ saved [320828/320828]

--2017-09-28 11:36:51--  https://www.csee.umbc.edu/~bwilk1/433/Lecture03.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 293564 (287K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture03.html’

www.csee.umbc.edu/~ 100%[=====================>] 286.68K  --.-KB/s   in 0.02s  

2017-09-28 11:36:51 (11.2 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture03.html’ saved [293564/293564]

--2017-09-28 11:36:52--  https://www.csee.umbc.edu/~bwilk1/433/Lecture04.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 309209 (302K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture04.html’

www.csee.umbc.edu/~ 100%[=====================>] 301.96K  --.-KB/s   in 0.03s  

2017-09-28 11:36:52 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture04.html’ saved [309209/309209]

--2017-09-28 11:36:54--  https://www.csee.umbc.edu/~bwilk1/433/Lecture05.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 319691 (312K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture05.html’

www.csee.umbc.edu/~ 100%[=====================>] 312.20K  --.-KB/s   in 0.03s  

2017-09-28 11:36:54 (11.2 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture05.html’ saved [319691/319691]

--2017-09-28 11:36:54--  https://www.csee.umbc.edu/~bwilk1/433/Lecture06.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 300456 (293K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture06.html’

www.csee.umbc.edu/~ 100%[=====================>] 293.41K  --.-KB/s   in 0.03s  

2017-09-28 11:36:55 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture06.html’ saved [300456/300456]

--2017-09-28 11:36:56--  https://www.csee.umbc.edu/~bwilk1/433/Lecture07.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 558487 (545K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture07.html’

www.csee.umbc.edu/~ 100%[=====================>] 545.40K  --.-KB/s   in 0.05s  

2017-09-28 11:36:56 (11.2 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture07.html’ saved [558487/558487]

--2017-09-28 11:36:57--  https://www.csee.umbc.edu/~bwilk1/433/Lecture08.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 260869 (255K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture08.html’

www.csee.umbc.edu/~ 100%[=====================>] 254.75K  --.-KB/s   in 0.02s  

2017-09-28 11:36:57 (11.2 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/Lecture08.html’ saved [260869/260869]

--2017-09-28 11:36:58--  https://www.csee.umbc.edu/~bwilk1/433/assignments/shell.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 20246 (20K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/assignments/shell.html’

www.csee.umbc.edu/~ 100%[=====================>]  19.77K  --.-KB/s   in 0.002s 

2017-09-28 11:36:58 (12.2 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/assignments/shell.html’ saved [20246/20246]

--2017-09-28 11:37:00--  https://www.csee.umbc.edu/~bwilk1/433/index.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 29262 (29K) [text/html]
Server file no newer than local file ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/index.html’ -- not retrieving.

--2017-09-28 11:37:00--  https://www.csee.umbc.edu/~bwilk1/components/bootstrap/fonts/glyphicons-halflings-regular.eot
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:00 ERROR 403: Forbidden.

--2017-09-28 11:37:01--  https://www.csee.umbc.edu/~bwilk1/components/bootstrap/fonts/glyphicons-halflings-regular.eot?
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:01 ERROR 403: Forbidden.

--2017-09-28 11:37:03--  https://www.csee.umbc.edu/~bwilk1/components/bootstrap/fonts/glyphicons-halflings-regular.woff2
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:03 ERROR 403: Forbidden.

--2017-09-28 11:37:03--  https://www.csee.umbc.edu/~bwilk1/components/bootstrap/fonts/glyphicons-halflings-regular.woff
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:03 ERROR 403: Forbidden.

--2017-09-28 11:37:05--  https://www.csee.umbc.edu/~bwilk1/components/bootstrap/fonts/glyphicons-halflings-regular.ttf
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:05 ERROR 403: Forbidden.

--2017-09-28 11:37:06--  https://www.csee.umbc.edu/~bwilk1/components/bootstrap/fonts/glyphicons-halflings-regular.svg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:06 ERROR 403: Forbidden.

--2017-09-28 11:37:07--  https://www.csee.umbc.edu/~bwilk1/components/font-awesome/fonts/fontawesome-webfont.eot?v=4.2.0
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:07 ERROR 403: Forbidden.

--2017-09-28 11:37:08--  https://www.csee.umbc.edu/~bwilk1/components/font-awesome/fonts/fontawesome-webfont.eot?
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:08 ERROR 403: Forbidden.

--2017-09-28 11:37:09--  https://www.csee.umbc.edu/~bwilk1/components/font-awesome/fonts/fontawesome-webfont.woff?v=4.2.0
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:09 ERROR 403: Forbidden.

--2017-09-28 11:37:09--  https://www.csee.umbc.edu/~bwilk1/components/font-awesome/fonts/fontawesome-webfont.ttf?v=4.2.0
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:10 ERROR 403: Forbidden.

--2017-09-28 11:37:11--  https://www.csee.umbc.edu/~bwilk1/components/font-awesome/fonts/fontawesome-webfont.svg?v=4.2.0
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2017-09-28 11:37:11 ERROR 403: Forbidden.

--2017-09-28 11:37:12--  https://www.csee.umbc.edu/~bwilk1/433/custom.css
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2017-09-28 11:37:12 ERROR 404: Not Found.

--2017-09-28 11:37:13--  https://www.csee.umbc.edu/~bwilk1/331/
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 28936 (28K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/index.html’

www.csee.umbc.edu/~ 100%[=====================>]  28.26K  --.-KB/s   in 0.002s 

2017-09-28 11:37:13 (12.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/index.html’ saved [28936/28936]

--2017-09-28 11:37:14--  https://www.csee.umbc.edu/~bwilk1/433/fb_messenger.png
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 37563 (37K) [image/png]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/fb_messenger.png’

www.csee.umbc.edu/~ 100%[=====================>]  36.68K  --.-KB/s   in 0.003s 

2017-09-28 11:37:14 (11.5 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/fb_messenger.png’ saved [37563/37563]

--2017-09-28 11:37:14--  https://www.csee.umbc.edu/~bwilk1/433/fb_verify.png
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 24402 (24K) [image/png]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/fb_verify.png’

www.csee.umbc.edu/~ 100%[=====================>]  23.83K  --.-KB/s   in 0.002s 

2017-09-28 11:37:14 (12.8 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/fb_verify.png’ saved [24402/24402]

--2017-09-28 11:37:15--  https://www.csee.umbc.edu/~bwilk1/433/registers.png
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 9397 (9.2K) [image/png]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/registers.png’

www.csee.umbc.edu/~ 100%[=====================>]   9.18K  --.-KB/s   in 0.001s 

2017-09-28 11:37:15 (13.9 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/433/registers.png’ saved [9397/9397]

--2017-09-28 11:37:16--  https://www.csee.umbc.edu/~bwilk1/433/assignments/assignments/shell_example_output/
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2017-09-28 11:37:16 ERROR 404: Not Found.

--2017-09-28 11:37:17--  https://www.csee.umbc.edu/~bwilk1/331/hw1.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2189 (2.1K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hw1.html’

www.csee.umbc.edu/~ 100%[=====================>]   2.14K  --.-KB/s   in 0s     

2017-09-28 11:37:17 (98.6 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hw1.html’ saved [2189/2189]

--2017-09-28 11:37:18--  https://www.csee.umbc.edu/~bwilk1/331/hw2.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2217 (2.2K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hw2.html’

www.csee.umbc.edu/~ 100%[=====================>]   2.17K  --.-KB/s   in 0s     

2017-09-28 11:37:18 (103 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hw2.html’ saved [2217/2217]

--2017-09-28 11:37:20--  https://www.csee.umbc.edu/~bwilk1/331/hw3.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3524 (3.4K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hw3.html’

www.csee.umbc.edu/~ 100%[=====================>]   3.44K  --.-KB/s   in 0s     

2017-09-28 11:37:20 (135 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hw3.html’ saved [3524/3524]

--2017-09-28 11:37:20--  https://www.csee.umbc.edu/~bwilk1/331/Lecture00.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 284331 (278K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture00.html’

www.csee.umbc.edu/~ 100%[=====================>] 277.67K  --.-KB/s   in 0.02s  

2017-09-28 11:37:20 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture00.html’ saved [284331/284331]

--2017-09-28 11:37:22--  https://www.csee.umbc.edu/~bwilk1/331/Lecture01.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 200343 (196K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture01.html’

www.csee.umbc.edu/~ 100%[=====================>] 195.65K  --.-KB/s   in 0.02s  

2017-09-28 11:37:22 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture01.html’ saved [200343/200343]

--2017-09-28 11:37:23--  https://www.csee.umbc.edu/~bwilk1/331/Lecture02.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 201889 (197K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture02.html’

www.csee.umbc.edu/~ 100%[=====================>] 197.16K  --.-KB/s   in 0.04s  

2017-09-28 11:37:23 (4.33 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture02.html’ saved [201889/201889]

--2017-09-28 11:37:24--  https://www.csee.umbc.edu/~bwilk1/331/Lecture03.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 270921 (265K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture03.html’

www.csee.umbc.edu/~ 100%[=====================>] 264.57K  --.-KB/s   in 0.02s  

2017-09-28 11:37:24 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture03.html’ saved [270921/270921]

--2017-09-28 11:37:25--  https://www.csee.umbc.edu/~bwilk1/331/Lecture04.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 267820 (262K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture04.html’

www.csee.umbc.edu/~ 100%[=====================>] 261.54K  --.-KB/s   in 0.02s  

2017-09-28 11:37:25 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture04.html’ saved [267820/267820]

--2017-09-28 11:37:26--  https://www.csee.umbc.edu/~bwilk1/331/Lecture05.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 261497 (255K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture05.html’

www.csee.umbc.edu/~ 100%[=====================>] 255.37K  --.-KB/s   in 0.02s  

2017-09-28 11:37:27 (11.2 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture05.html’ saved [261497/261497]

--2017-09-28 11:37:27--  https://www.csee.umbc.edu/~bwilk1/331/Lecture06.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 259496 (253K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture06.html’

www.csee.umbc.edu/~ 100%[=====================>] 253.41K  --.-KB/s   in 0.02s  

2017-09-28 11:37:27 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture06.html’ saved [259496/259496]

--2017-09-28 11:37:29--  https://www.csee.umbc.edu/~bwilk1/331/Lecture07.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 285979 (279K) [text/html]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture07.html’

www.csee.umbc.edu/~ 100%[=====================>] 279.28K  --.-KB/s   in 0.02s  

2017-09-28 11:37:29 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/Lecture07.html’ saved [285979/285979]

--2017-09-28 11:37:30--  https://www.csee.umbc.edu/~bwilk1/331/index.html
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 28936 (28K) [text/html]
Server file no newer than local file ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/index.html’ -- not retrieving.

--2017-09-28 11:37:31--  https://www.csee.umbc.edu/~bwilk1/331/custom.css
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2017-09-28 11:37:31 ERROR 404: Not Found.

--2017-09-28 11:37:32--  https://www.csee.umbc.edu/~bwilk1/331/compilation.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 114688 (112K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/compilation.jpg’

www.csee.umbc.edu/~ 100%[=====================>] 112.00K  --.-KB/s   in 0.01s  

2017-09-28 11:37:32 (11.4 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/compilation.jpg’ saved [114688/114688]

--2017-09-28 11:37:33--  https://www.csee.umbc.edu/~bwilk1/331/interpreter.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 98304 (96K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/interpreter.jpg’

www.csee.umbc.edu/~ 100%[=====================>]  96.00K  --.-KB/s   in 0.008s 

2017-09-28 11:37:33 (11.6 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/interpreter.jpg’ saved [98304/98304]

--2017-09-28 11:37:34--  https://www.csee.umbc.edu/~bwilk1/331/hybrid.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 88795 (87K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hybrid.jpg’

www.csee.umbc.edu/~ 100%[=====================>]  86.71K  --.-KB/s   in 0.007s 

2017-09-28 11:37:34 (11.6 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/hybrid.jpg’ saved [88795/88795]

--2017-09-28 11:37:35--  https://www.csee.umbc.edu/~bwilk1/331/parsetree1.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 62447 (61K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/parsetree1.jpg’

www.csee.umbc.edu/~ 100%[=====================>]  60.98K  --.-KB/s   in 0.005s 

2017-09-28 11:37:35 (11.5 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/parsetree1.jpg’ saved [62447/62447]

--2017-09-28 11:37:36--  https://www.csee.umbc.edu/~bwilk1/331/example_parse2.png
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 19490 (19K) [image/png]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/example_parse2.png’

www.csee.umbc.edu/~ 100%[=====================>]  19.03K  --.-KB/s   in 0.002s 

2017-09-28 11:37:36 (11.6 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/example_parse2.png’ saved [19490/19490]

--2017-09-28 11:37:37--  https://www.csee.umbc.edu/~bwilk1/331/example_parse3.png
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 32242 (31K) [image/png]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/example_parse3.png’

www.csee.umbc.edu/~ 100%[=====================>]  31.49K  --.-KB/s   in 0.003s 

2017-09-28 11:37:37 (11.5 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/example_parse3.png’ saved [32242/32242]

--2017-09-28 11:37:38--  https://www.csee.umbc.edu/~bwilk1/331/ambparse.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 167936 (164K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/ambparse.jpg’

www.csee.umbc.edu/~ 100%[=====================>] 164.00K  --.-KB/s   in 0.02s  

2017-09-28 11:37:38 (7.34 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/ambparse.jpg’ saved [167936/167936]

--2017-09-28 11:37:39--  https://www.csee.umbc.edu/~bwilk1/331/lexprocess.svg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 47182 (46K) [image/svg+xml]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/lexprocess.svg’

www.csee.umbc.edu/~ 100%[=====================>]  46.08K  --.-KB/s   in 0.004s 

2017-09-28 11:37:39 (11.5 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/lexprocess.svg’ saved [47182/47182]

--2017-09-28 11:37:40--  https://www.csee.umbc.edu/~bwilk1/331/moneyDFA.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 155385 (152K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/moneyDFA.jpg’

www.csee.umbc.edu/~ 100%[=====================>] 151.74K  --.-KB/s   in 0.01s  

2017-09-28 11:37:40 (11.4 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/moneyDFA.jpg’ saved [155385/155385]

--2017-09-28 11:37:41--  https://www.csee.umbc.edu/~bwilk1/331/NFA1.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 36699 (36K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/NFA1.jpg’

www.csee.umbc.edu/~ 100%[=====================>]  35.84K  --.-KB/s   in 0.003s 

2017-09-28 11:37:42 (11.6 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/NFA1.jpg’ saved [36699/36699]

--2017-09-28 11:37:44--  https://www.csee.umbc.edu/~bwilk1/331/NFA2.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 36512 (36K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/NFA2.jpg’

www.csee.umbc.edu/~ 100%[=====================>]  35.66K  --.-KB/s   in 0.003s 

2017-09-28 11:37:44 (11.3 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/NFA2.jpg’ saved [36512/36512]

--2017-09-28 11:37:45--  https://www.csee.umbc.edu/~bwilk1/331/aa.png
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 29991 (29K) [image/png]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/aa.png’

www.csee.umbc.edu/~ 100%[=====================>]  29.29K  --.-KB/s   in 0.002s 

2017-09-28 11:37:45 (12.9 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/aa.png’ saved [29991/29991]

--2017-09-28 11:37:46--  https://www.csee.umbc.edu/~bwilk1/331/parsetable.jpg
Connecting to www.csee.umbc.edu (www.csee.umbc.edu)|130.85.36.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 226046 (221K) [image/jpeg]
Saving to: ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/parsetable.jpg’

www.csee.umbc.edu/~ 100%[=====================>] 220.75K  --.-KB/s   in 0.02s  

2017-09-28 11:37:46 (11.2 MB/s) - ‘./local_443-2/www.csee.umbc.edu/~bwilk1/331/parsetable.jpg’ saved [226046/226046]

FINISHED --2017-09-28 11:37:46--
Total wall clock time: 1m 4s
Downloaded: 41 files, 6.0M in 0.6s (10.2 MB/s)

More Useful wget Features

  • wget allows you specify a list of urls to download by using the -i flag
  • The type of files downloaded can be controlled by the following flags
    • --accept takes a comma separated list of file endings to accept
    • --reject takes a comma separated list of file endings to reject

Real-World Example

  • As a computational linguist, one of the most important steps in research is to gather data
  • In this example, pretend we want to build a dataset of text found on academic websites
  • The steps we will take are:
    1. Get a list of URLs from a website
    2. Extract the URLS
    3. Use wget to download the websites
    4. Use sed and other tools to strip the text out from the website
In [6]:
wget "https://univ.cc/search.php?dom=edu&key=&start=1" -Ouni_webs.html
--2017-09-28 11:41:28--  https://univ.cc/search.php?dom=edu&key=&start=1
Resolving univ.cc (univ.cc)... 148.251.1.24
Connecting to univ.cc (univ.cc)|148.251.1.24|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5601 (5.5K) [text/html]
Saving to: ‘uni_webs.html’

uni_webs.html       100%[=====================>]   5.47K  --.-KB/s   in 0s     

2017-09-28 11:41:29 (17.4 MB/s) - ‘uni_webs.html’ saved [5601/5601]

In [9]:
grep -Po "<a href='.*?'>.*?</a>" uni_webs.html | \
sed -E "s|<a href='([^']*?)'>(.*?)</a>|\1 \2|g" > targets
In [10]:
mapfile sites_to_get < targets
In [12]:
for target in "${sites_to_get[@]}"; do
    array=( $target )
    url=${array[0]}
    name=${array[@]:1}
    name=${name// /_}
    wget $url -O${name}.html
    tr '\n' ' ' < ${name}.html > ${name}.flat.html
    grep -Po "<p>(.*?)</p>" ${name}.flat.html \
    | sed -E "s|<p>(.*?)</p>|\1|g" > ${name}.txt
    break
done
--2017-09-28 11:46:59--  http://www.acu.edu/
Resolving www.acu.edu (www.acu.edu)... 35.164.249.222, 54.218.51.199
Connecting to www.acu.edu (www.acu.edu)|35.164.249.222|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘Abilene_Christian_University.html’

Abilene_Christian_U     [ <=>                  ]  40.12K  --.-KB/s   in 0.08s  

2017-09-28 11:46:59 (522 KB/s) - ‘Abilene_Christian_University.html’ saved [41084]

In [13]:
cat Abilene_Christian_University.txt
Prepare to successfully enter the workforce through one of 70-plus majors and 135 areas of study. <br /> 
Increase your personal and professional expertise by earning one of our many graduate degrees. <br /> 
Combine convenience and quality by earning your degree in our Christ-centered online community. <br /> 
Welcome the Wildcats home for their first season at Anthony Field at Wildcat Stadium. Opening weekend is September 16 and will include a Needtobreathe concert, tailgating, inaugural game against Houston Baptist and fireworks! Limited seats are available, don't miss out on yours!<br /> 
<a class="button button--orange" href="http://www.acusports.com/fbtix" target="_blank">Learn More</a>
ACU invites you to join a learning community founded on Christian tradition and academic rigor, but open to any student seeking to build their future – regardless of their individual background or beliefs. 
Whether you’re starting college for the first time or returning for a graduate degree, ACU is a place where any conversation on any topic may be engaged with kindness and compassion, even (and especially) when we disagree. ACU invites you to find the program that fulfills your individual purpose.
           Admissions Helpline: <strong>800-460-6228</strong>
           Graduate Advisors Helpline: <strong>855-219-7300</strong>
© 2017 Abilene Christian University

curl

  • curl is a more powerful tool that allows uploading and download over
    • (S)FTP
    • HTTP(S)
    • SCP
    • LDAP
  • curl prints to STDOUT
In [14]:
curl http://www.umbc.edu
<!DOCTYPE html>
<html lang="en">
  <head>
    <meta charset="UTF-8" />
    <title>UMBC: An Honors University In Maryland</title>

    <!-- Always force latest IE rendering engine (even in intranet) & Chrome Frame -->
    <!-- <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> -->

    <!-- Sets the viewport width to the width of the device, so media queries work -->
    <!-- NOTE: We're locking the max scale (which prevents zooming) to fix bugs
         during orientation changes on devices.  Our styles should accomodate this though. -->
<link rel="image_src" href="http://www.umbc.edu/images/UMBC_fb_tmb.png" />
<meta name="description" content="" />
    <meta name="viewport" content="width=device-width, initial-scale=1, minimum-scale=1, maximum-scale=1">
    <link rel="icon" type="image/png" href="images_homepage/icon.png" />

    <!-- Template Styles -->
    <link rel="stylesheet" type="text/css" href="stylesheets/homepage.css" />

    <!-- Site-Specific Customizations -->
    <style type="text/css">

      #site-menu, #site-menu li a, #site-menu li ul {}
      #site-menu li:hover a {}
      #site-menu li a:hover, #site-menu li a:focus {}
      #site-menu .menu-arrow {}
      #site-menu li:hover > a .menu-arrow {}
      #site-footer {}
      #site-footer .site-name {color: #ffffff;}
      #site-footer a {}
      .layout-default .page-container-inner, .layout-home .page-container-inner {}
      /*.layout-default .page-sidebar, .layout-home .page-sidebar, .sidebar-nav a {}*/
      .layout-default .page-sidebar, .layout-home .page-sidebar, .sidebar-nav a {}
      .sidebar-nav a .secondary {}
      .sidebar-nav > ul > li > a, .sidebar-nav > ul > li.current-menu-item > a, .sidebar-nav > ul > li.current-menu-ancestor > a {}
      .sidebar-nav-header {}
      .sidebar-nav a:hover, .sidebar-nav a:focus, .sidebar-nav a:hover .secondary, .sidebar-nav a:focus .secondary { }
      .sidebar-nav .current-menu-item > a:hover > .menu-arrow, .sidebar-nav .current-menu-item > a:focus > .menu-arrow {}
      .sidebar-nav .current-menu-item > a, .sidebar-nav .current-menu-item > a .secondary {}
      .sidebar-nav .current-menu-item > a > .menu-arrow, .sidebar-nav .current-menu-item > a:hover > .menu-arrow, .sidebar-nav .current-menu-item > a:focus > .menu-arrow {}
      .widget .widgettitle {background-color: #cccccc;color: #000000;}
      .widget .widgettitle a {color: #000000;}
      .widget > ul, .widget > .textwidget {background-color: #ffffff;color: #000000;}
      .widget > ul a, .widget > .textwidget a {color: #0088CC;}
      .widget .rss-date, .widget .secondary, .widget_twitter > ul a.timesince {color: #5d5656;}
      .widgetcorner, .widgetcorner .fill {}
      .layout-default .widgetcorner .corner {border-right-color: #909090;}
      .layout-home .widgetcorner .corner {border-left-color: #909090;}
 


      @media screen and (max-width: 767px) {
        #mobile-site-menu-expander {color: #ffffff;}
        .mobile-site-menu-expander-bar {background-color: #ffffff;}
        #site-header {}
        #site-header h1 {font-size: 30px;}
        #site-menu li:hover a {}
        .layout-default .page-sidebar, .layout-home .page-sidebar {}

        /* This is here to override any custom color set by the theme */
        .layout-default .page-container-inner, .layout-home .page-container-inner { background-color: #fff; }
      }

</style>

    <!-- Some custom styles just for older IE versions -->
    <!--[if lte IE 8]>
    <style>
      #container { border: 1px solid #ddd; border-top: none; }
      #site-footer .footer-field { float: left; }
      #site-menu ul li a { border-left: none; }
      #site-menu > ul > li > a .menu-arrow { display: none; }
      .widget-spotlight .playlist li { float: left; display: block; overflow: hidden; }
    </style>
    <![endif]-->

    <!--[if IE]>
    <script src="http://html5shim.googlecode.com/svn/trunk/html5.js"></script>
    <![endif]-->

    <script src="//ajax.googleapis.com/ajax/libs/jquery/1.7.2/jquery.min.js"></script>
    <script src="js/homepage-base.js"></script>
    <script src="js/audience-tabs.js"></script>
    <script src="js/jquery.quovolver.js"></script>


    <meta name="generator" content="UMBC" />
    <!-- Google Analytics -->
    <script type="text/javascript">
      var _gaq = _gaq || [];
      // Primary Tracker
      _gaq.push(
        ['_setAccount', 'UA-1045586-1'],
        ['_trackPageview']
      );


      (function() {
        var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
        ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
        var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
      })();
    </script>
    
    <script>
    $(document).ready(function() {
        
        // Rotating quotes for What other say
        $('#rotating-quotes .quotes').quovolver({
            children : 'li',
            transitionSpeed : 300,
            autoPlay : false,
            equalHeight : false,
            navPosition : 'above',
            navPrev            : false,
            navNext            : false,
            navNum            : true,
            navText            : false,
            navTextContent : 'Quote @a of @b'
        });
        
    });
    </script>
    
    <script type="text/javascript" src="//www.google.com/jsapi"></script>
    <script type="text/javascript">
      google.load('search', '1');
      google.setOnLoadCallback(function() {
        google.search.CustomSearchControl.attachAutoCompletion(
          '008589878477221853669:fglxypz-c8m+qptype:1',
          document.getElementById('umbc-nav-search-query'),
          'umbc-nav-search');
      });
    </script>
    
</head>

<body id="home">

<div id="skip-content"><a href="#main-content">Skip to Main Content</a></div>

<!-- Comment out the alert when not in use -->
<!-- DELAY ALERT-->
<!-- <section class="emergency"><a href="http://bit.ly/1EJ0VYN">Due to inclement weather UMBC will be opening at noon on Monday, March 2.</a></section> -->

<!-- CLOSED ALERT -->
<!-- <section class="emergency"><a href="http://about.umbc.edu/inclement-weather-emergency-closing-policy/">Due to inclement weather, UMBC will close at 8 p.m. on Monday, March 13 and remain closed on Tuesday, March 14.</a></section> -->

<!-- STANDARD ALERT -->
<!-- <section class="emergency">UMBC is currently monitoring winter storm predictions. Please sign up for <a href="http://my.umbc.edu/go/alerts">E2Campus alerts</a> and review our <a href="http://about.umbc.edu/inclement-weather-emergency-closing-policy/">inclement weather procedure</a>.</section> -->

<!-- OTHER ALERT -->
<!-- <section class="emergency">Temporary parking changes on campus today in preparation for UMBC's 50th celebration weekend. <a href="http://50.umbc.edu/temporary-parking-changes-for-sept-15-16/">Learn more</a>.</section> -->

<!-- <span style="background-color: #357BB8;">&#10052; &#10052;</span> --><!-- INCLUDE FOR ALERT -->

<div id="container-header-background"> 
<div id="container-header"><!-- main container -->
<header id="umbc-header"><!-- umbc header -->

<div id="umbc-logo"><a href="http://umbc.edu" title="UMBC: An Honors University in Maryland"><span>UMBC: An Honors University in Maryland</span></a></div>

<nav role="navigation" id="umbc-nav" >
<ul id="umbc-nav-items">
<li id="umbc-nav-azindex"><a href="http://umbc.edu/siteindex">A-Z Index</a></li>
<li id="umbc-nav-myumbc"><a href="http://my.umbc.edu">myUMBC</a></li>
<li id="umbc-nav-events"><a href="http://my.umbc.edu/events">Events</a></li>
<!-- <li id="umbc-nav-computing"><a href="http://umbc.edu/doit">Computing</a></li> -->
<li id="umbc-nav-directory"><a href="http://umbc.edu/search/directory">Directory</a></li>
<li id="umbc-nav-maps"><a href="http://about.umbc.edu/visitors-guide/campus-map/">Maps</a></li>
</ul>

<form role="search" id="umbc-nav-search" action="http://www.umbc.edu/stats/searchthru/" method="get">
<div id="umbc-nav-search-input">
<label for="umbc-nav-search-query">Search UMBC</label>
<input type="hidden" name="cx" value="008589878477221853669:fglxypz-c8m" />
<input type="hidden" name="ie" value="UTF-8" />
<input id="umbc-nav-search-query" type="text" placeholder="Search" autocomplete="off" name="q" size="250" maxlength="250">
<input id="umbc-nav-search-submit" type="submit" value="">
</div>
</form>

</nav>
</header>

<header role="banner" id="site-header" >
<a href="#" id="mobile-site-menu-expander">
<span class="mobile-site-menu-expander-bar"></span>
<span class="mobile-site-menu-expander-bar"></span>
<span class="mobile-site-menu-expander-bar"></span>
</a>
</header>

</div><!-- END umbc header -->

<div id="site-menu-background"> 

<nav role="navigation" id="site-menu"><!-- gold toolbar -->
<ul id="menu-main" class="menu">

<li class="utilities"><a href="">Utilities</a>
<ul class="sub-menu">
<li><a href="http://umbc.edu/siteindex">A-Z Index</a></li>
<li><a href="http://my.umbc.edu">myUMBC</a></li>
<li><a href="http://my.umbc.edu/events">Events</a></li>
<li><a href="http://umbc.edu/search/directory">Directory</a></li>
<li><a href="http://about.umbc.edu/visitors-guide/campus-map/">Maps</a></li>
</ul>
</li>
<!-- PER JAKE DANIEL 9/13/2016 -->
<li><a href="http://about.umbc.edu/">About </a>
<ul class="sub-menu">
	<li><a href="http://about.umbc.edu/administration/">Administration</a>
	<ul class="sub-menu">
		<li><a href="http://president.umbc.edu/">President Hrabowski</a></li>
		<li><a href="http://about.umbc.edu/governance/">Governance</a></li>
	</ul>
</li>
	<li><a href="http://news.umbc.edu/tag/rankings/">Rankings</a></li>
	<li><a href="http://about.umbc.edu/meet-umbc-people/">Meet UMBC People</a></li>
	<li><a href="http://news.umbc.edu">News</a></li>
	<li><a href="http://diversity.umbc.edu/">Diversity and Inclusion</a><!-- UMBC Diversity and Inclusion Resources --></li>
	<li><a href="http://about.umbc.edu/visitors-guide/">Visit Us</a><span class="menu-arrow menu-arrow-right"></span>
	<ul class="sub-menu">
		<li><a href="http://about.umbc.edu/visitors-guide/campus-map/">Campus Maps</a></li>
		<li><a href="http://about.umbc.edu/visitors-guide/directions/">Directions and Parking</a></li>
		<li><a href="http://about.umbc.edu/visitors-guide/research-park-technology-center/">bwtech@UMBC Research and Technology Park</a></li>
		<li><a href="http://about.umbc.edu/visitors-guide/athletics/">Athletics</a></li>
		<li><a href="http://about.umbc.edu/visitors-guide/on-campus-destinations/">On-Campus Destinations</a></li>
		<li><a href="http://about.umbc.edu/visitors-guide/where-to-eat/">Where to Eat</a></li>
		<li><a href="http://about.umbc.edu/visitors-guide/the-surrounding-community/">The Surrounding Community</a></li>
		<li><a href="http://about.umbc.edu/visitors-guide/accommodations/">Accommodations</a></li>
		<li><a href="http://about.umbc.edu/inclement-weather-emergency-closing-policy/">Inclement Weather and Emergency Closing Policy</a></li>
	</ul>
</li>
	<li><a href="http://about.umbc.edu/accreditation/">Accreditation</a></li>
	<li><a href="http://enrollment.umbc.edu/consumer_info/">Consumer Information</a></li>
	<!-- CHANGED PER JAKE 11/30/16 <li><a href="http://www.umbc.edu/hr/employment/index.php">Work at UMBC</a></li> 
	UPDATED 6.2.17 -->
	<li><a href="http://hr.umbc.edu/jobs/">Work at UMBC</a></li>
	<li><a href="http://about.umbc.edu/visitors-guide/contact-us/">Contact Us</a></li>
</ul>
</li>
<!--/ JLD -->
<!-- PER JAKE DANIEL 9/13/2016
<li><a href="">About</a>
<ul class="sub-menu">

<li><a href="http://about.umbc.edu">About UMBC</a></li>
<li><a href="http://president.umbc.edu">President</a></li>
<li><a href="http://about.umbc.edu/administration/">Administration</a></li>
<li><a href="http://news.umbc.edu">News</a></li>
<li><a href="http://about.umbc.edu/visitors-guide/">Visit</a></li>
<li><a href="http://www.umbc.edu/hr/employment/index.html">Jobs</a></li>
<li><a href="http://doit.umbc.edu">Computing</a></li>
<li><a href="http://www.umbc.edu/giving/">Support UMBC</a></li>
</ul>
</li> -->

<li><a href="">Academics</a>
<ul class="sub-menu">
<li><a href="http://www.umbc.edu/colleges">Colleges &amp; Schools</a></li>
<li><a href="http://degrees.umbc.edu">Majors &amp; Programs</a></li>
<li><a href="http://catalog.umbc.edu">Course Catalog (Undergrad)</a></li>
<li><a href="http://www.umbc.edu/gradschool/gradcatalog/">Course Catalog (Graduate)</a></li>
<li><a href="http://registrar.umbc.edu/academic-calendar/">Academic Calendar</a></li>
<li><a href="https://my.umbc.edu/go/schedule">Class Schedule</a></li>
<li><a href="http://www.umbc.edu/online">Online Learning</a></li>
<li><a href="http://www.umbc.edu/aok">Albin O. Kuhn Library</a></li>
<li><a href="http://www.umbc.edu/bookstore">Bookstore</a></li>
</ul>
</li>

<li><a href="">Admissions</a>
<ul class="sub-menu">

<li><a href="http://undergraduate.umbc.edu">Undergraduate</a></li>
<li><a href="http://www.umbc.edu/gradschool/">Graduate</a></li>
<li><a href="http://www.umbc.edu/financialaid">Financial Aid &amp; Scholarships</a></li>
<li><a href="http://www.umbc.edu/dps">Professional Studies</a></li>
<li><a href="http://summerwinter.umbc.edu ">Summer &amp; Winter Sessions</a></li>
<li><a href="http://www.umbctraining.com">Training Centers</a></li>
</ul>
</li>

<li><a href="">Arts &amp; Culture</a>
<ul class="sub-menu">

<li><a href="http://www.umbc.edu/arts">Calendar</a></li>
<li><a href="http://www.umbc.edu/aok">Albin O. Kuhn Library &amp; Gallery</a></li>
<li><a href="http://www.umbc.edu/cadvc/">Center for Art, Design and Visual Culture</a></li>
<li><a href="http://www.umbc.edu/engage">Learn More</a></li>

</ul>
</li>

<li><a href="">Athletics</a>
<ul class="sub-menu">

<li><a href="http://www.umbcretrievers.com/">UMBCRetrievers.com</a></li>
<li><a href="http://umbcretrievers.com/composite">Schedule</a></li>
<li><a href="http://umbcretrievers.com/tickets">Tickets</a></li>
<li><a href="http://umbcretrievers.com/information/facilities">Facilities/Directions</a></li>
<li><a href="http://recreation.umbc.edu/">Recreation</a></li>
<li><a href="http://bookstore.umbc.edu/MerchList.aspx?ID=7069">Fan Gear</a></li>
<li><a href="http://umbcretrievers.com/information/camps">Camps</a></li>
</ul>
</li>

<li><a href="">Research</a>
<ul class="sub-menu">

<li><a href="http://research.umbc.edu">About Research</a></li>
<li><a href="http://research.umbc.edu/umbc-research-news/">Research News</a></li>
<li><a href="http://research.umbc.edu/research-centers-institutes/">Research Centers &amp; Institutes</a></li>
<li><a href="http://www.umbc.edu/aok">Albin O. Kuhn Library</a></li>
<li><a href="http://doit.umbc.edu">Computing</a></li>
</ul>
</li>

<li><a href="">Support UMBC</a>
<ul class="sub-menu">
<li><a href="http://alumni.umbc.edu/support">Make a Gift</a></li>
<li><a href="http://giving.umbc.edu">Why Giving Matters</a></li>
<li><a href="https://umbc.givecorps.com/">Support Student Projects</a></li>
</ul>

</li>
</ul>      
</nav> <!-- END gold toolbar --><!-- INCLUDE FOR GOLD NAV -->

</div></div>

<div id="container"> <!-- main container -->

<!-- START WINDOW START WINDOW START WINDOW START WINDOW START WINDOW START WINDOW START WINDOW START WINDOW -->
<!-- WINDOW IS 1024 x 380px WINDOW THUMBNAIL IS 128 x 35px -->

<section class="page-content">
<section class="home-widgets">
<div class="widget widget-spotlight">
<div class="panels">

<!-- TWO LINKS PER WINDOW - DON'T FORGET MOBILE LINK  --> 
<!-- REMEMBER image mobile AND content-details SHOULD BE RIGHT LEFT OR CENTER FOR image AND RIGHT OR LEFT FOR content -->
<!-- description SHOULD BE USED FOR PHOTO CREDIT -->


<div class="panel panel-1">
<div class="image mobile-left"><img src="images_homepage/win_Climate-Scientist-and-Mentor-Honored-17.jpg" alt="Climate Scientist and Mentor Honored"></div>
<div class="content-details right">
<a class="mobile-seemore" href="http://bit.ly/2wQkC3N">&raquo;</a>
<div class="title">Honoring a Climate Scientist and Mentor</div>
<div class="tagline">JCET Director Belay Demoz is elected a fellow of the American Meteorological Society.</div>
<a class="web-seemore" href="http://bit.ly/2wQkC3N">Read more &raquo;</a>
</div>
</div>



<div class="panel panel-2">
<div class="image mobile-center"><img src="images_homepage/win_National-Excellence-in-Innovation-and-Teaching17.jpg" alt="National Excellence in Innovation and Teaching"></div>
<div class="content-details right">
<a class="mobile-seemore" href="http://bit.ly/2h2wpnY">&raquo;</a>
<div class="title">National Excellence in Innovation and Teaching</div>
<div class="tagline">Growing Retriever community celebrates U.S. News spotlight on UMBC.</div>
<a class="web-seemore" href="http://bit.ly/2h2wpnY">Read more &raquo;</a>
</div>
</div>

<div class="panel panel-3">
<div class="image mobile-center"><img src="images_homepage/win_Strong-Connections-Meaningful-Work2.jpg" alt="Strong Connections, Meaningful Work"></div>
<div class="content-details left">
<a class="mobile-seemore" href="http://bit.ly/2wPg3sd">&raquo;</a>
<div class="title">Strong Connections, Meaningful Work</div>
<div class="tagline">UMBC alumni mentors give today’s students a glimpse of possible career paths.</div>
<a class="web-seemore" href="http://bit.ly/2wPg3sd">Read more &raquo;</a>
</div>
</div>

<div class="panel panel-4">
<div class="image mobile-right"><img src="images_homepage/win_Earth-Space-UMBC-NASA.jpg" alt="Earth and Space Institute"></div>
<div class="content-details right">
<a class="mobile-seemore" href="http://bit.ly/2jLBQwx">&raquo;</a>
<div class="title">Earth and Space Institute</div>
<div class="tagline">New UMBC research center builds on decades of NASA collaboration.</div>
<a class="web-seemore" href="http://bit.ly/2jLBQwx">Read more &raquo;</a>
</div>
</div>


<div class="panel panel-5">
<div class="image mobile-center"><img src="images_homepage/win_Building-Robots-Breaking-Stereotypes.jpg" alt="Building Robots, Breaking Stereotypes"></div>
<div class="content-details right">
<a class="mobile-seemore" href="http://bit.ly/2hsh3gm">&raquo;</a>
<div class="title">Building Robots, Breaking Stereotypes</div>
<div class="tagline">UMBC Ph.D. candidate Kavita Krishnaswamy receives Google and Microsoft awards for robotics research.</div>
<a class="web-seemore" href="http://bit.ly/2hsh3gm">Read more &raquo;</a>
</div>
</div>


<div class="panel panel-6">
<div class="image mobile-center"><img src="images_homepage/win_UMBC-Alumnus-Becomes-U.S.-Surgeon-General.jpg" alt="UMBC Alumnus Becomes U.S. Surgeon General"></div>
<div class="content-details right">
<a class="mobile-seemore" href="http://bit.ly/2vPbC15">&raquo;</a>
<div class="title">UMBC Alumnus Becomes U.S. Surgeon General</div>
<div class="tagline">Senate confirms Jerome Adams, recognizing his career serving vulnerable populations.</div>
<a class="web-seemore" href="http://bit.ly/2vPbC15">Read more &raquo;</a>
</div>
</div>

<div class="panel panel-7">
<div class="image mobile-left"><img src="images_homepage/win_Pausing-the-Clock.jpg" alt="Commitment to Excellence"></div>
<div class="content-details right">
<a class="mobile-seemore" href="http://bit.ly/2iDMkxc">&raquo;</a>
<div class="title">Pausing the Clock</div>
<div class="tagline">UMBC's Gymama Slaughter works to extend viability of life-saving organs awaiting transplant with innovative bioreactor.</div>
<a class="web-seemore" href="http://bit.ly/2iDMkxc">Read more &raquo;</a> 
</div>
</div>


  






<!--VIRTUAL TOUR EVERGREEN
<div class="panel panel-5">
<div class="image mobile-center"><img src="images_homepage/win_virtualtour.jpg" alt="Virtual Tour"></div>
<div class="content-details right">
<a class="mobile-seemore" href="http://www.umbc.edu/undergraduate/experience/virtual_tour_2011.html">&raquo;</a>
<div class="title">Virtually Us</div>
<div class="tagline">Can't make it to campus? No problem &ndash; we'll bring it to you.</div>
<div class="description">No problem - we'll bring it to you. It's virtually the same.</div> 
<a class="web-seemore" href="http://www.umbc.edu/undergraduate/experience/virtual_tour_2011.html">Take a virtual tour &raquo;</a>
</div>
</div>  -->

</div>

<!-- WINDOW THUMBNAIL IS 128 x 35px --> 
<!-- win_LIVEWIRE-a.jpg -->
<div class="playlist"><ul>
  <li class="item-1"><img src="images_homepage/win_Climate-Scientist-and-Mentor-Honored-17_tmb.jpg" alt="Climate Scientist and Mentor Honored"></li>
  <li class="item-2"><img src="images_homepage/win_National-Excellence-in-Innovation-and-Teaching17_tmb.jpg" alt="National Excellence in Innovation and Teaching"></li>
  <li class="item-3"><img src="images_homepage/win_Strong-Connections-Meaningful-Work2_tmb.jpg" alt="Strong Connections, Meaningful Work"></li>
  <li class="item-4"><img src="images_homepage/win_Earth-Space-UMBC-NASA_tmb.jpg" alt="Earth and Space Institute"></li>
<li class="item-5"><img src="images_homepage/win_Building-Robots-Breaking-Stereotypes_tmb.jpg" alt=" Building Robots, Breaking Stereotypes"></li>
<li class="item-6"><img src="images_homepage/win_UMBC-Alumnus-Becomes-U.S.-Surgeon-General_tmb.jpg" alt="UMBC Alumnus Becomes U.S. Surgeon General"></li>

<li class="item-7"><img src="images_homepage/win_Pausing-the-Clock_tmb.jpg" alt="Pausing the Clock"></li>
<!--<li class="item-5"><img src="images_homepage/win_tmb_virtualtour.jpg" alt="Virtual Tour"></li> -->
</ul></div>
</div>


</section><!-- END window -->

<!-- START AUDIENCE TAB LINKS START AUDIENCE TAB LINKS START AUDIENCE TAB LINKS -->
<!-- AUDIENCE IMAGES ARE 250 x 75px -->
<div id="audience-tabs">

<ul class="tabs">
<li><a href="#" class="defaulttab" data-tab="tabs1" onClick="return false;">Prospective <span class="mobile">Students</span></a></li>
<li><a href="#" data-tab="tabs2" onClick="return false;">Current <span class="mobile">Students</span></a></li>
<li><a href="#" data-tab="tabs3" onClick="return false;">Parents &amp; Family</a></li>
<li><a href="#" data-tab="tabs4" onClick="return false;">Faculty &amp; Staff</a></li>
<li><a href="#" data-tab="tabs5" onClick="return false;">Alumni <span class="mobile">&amp; Supporters</span></a></li>
<li><a href="#" data-tab="tabs6" onClick="return false;">Businesses <span class="mobile">&amp; Employers</span></a></li>
</ul>

<!-- PROSPECTIVE STUDENTS TAB PROSPECTIVE STUDENTS TAB PROSPECTIVE STUDENTS TAB -->
 
<div class="tab-content" id="tabs1">
<div class="column1">
<h3>Admissions</h3>
<img src="images_homepage/ps_admission.jpg" alt="Admission thumbnail">
<p><a href="http://undergraduate.umbc.edu">Undergraduate Admissions</a></p>
<p><a href="http://www.umbc.edu/gradschool/">Graduate School Admissions</a></p>
<p><a href="http://www.umbc.edu/dps/">Division of Professional Studies</a></p>
<p><a href="http://www.umbctraining.com">Training Centers</a></p>
<p><a href="http://www.umbc.edu/financialaid">Financial Aid &amp; Scholarships</a></p>
<p><a href="http://enrollment.umbc.edu/consumer_info/">Consumer Information</a></p>
<p><a href="http://about.umbc.edu">Fast Facts </a></p>
</div>
    
<div class="column2">
<h3>Campus Life</h3> 
<img src="images_homepage/ps_campuslife.jpg" alt="Campus Life thumbnail">
<p><a href="http://undergraduate.umbc.edu/majors.php">Undergraduate Majors &amp; Programs</a></p>
<p><a href="http://www.umbc.edu/gradschool/programs/all_programs.html">Graduate School Programs</a></p>
<p><a href="http://www.umbc.edu/wordsofwisdom/">Faculty Words of Wisdom</a></p>
<p><a href="http://osl.umbc.edu/orgs/list/">Clubs &amp; Organizations</a></p>
<p><a href="http://www.umbc.edu/arts">Arts &amp; Culture</a></p>
<p><a href="http://www.umbcretrievers.com/">UMBC Athletics</a></p>
<p><a href="http://www.umbc.edu/reslife/">Living on Campus</a></p>
</div>
    
<div class="column3">
<h3>Visiting</h3> 
<img src="images_homepage/ps_visiting.jpg" alt="Visiting thumbnail">
<p><a href="http://about.umbc.edu/visitors-guide">Visitor's Guide</a></p>
<p><a href="http://about.umbc.edu/visitors-guide/campus-map/">Campus Maps</a></p>
<p><a href="http://www.umbc.edu/aok">Albin O. Kuhn Library</a></p>
<p><a href="http://www.umbc.edu/bookstore">UMBC Bookstore</a></p>
<p><a href="https://secure.visualzen.com/vzevents/umbc/">Undergraduate Admissions Tours</a></p>
<p><a href="http://undergraduate.umbc.edu/visit/virtual-tour.php">Virtual Tour</a></p>
</div>
</div>

<!-- CURRENT STUDENTS TAB CURRENT STUDENTS TAB CURRENT STUDENTS TAB CURRENT STUDENTS TAB CURRENT STUDENTS TAB -->

<div class="tab-content" id="tabs2">
<div class="column1">
<h3>Get Involved</h3>
<a href="http://www.umbc.edu/studentlife"><img src="images_homepage/cs_getinvolved.jpg" alt="Get Involved thumbnail"></a>
<p><a href="http://my.umbc.edu/topics/involvement-and-leadership">Involvement &amp; Leadership </a></p>
<p><a href="http://my.umbc.edu/topics/arts-culture-and-entertainment">Arts, Culture &amp; Entertainment</a> </p>
<p><a href="http://my.umbc.edu/topics/diversity">Diversity</a></p>
<p><a href="http://undergraduate.umbc.edu/community/professors-not-to-miss.php">Professors Not to Miss</a></p>
<p><a href="http://umbcbreakingground.wordpress.com/">UMBC BreakingGround</a></p>
<p><a href="http://www.umbcretrievers.com/">Athletics &amp; Recreation</a></p>
<p><a href="http://my.umbc.edu/events">Events</a></p>
</div>
    
<div class="column2">
<h3>Get Help</h3> 
<a href="http://www.umbc.edu/saf"><img src="images_homepage/cs_support.jpg" alt="Support Services thumbnail"></a>
<p><a href="http://www.umbc.edu/saf/">Student Affairs</a></p>
<p><a href="http://my.umbc.edu/topics/advising-and-student-support">Advising &amp; Student Support</a></p>
<p><a href="http://my.umbc.edu/topics/jobs-and-internships">Jobs &amp; Internships</a></p>
<p><a href="http://my.umbc.edu/topics/billing-and-personal-finances">Billing &amp; Personal Finances</a></p>
<p><a href="http://my.umbc.edu/topics/housing-on-and-off-campus">Housing</a></p>
<p><a href="http://my.umbc.edu/topics/parking-and-transportation">Parking &amp; Transportation</a></p>
<p><a href="http://my.umbc.edu/topics/food-and-dining">Food &amp; Dining </a></p>
<p><a href="http://my.umbc.edu/topics/health-wellness-and-safety">Health, Wellness &amp; Safety </a></p>
</div>
    
<div class="column3">
<h3>Top Tools</h3> 
<a href="http://my.umbc.edu"><img src="images_homepage/cs_myumbc.jpg" alt="myUMBC thumbnail"></a>
<p><a href="http://my.umbc.edu">myUMBC</a></p>
<p><a href="http://www.umbc.edu/aok">Albin O. Kuhn Library</a></p>
<p><a href="http://my.umbc.edu/topics/classes-and-grades">Classes &amp; Grades </a></p>
<p><a href="http://www.umbc.edu/catalog/2012/index.php">Course Catalog</a></p> 
<p><a href="http://registrar.umbc.edu/academic-calendar/">Academic Calendar</a></p>
<p><a href="http://campuscard.umbc.edu/">Campus Card/Mail Services</a></p>
<p><a href="http://www.umbc.edu/saf/policies/pdfs/UMBC_Student_Handbook.pdf">UMBC Student Handbook</a></p>
</div>
</div>
    
<!-- PARENT FAMILY TAB PARENT FAMILY TAB PARENT FAMILY TAB FAMILY TAB FAMILY TAB FAMILY TAB -->

<div class="tab-content" id="tabs3"><div class="column1">
<h3>Resources</h3>
<img src="images_homepage/pf_family.jpg" alt="Parent Family Resources thumbnail">
<p><a href="http://my.umbc.edu/topics/advising-and-student-support">Advising &amp; Student Support  </a></p>
<p><a href="http://my.umbc.edu/topics/health-wellness-and-safety">Health, Wellness &amp; Safety  </a></p>
<p><a href="http://my.umbc.edu/topics/billing-and-personal-finances">Billing &amp; Personal Finances  </a></p>
<p><a href="http://www.umbc.edu/financialaid/">Financial Aid &amp; Scholarships  </a></p>
<p><a href="http://my.umbc.edu/topics/jobs-and-internships">Jobs &amp; Internships  </a></p>
<p><a href="http://my.umbc.edu/topics/housing-on-and-off-campus">Housing  </a></p>
<p><a href="http://my.umbc.edu/topics/parking-and-transportation">Parking &amp; Transportation  </a></p>
<p><a href="http://my.umbc.edu/topics/food-and-dining">Food &amp; Dining </a></p>
</div>
    
<div class="column2">
<h3>Visiting</h3> 
<img src="images_homepage/pf_visiting.jpg" alt="Visiting thumbnail">
<p><a href="http://about.umbc.edu/visitors-guide">Visitor's Guide</a></p>
<p><a href="http://about.umbc.edu/visitors-guide/campus-map/">Campus Maps</a></p>
<p><a href="http://www.umbc.edu/aok">Albin O. Kuhn Library</a></p>
<p><a href="http://www.umbc.edu/bookstore">UMBC Bookstore</a></p>
<p><a href="https://secure.visualzen.com/vzevents/umbc/">Schedule an Undergraduate Tour</a></p>
<p><a href="http://undergraduate.umbc.edu/visit/virtual-tour.php">Take our virtual tour</a></p>
</div>

<div class="column3">
<h3>Connect </h3> 
<p><a href="http://my.umbc.edu/groups/parents">Family Connection </a></p>
<p><a href="http://umbc.us7.list-manage.com/subscribe?u=f6412bb434bcfb2aa45386155&id=1df27fef01">Sign Up for Newsletter</a></p>
<p><a href="http://www.umbc.edu/saf/">Student Affairs</a></p>

<h3>Support UMBC </h3> 
<p><a href="http://www.umbc.edu/giving">Make a Gift</a></p>
</div>
</div>
    
<!-- FAC STAFF TAB FAC STAFF TAB FAC STAFF TAB FAC STAFF TAB FAC STAFF TAB FAC STAFF TAB FAC STAFF TAB -->
 
<div class="tab-content" id="tabs4">
<div class="column1">
<h3>Resources</h3>
<a href="http://www.umbc.edu/facultystaff/ "><img src="images_homepage/fs_library.jpg" alt="Library thumbnail"></a>
<p><a href="http://my.umbc.edu/topics/advising-and-student-support">Advising &amp; Student Support</a></p>
<p><a href="http://my.umbc.edu/topics/parking-and-transportation">Parking &amp; Transportation</a></p> 
<p><a href="http://my.umbc.edu/topics/food-and-dining">Food &amp; Dining</a></p>
<p><a href="http://my.umbc.edu/topics/health-wellness-and-safety">Health, Wellness &amp; Safety</a></p>
<p><a href="http://my.umbc.edu/events">Events </a></p>
<p><a href="http://www.umbc.edu/policies/">University Policies</a></p>
<p><a href="http://fdc.umbc.edu/">Faculty Development Center</a></p>
</div>

<div class="column2">
<h3>UMBC Insights</h3>
<p><a href="http://umbcinsights.wordpress.com/">News for the University Community</a></p>

<h3>Human Resources</h3> 
<p><a href="http://www.umbc.edu/hr/">HR Website </a></p>
<p><a href="http://www.umbc.edu/hr/newemployeeresources/benefits.html">Benefits Information</a></p>
<p><a href="http://www.umbc.edu/hr/supervisortoolkit/supervisortoolkitindex.html">Resources for Supervisors</a></p>

<h3>Jobs at UMBC</h3> 
<p><a href="http://www.umbc.edu/hr/employment/index.html">Employment Opportunities</a></p>
<p><a href="http://www.umbc.edu/hr/newemployeeresources/welcome.html">Resources for New Employees</a></p>
</div>

<div class="column3">
<h3>Top Tools</h3> 
<a href="http://my.umbc.edu"><img src="images_homepage/cs_myumbc.jpg" alt="myUMBC thumbnail"></a>
<p><a href="http://my.umbc.edu/topics/faculty-center">myUMBC Faculty Center  </a></p>
<p><a href="http://my.umbc.edu/topics/staff-center">myUMBC Staff Center   </a></p>
<p><a href="http://www.umbc.edu/aok">Albin O. Kuhn Library</a></p>
<p><a href="http://registrar.umbc.edu/academic-calendar/">Academic Calendar</a></p>
<p><a href="http://www.umbc.edu/catalog/">Course Catalog</a></p>
<p><a href="http://campuscard.umbc.edu/">Campus Card/Mail Services</a></p>
</div>
</div>

<!-- ALUMNI SUPPORTER TAB ALUMNI SUPPORTER TAB ALUMNI SUPPORTER TAB ALUMNI SUPPORTER TAB ALUMNI SUPPORTER TAB -->

<div class="tab-content" id="tabs5"><div class="column1">
<h3>Alumni Association</h3>
<a href="http://alumni.umbc.edu"><img src="images_homepage/as_alumni.jpg" alt="Support Services thumbnail"></a>
<p><a href="http://alumni.umbc.edu/s/1325/1col.aspx?sid=1325&amp;gid=1&amp;pgid=316">Get Involved</a></p>
<p><a href="http://umbcalumni.wordpress.com/">News</a> </p>
<p><a href="http://alumni.umbc.edu/s/1325/1col.aspx?sid=1325&amp;gid=1&amp;pgid=13&amp;cid=664">Events</a></p>
<p><a href="http://umbcalumni.wordpress.com/alumni-award-winners/">Alumni Awards</a></p>
</div>
    
<div class="column2">
<h3>UMBC Magazine</h3> 
<a href="http://www.umbc.edu/magazine"><img src="images_homepage/as_magcover.jpg" alt="UMBC Magazine thumbnail"></a>
<p><a href="http://umbcmagazine.wordpress.com">Visit the magazine online </a></p>
</div>
    
<div class="column3">
<h3>Give to UMBC</h3> 
<a href="http://www.umbc.edu/giving"><img src="images_homepage/as_giving.jpg" alt="Give to UMBC thumbnail"></a>
<p><a href="https://secure.imodules.com/s/1325/giving_social.aspx?sid=1325&amp;gid=1&amp;pgid=564&amp;cid=1258">Give Now</a></p>
<p><a href="http://www.umbc.edu/giving/learn/annualfund.html">Annual Giving</a></p> 
<p><a href="http://umbcgiving.wordpress.com/">Giving Stories</a></p>
</div>
</div>

<!-- BUSINESSES AND SUPPORTERS TAB BUSINESSES AND SUPPORTERS TAB BUSINESSES AND SUPPORTERS TAB BUSINESSES AND SUPPORTERS TAB -->

<div class="tab-content" id="tabs6">
<div class="column1">
<h3>bwtech@UMBC</h3> 
<a href="http://www.bwtechumbc.com/"><img src="images_homepage/cp_bwtech.jpg" alt="bwtech thumbnail"></a>
<p><a href="http://www.bwtechumbc.com/">About bwtech@UMBC<br />Research &amp; Technology Park</a></p>
<p><a href="http://www.bwtechumbc.com/">Programs</a></p>
<p><a href="http://www.bwtechumbc.com//facilities/space.html">Acquire Space</a></p>  
<p><a href="http://www.bwtechumbc.com//about/directions.html">Maps &amp; Directions</a></p>
</div>
    
<div class="column2">
<h3>Work With Us</h3> 
<a href="http://www.umbc.edu/business"><img src="images_homepage/cp_business.jpg" alt="Corporate Relations thumbnail"></a>
<p><a href="http://www.umbc.edu/business/">Learn How</a></p> 
<p><a href="http://www.umbc.edu/business/students.php">Access Students</a></p>
<p><a href="http://www.umbc.edu/business/training.php">Access Training</a></p>
<p><a href="http://www.umbc.edu/business/research.php">Access Research</a></p>
<p><a href="http://www.umbc.edu/business/space.php">Access Space</a></p>
<p><a href="http://www.umbc.edu/business/support.php">Support UMBC</a></p>  
</div>
    
<div class="column3">
<h3>Give to UMBC</h3> 
<a href="http://www.umbc.edu/giving"><img src="images_homepage/bs_giving.jpg" alt="Give to UMBC thumbnail"></a>
<p><a href="https://secure.imodules.com/s/1325/giving_social.aspx?sid=1325&amp;gid=1&amp;pgid=564&amp;cid=1258">Give Now</a></p>
<p><a href="http://www.umbc.edu/giving/learn/annualfund.html">Annual Giving</a></p> 
<p><a href="http://umbcgiving.wordpress.com/">Giving Stories</a></p>
</div>
</div>

</div>

<!-- END audience links -->

<!-- news and events news and events news and events news and events news and events news and events-->

<section class="page-container layout-home">
<section class="page-content">
    
<article role="main">
 
<div class="news"> 

<h1>News</h1>

<!-- COPY A PREVIOUS HEADLINE AND UPDATE URL AND HEADLINE TITLE BUT KEEP TAG FORMATTING INTACT ~ REMEMBER TO PUT PUBLICATION NAME BETWEEN <i> TAGS  -->
<!-- ampersand is &amp; em dash is &mdash; -->


<!-- 9/25 -->
<p><a href="http://bit.ly/2xAfwdU">UMBC responds to U.S. Department of Education's Title IX guidance changes</a><br><span style="color:#666666;"><em>Sept. 25, 2017</em></span></p>

<!-- 9/25 -->
<p><a href="http://bit.ly/2xvc96z">Christy Ford Chapin begins Library of Congress fellowship, continuing history faculty's trend of research achievement</a><br><span style="color:#666666;"><em>September 25, 2017</em></span></p>

<!-- 9/20 -->
<p><a href="http://bit.ly/2xr7Bj3">UMBC to build on success in shrinking carbon footprint through updated Climate Action Plan</a><br><span style="color:#666666;"><em>September 20, 2017</em></span></p>

<!-- 9/20 -->
<p><a href="http://bit.ly/2wHkWA8">How Girls Code connects young women to computer science and robotics at UMBC</a><br><span style="color:#666666;"><em>September 20, 2017</em></span></p>

<!-- 8/24 -->
<p><a href="http://bit.ly/2fBwkbe">UMBC's Amy Hurst and William Easley connect with Baltimore teens through 3D printing makerspace</a><br><span style="color:#666666;"><em>September 19, 2017</em></span></p><!-- INCLUDE for NEWS -->

<p><a href="http://news.umbc.edu/" class="moreinfo">More news headlines &raquo;</a></p>
<p><a href="http://president.umbc.edu/" class="moreinfo">President Hrabowski's media appearances, publications, and speeches &raquo;</a></p>
</div>   

<div class="events"> 

<h1>Events</h1>

<!-- COPY A PREVIOUS EVENT AND UPDATE DATE URL AND EVENT NAME BUT KEEP TAG FORMATTING INTACT ~ TWO EVENTS FOR SAME DATE SHOULD BE SEPARATED BY br SOONEST DATES FIRST-->


<p class="date">10/5</p>
<p><a href="http://homecoming.umbc.edu/2017-alumni-awards/">2017 Alumni Awards</a></p>

<p class="date">10/13</p>
<p><a href="http://homecoming.umbc.edu/comedy-show-with-trevor-noah/">Homecoming 2017: Comedy Show with Trevor Noah</a></p>

<p class="date">10/14</p>
<p><a href="http://homecoming.umbc.edu/carnival/">Homecoming 2017 Carnival</a></p><!-- INCLUDE FOR EVENTS -->

<p><a href="http://my.umbc.edu/events" class="moreevent">More events &raquo;</a></p>
</div>   
      
<div class="whatotherssay"> 

<h1>UMBC Campaign</h1>
<div class="demo" id="rotating-quotes">
<div class="quotes">

<ul>
<li><a href="http://giving.umbc.edu/"><img src="images_homepage/campaign-logo-cropped.jpg"><br>For 50 years, we have called on our GRIT to do GREAT things. Now we are calling on YOU.</a></li>
<li><!--
<blockquote>
<p>&ldquo;This midsize state university has earned a reputation as one of the most innovative schools in the country.&rdquo;</p>
<p>&mdash;<em><a href="http://www.cbsnews.com/video/watch/?id=7388127n&tag=contentBody;storyMediaBox">&ldquo;60 Minutes&rdquo;</a></em></p>
</blockquote> --><a href="http://50.umbc.edu/timeline/">
<img src="images_homepage/50th-4.jpg"><br>Timeline: 50 Years of Grit &amp; Greatness</a>
</li>
<li><a href="http://50.umbc.edu/weekendroundup/"><img src="images_homepage/50thFIREWORKS.jpg"><br>Highlights from UMBC's 50th Anniversary Celebration Weekend</a></li>
        <!-- COMMENTED OUT FOR 50TH                        
<li>
<blockquote>
<p>&ldquo;An institution that combines the best of a major research center while keeping its focus on undergraduates.&rdquo;</p>
<p>&mdash;<a href="http://www.washingtonpost.com/opinions/u-md-baltimore-county-serves-its-students-well/2012/04/09/gIQAneVv6S_story.html"><em>The Washington Post</em></a></p>
</blockquote>
</li>
                                
<li>
<blockquote>
<p>&ldquo;When you think of the top science universities in the U.S., schools like MIT and Caltech may jump to mind. But perhaps the most envied science program in the country is at the University of Maryland, Baltimore County.&rdquo;</p>
<p>&mdash;<em><a href="http://www.time.com/time/specials/packages/article/0,28804,2111975_2111976_2112119,00.html">TIME</a></em></p>
</blockquote>
</li>

<li>
<blockquote>
<p>&ldquo;Students here [at UMBC] are given access to academic and social resources usually reserved for those attending mammoth public institutions or pricey private colleges.&rdquo;</p>
<p>&mdash;<a href="http://www.umbc.edu/window/fiske_guide_honors.html"><em>Fiske Guide to Colleges</em></a></p>
</blockquote>
</li>
                                
<li>
<blockquote>
<p>&ldquo;Up-and-Coming Schools,&rdquo;like #1 UMBC, are &ldquo;making the most promising and innovative changes in the areas of academics, faculty, and student life.&rdquo;</p>
<p>&mdash;<em><a href="http://colleges.usnews.rankingsandreviews.com/best-colleges/rankings/national-universities/up-and-coming">U.S. News &amp; World Report</a></em></p>
</blockquote>
</li>
                                
<li>
<blockquote>
<p>&ldquo;Continue[s] to deliver a great education at prices that put private schools to shame&rdquo;</p>
<p>&mdash;<a href="http://www.kiplinger.com/magazine/archives/best-values-in-public-colleges-2012.html"><em>Kiplinger&rsquo;s</em> &ldquo;Best Values in Public Colleges&rdquo;</a></p>
</blockquote>
</li>
 -->
 <!--                               
<li>
<blockquote>
<p>&ldquo;Of all the research universities we visited, UMBC was the place that we thought had most capably connected its research functions with its undergraduate schooling.&rdquo;</p>
<p>&mdash;<a href="http://www.umbc.edu/blogs/umbcnews/2010/09/post_3.html">&ldquo;Higher Education?&rdquo; by Andrew Hacker & Claudia Dreifus</a></p>
</blockquote>
</li> -->

</ul>
</div><!-- .quotes -->
</div><!-- .demo -->
                    
</div><!-- .whatotherssay -->
</article>
</section>
  
<!-- END News Events and What Others Say END News Events and What Others Say -->
  
</section>

<!-- footer start -->
<footer role="contentinfo" id="site-footer"></footer>   

</section>
</div> <!-- #container -->
<footer role="contentinfo" id="umbc-footer">
<div id="umbc-footer-logo"><a href="http://umbc.edu" title="UMBC: An Honors University in Maryland"><span>UMBC: An Honors University in Maryland</span></a></div>
<!-- =JLD -->
<div id="usmd-footer-logo"><a href="http://www.usmd.edu/" title="Univeristy System of Maryland"><span>Univeristy System of Maryland</span></a></div>
<br style="clear:both;"><br>
<nav id="umbc-footer-nav" style="clear:both;">
<ul id="umbc-footer-nav-items">
<li><a href="http://about.umbc.edu">About UMBC</a></li>
<li><a href="mailto:homepage@umbc.edu">Contact Us</a></li>
<li><a href="http://umbc.edu/go/equal-opportunity">Equal Opportunity</a></li>
<li>Community: <a href="https://www.facebook.com/umbcpage" id="umbc-footer-facebook"><span class="none">Facebook</span></a> <a href="http://twitter.com/umbc" id="umbc-footer-twitter"><span class="none">Twitter</span></a> <a href="http://www.youtube.com/user/UMBCtube" id="umbc-footer-youtube"><span class="none">YouTube</span></a> <a href="http://alumni.umbc.edu/" id="umbc-footer-rn"><span class="none">Retriever Net</span></a></li>
</ul>
</nav>

<div id="umbc-footer-info">&copy; University of Maryland, Baltimore County <span class="bullet">&bull;</span> 1000 Hilltop Circle <span class="bullet">&bull;</span> Baltimore, MD 21250
</div>

</footer>

</body>
</html>
In [15]:
curl -I http://www.umbc.edu
HTTP/1.1 200 OK
Date: Thu, 28 Sep 2017 15:48:42 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.1e-fips mod_fcgid/2.3.9 PHP/5.4.16 mod_perl/2.0.10 Perl/v5.16.3
X-Powered-By: PHP/5.4.16
Content-Type: text/html; charset=UTF-8

POST requests

  • We will look at HTTP requests more in detail in a few weeks
  • IF you submit something in a form and don't see a crazy web address, it was probably submitted using POST
  • curl allows POST by using the -X flag
    curl -X POST -d "DATA" URL
    

Debugging in bash

  • The bash command itself has several flags are are useful in debugging
  • The flags are included as part of the shebang line
    #!/bin/bash FLAGS
    
  • The main flags for debugging are
    • -n Step the through the script but do not running, good for finding syntax errors
    • -x Prints traces of commands and their arguments
In [16]:
cat syntax_example.sh
#!/bin/bash -n
echo "HELLO"
In [17]:
./syntax_example.sh
In [18]:
cat syntax_error_example.sh
#!/bin/bash -n
for i in (1 2 3 4); do
echo "HELLO"


In [19]:
./syntax_error_example.sh
./syntax_error_example.sh: line 2: syntax error near unexpected token `('
./syntax_error_example.sh: line 2: `for i in (1 2 3 4); do'

In [20]:
cat ./cla_debug.sh
#!/bin/bash -x
echo "The name of the file is $0"
echo "You passed $# arguments"

echo "The first argument is $1"
echo "The second argument is $2"

echo "All the arguments are $@"
In [21]:
./cla_debug.sh Arg1 SOmething goes here
+ echo 'The name of the file is ./cla_debug.sh'
The name of the file is ./cla_debug.sh
+ echo 'You passed 4 arguments'
You passed 4 arguments
+ echo 'The first argument is Arg1'
The first argument is Arg1
+ echo 'The second argument is SOmething'
The second argument is SOmething
+ echo 'All the arguments are Arg1' SOmething goes here
All the arguments are Arg1 SOmething goes here