[FRIAM] scraping a web site

Wed Jan 4 17:44:22 EST 2017

Yes, I’d usually use my phone for reading if it weren’t for the paywall boundaries.  If someone insists on forcing a PDF on me, fine, but it is so much faster to find things with HTML than tortured LaTeX output.  And minimize the damned JavaScript gumming everything up.  Simple declarative content.   Actual printouts are just a way to get more screen real estate than I have when I’m trying to learn something new.

From: Friam [mailto:friam-bounces at redfish.com] On Behalf Of Gary Schiltz
Sent: Wednesday, January 04, 2017 3:34 PM
To: The Friday Morning Applied Complexity Coffee Group <friam at redfish.com>
Subject: Re: [FRIAM] scraping a web site

As if Nick's head isn't already spinning from all the advice, one thing I would mention is just how big a share of web access these days is via mobile devices, i.e. smartphones and tablets. According to some (reputable?) sources, glean from a single Google search, mobile use has overtaken desktop use (desktop includes laptops). If true, then is a good idea to design new web sites with this in mind, and use a platform that supports "responsive" design, where the platform detects the capabilities of the user's browser and formats pages accordingly. I haven't dug into Nick's site yet, so I don't how amenable the pages are to formatting for a four inch screen :-)

On Wed, Jan 4, 2017 at 5:03 PM, Gillian Densmore <gil.densmore at gmail.com<mailto:gil.densmore at gmail.com>> wrote:
Kirby eh? it was kind of quirk when I tried for what's worth.

On Wed, Jan 4, 2017 at 1:55 PM, Nick Thompson <nickthompson at earthlink.net<mailto:nickthompson at earthlink.net>> wrote:
Thanks, Barry.  Fabulous.  N

Nicholas S. Thompson
Emeritus Professor of Psychology and Biology
Clark University
http://home.earthlink.net/~nickthompson/naturaldesigns/

From: Friam [mailto:friam-bounces at redfish.com<mailto:friam-bounces at redfish.com>] On Behalf Of Barry MacKichan
Sent: Wednesday, January 04, 2017 12:07 PM
To: The Friday Morning Applied Complexity Coffee Group <friam at redfish.com<mailto:friam at redfish.com>>
Subject: Re: [FRIAM] scraping a web site

Squarespace (https://www.squarespace.com) has a good reputation.

If your site doesn’t require any code on the back end (and I would guess it doesn’t, given its age) you could put it on Amazon S3, so you pay only for the storage space (a few cents per gigabyte).

--Barry

On 3 Jan 2017, at 21:49, Nick Thompson wrote:
Dear Phellow Phriammers,

I am in the uncomfortable position of being bound by threads of steel to Earthlink.  Many, MANY, years I go I started a website on Earthlink, {http://home.earthlink.net/~nickthompson/naturaldesigns/
}, and put a lot of my writing, and some commentary up on it.  The website creation and editing medium (trellix) was pretty good for its time, and there are many ways that I find the site quite satisfying.  But gradually Earthlink has withdrawn its support, and now I am not sure I could get in to edit or change it.  Meantime, Research Gate has gotten started, and provides a somewhat better place to meet the world and archive my stuff.  And also, having the site on earthlink binds me to them and their 22 dollar a month fee.  So. …

I am wondering if there is a way (or a service that would) scrape the website and, possibly, dump it into a new and more reliable, more website creation medium?  Please, ambulatory knowledge only.  I don’t want a people doing deep searches to answer this  question .

Thanks, as always .

Nick

Nicholas S. Thompson
Emeritus Professor of Psychology and Biology
Clark University
http://home.earthlink.net/~nickthompson/naturaldesigns/

============================================================
FRIAM Applied Complexity Group listserv
Meets Fridays 9a-11:30 at cafe at St. John's College
to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://redfish.com/pipermail/friam_redfish.com/attachments/20170104/47a596bb/attachment-0002.html>