Home Automation Archive by category "Web Scraping" (Page 13)

Category: Web Scraping

Web scraping (web harvesting or web data extraction) is a computer software technique of extracting information from websites. Usually, such software programs simulate human exploration of the World Wide Web by either implementing low-level Hypertext Transfer Protocol (HTTP), or embedding a fully-fledged web browser, such as Mozilla Firefox.
Web scraping is closely related to web indexing, which indexes information on the web using a bot or web crawler and is a universal technique adopted by most search engines. In contrast, web scraping focuses more on the transformation of unstructured data on the web, typically in HTML format, into structured data that can be stored and analyzed in a central local database or spreadsheet. Web scraping is also related to web automation, which simulates human browsing using computer software. Uses of web scraping include online price comparison, contact scraping, weather data monitoring, website change detection, research, web mashup and web data integration.
https://en.wikipedia.org/wiki/Web_scraping

Automate LinkedIn email introductions / mesages

LinkedIn email introductionsWriting a “thank you” email in LinkedIn can be time consuming. I wrote a short script toAutoHotkey Merchandise-White Stress ball automate the process of writing LinkedIn email introductions.

It can dynamically populate the: To, subject line and message body which will greatly increase the likelihood of someone opening and reading your email.  Suddenly you can speak to a ton more people and still look like a rockstar!

 

 

LinkedIn email introductions automated via web scraping with AutoHotkey

Bearded man in denim shirt and woman in white top reviewing papers and a laptop together at a desk with coffee

Linkedin Robot for Automating Social Media Marketing 2014 …

May 2, 2014 … DOWNLOAD LINK: http://www.mediafire.com/download/f8tsv814ec8xhxn.

How to Web Scrape with AutoHotkey: Setting values and clicking links in IE

Setting values and clicking links in IE

Setting values and clicking links in IEThis is the second video in this series.  Here we practice setting values and clicking links in IE on a page (kind of reverse of Web Scraping with AutoHotkey however I don’t believe anybody has coined a decent term yet) and clicking links.

Word of warning- some pages want you to fire an “event”.  Sometimes this is tricky.  Given this video is set to an introductory level I only touch a little on the subject.

Web Scraping with AutoHotKey 102-Setting values and clicking links in IE

Setting values and clicking links in IE

The syntax for writing the writing the code can be found on my first post here.  There is also an AutoHotKey forum thread you might wish to review here.  Setting values and clicking links in IE is pretty straight forward

Web scraping

 (web harvesting or web data extraction) is a computer software technique of extracting information from websites. Usually, such software programs

Transfer systems automatically regardless of their sources

transfer systems

TTwo colleagues look at a laptop together in a bright office, while a woman holds papers and smiles at a bearded man beside her.ransfer Systems regardless of their sources

Our clients enter campaigns into a SharePoint page that need to be transferred to our CMS. Unfortunately the two systems are not tied in any way and there are no existing API Web Services that we can leverage.

There are over 250 items that might be selected which means we end up taking a lot of time to, manually, transfer the campaigns.

I wrote a script with AutoHotKey that automates much of the process (as well as replacing Unicode values with their HTML equivalents).  This allows me to transfer systems automatically with very little effort!

This saves a TON of mundane time by performing web scraping with AutoHotkey and is more reliable than doing it manually.

Four colleagues seated at a meeting table, with a green AutoHotkey water bottle in the center