use python to scrape a site and not look like a bot

can’t find the python i wrote to do this…lucky it’s super simple

something something python requests, but construct a user-agent string to supply with the request first….

use any generic browser user agent string, eg. Chrome version 75 on Windows 10:

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.142 Safari/537.36

User-agent parsing breakdown can be found on WhatIsMyBrowser.com

Choose a specific user-agent here (same site)

then do something with the return in Beautiful Soup or regex or something something…