Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-02 Thread Alan Gauld via Tutor
On 02/05/17 19:06, Ian Monat wrote: > I could give them reasons why .exe files won't work for me but they don't > really care if I take the data files on their site or not. But do they care about their reputation? The biggest issue here is not the technical one but the security one, they could b

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-02 Thread Ian Monat
Hi Steven, Thanks for your commentary, made me laugh, I wish switching distributors were that easy. I could give them reasons why .exe files won't work for me but they don't really care if I take the data files on their site or not. So I guess to answer your question, we need them more. That sai

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-02 Thread Steven D'Aprano
On Mon, May 01, 2017 at 10:20:42AM -0700, Ian Monat wrote: [...] > Then you have you run the .exe which produces a zipped file, and inside the > zipped file, is the .txt, which what I really want. There's no way the > distributor will change anything about how they store files on their > website fo

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-02 Thread Mats Wichmann
On 05/01/2017 06:12 PM, Ian Monat wrote: > Thank you for the reply Mats. > > I agree the fact that files are wrapped in an .exe is ridiculous. We're > talking about a $15B company that is doing this by the way, not a ma and pa > shop. Anyways... > > If I understand you correctly, you're saying I

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-01 Thread Alan Gauld via Tutor
On 02/05/17 01:12, Ian Monat wrote: > 1) Use Python to download the file from the web (but not by using a > webscraper, according to Alan) Things like BeautifulSoup will help you read the HTML and extract links etc but they won't help you actually fetch the file/documents from the web site. A pac

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-01 Thread Ian Monat
Thank you for the reply Mats. I agree the fact that files are wrapped in an .exe is ridiculous. We're talking about a $15B company that is doing this by the way, not a ma and pa shop. Anyways... If I understand you correctly, you're saying I can: 1) Use Python to download the file from the web

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-01 Thread Mats Wichmann
On 05/01/2017 03:44 PM, Alan Gauld via Tutor wrote: > On 01/05/17 18:20, Ian Monat wrote: >> ... I've written a script using the requests module but I >> think a web scraper like Scrapy, Beautiful Soup or Selinium may be >> required. > > I'm not sure what you are looking for. Scrapy, BS etc will

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-01 Thread Ian Monat
Hi Alan, thanks for the reply. My goal is to automatically via Python download the .exe, unzip it, and place the new .txt in a folder on my OneDrive. Then I have another visualization program that loads all the .txt files in that folder and displays them in a web-dashboard. My sales team has acc

Re: [Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-01 Thread Alan Gauld via Tutor
On 01/05/17 18:20, Ian Monat wrote: > ... I've written a script using the requests module but I > think a web scraper like Scrapy, Beautiful Soup or Selinium may be > required. I'm not sure what you are looking for. Scrapy, BS etc will help you read the HTML but not to fetch the file. Also do you

[Tutor] Using Python to access .txt files stored behind a firewall as .exe files

2017-05-01 Thread Ian Monat
I've got a Python project that I'd love some help on from a Python developer who is well versed at web scraping or requests. I work for a supplier, and we use a distributor to sell our products to retailers. The distributor has a reporting website that requires a login. >From that home / login pag