Re: [Tutor] Request review: A DSL for scraping a web page

2015-04-04 Thread Joe Farro
Joe Farro gmail.com> writes: > indentation doesn't (always) reflect the hierarchy of the data being > generated, which seems more clear. Meant to say: However, the indentation doesn't (always) reflect the hierarchy of the data being generated, which seems more clear *

Re: [Tutor] Request review: A DSL for scraping a web page

2015-04-04 Thread Joe Farro
Joe Farro gmail.com> writes: > > Thanks, Peter. > > Peter Otten <__peter__ web.de> writes: > > > Can you give a real-world example where your DSL is significantly cleaner > > than the corresponding code using bs4, or lxml.xpath, or lxml.objectify? Peter,

Re: [Tutor] Request review: A DSL for scraping a web page

2015-04-02 Thread Joe Farro
Alan Gauld btinternet.com> writes: > DSL? Good to know the term/acronym is not ubiquitous. I was going for succinct, possibly too succinct... > Have you looked at the existing web scraping tools in Python? > There are several to pick from. They all avoid the kind of mess > you describe. I'm fam

Re: [Tutor] Request review: A DSL for scraping a web page

2015-04-02 Thread Joe Farro
Thanks, Peter. Peter Otten <__peter__ web.de> writes: > Can you give a real-world example where your DSL is significantly cleaner > than the corresponding code using bs4, or lxml.xpath, or lxml.objectify? Yes, definitely. Will work something up. > Your code on github looks good to me (too fe

[Tutor] Request review: A DSL for scraping a web page

2015-04-02 Thread Joe Farro
Hello, I recently wrote a python package and was wondering if anyone might have time to review it? I'm fairly new to python - it's been about 1/2 of my workload at work for the past year. Any suggestions would be super appreciated. https://github.com/tiffon/take https://pypi.python.org/pypi/tak