GeoNames Home | Postal Codes | Download / Webservice | About 

GeoNames Forum
  [Search] Search   [Recent Topics] Recent Topics   [Groups] Back to home page 
[Register] Register / 
[Login] Login 
Scraping data from geonames.org  XML
Forum Index -> General
Author Message
devilg



Joined: 09/10/2018 08:46:15
Messages: 1
Offline

Hello,
I have created a non-commercial project that involves scraping countries data from geonames.org, such as country neighbors, names, currencies etc.
I attached the geonames.org license to it and attributed the website. Is there anything else I should do?
Thank you and have a great week!
marc



Joined: 08/12/2005 07:39:47
Messages: 4412
Offline

With 'scraping' I understand you are parsing html pages and you are not simply downloading the files from the download section. The data you mention is all included in the countryInfo file:
http://download.geonames.org/export/dump/countryInfo.txt

Why do you scrape? GeoNames provides a lot of data in the download section licensed under cc-by. There is no need to scrape. At the contrary scraping is generating an unwanted load to the server for data which is already prepared for download and data which is not included in the download is probably included in the premium data and deliberately not included in the free download.


Please delete your project as it is not fair to scrape. Thanks.


Marc

[WWW]
 
Forum Index -> General
Go to:   
Powered by JForum 2.1.5 © JForum Team