Exploring Data Scraping Options for Nonprofit Database in Austin
During the meeting, David expressed his need for data scraping or web scraping but mentioned that he doesn't have the technical knowledge to do it himself. He mentioned receiving quotes from vendors in India but didn't want to spend that much money on the project. He also mentioned a resource that could provide the information he needs but for a cost of $5,000, which he doesn't have. David discussed his options, which include reaching out to organizations in Austin for a database, using scraping tools like Octoparse, or utilizing a free tool and then hiring someone to assist with the final steps. Ray suggested trying different free scraping tools and mentioned the benefit of using no-code tools to avoid hiring a person for the job. They explored a website called Weweb and discussed the possibility of intercepting API calls for structured data extraction. They also suggested contacting the United Way of Greater Austin to discuss accessing their database. Ray mentioned the importance of approaching the project legally and ethically. The meeting ended with plans to further explore scraping tools and await David's progress with contacting organizations in Austin.