For a recent project, I have to build a directory website, and here's what I'm going to do:
1/ Scrape Google Maps listings (Octoparse) 2/ Scrape up to 50 reviews for those listings (Octoparse)
👇
3/ Do a sentiment analysis of reviews and generate a short summary using a custom script (OpenAI API) 4/ Crawl their websites, if any (Firecrawl API) 5/ Extract a list of services offered and facilities available (OpenAPI API)
6/ Finalize final data points 7/ Design the website by presenting the data in an appealing and user-friendly way
I will be creating separate pages for different cities, but listings won't have separate pages of their own.
Everything will be done by custom Python scripts along with the SQLite3 database.
I will share more details as the project progresses.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Last week, I spent 40+ hours creating landing page style programmatic pages using WP All Import and Gutenberg.
For this project, I had to:
◉ Develop a WordPress plugin
◉ Use PageSpeed & SimilarWeb APIs
◉ Prepare ~100 columns of data
◉ Design pSEO template
And much more...
@UntalkedSEO Before I explain how it's being done, you can check all these pSEO pages on @UntalkedSEO website through below URL: untalkedseo.com/examples/
Some overview before moving forward:
◉ UntalkedSEO is built in WordPress
◉ Uses @BuildWithOllie theme
◉ Google Sheets contains data for pSEO pages
◉ WP All Import plugin for automation
◉ ACF plugin for creating custom post types and custom fields
◉ A custom plugin to make custom post types dynamic
◉ Using Google PageSpeed API to get Core Web Vitals data for URLs
◉ Using SimilarWeb API for traffic and competitors related data
◉ Document Studio Google Sheets AddOn (by @labnol) for automating featured images
The only major issue with Writebook – I had to pay for the server.
Since all the pages were completely static and didn't need to be updated frequently, I decided to use a static site generator 11ty to publish the ebook.