News Scraper Web App

news-scraper-ui-thumb.jpeg
info /

A full-stack app that scrapes news stories from two major news sources in the Philippines - Rappler and Manila Bulletin.

2022
The Challenge

I wanted to build a simple app that scrapes the latest news from two news agencies and expose the scraped data through a public API. By default, the app fetches the latest news stories from Rappler and Manila Bulletin. A user can also look for a specific news story by typing a keyword into the search bar. The app scrapes the news results from the two sources and consumes the data for display on the UI.

The Solution

The UI is bootstrapped with React JS and used reusable components from the Carbon Design System. While, the server is created with Express and TypeScript. The JS library Cheerios is employed to process and scrape data off the returned HTML document from Rappler and Manila Bulletin. The API can be tested at https://stormy-meadow-81503.herokuapp.com/api/news/:keyword