A progressive Node.js framework for building efficient and scalable server-side applications.

Description

Nest framework TypeScript starter repository.

Installation

$ pnpm install

Running the app

# development
$ pnpm run start

# watch mode
$ pnpm run start:dev

# production mode
$ pnpm run start:prod

TODOs

• Error handler (using exceptions)
• Extract real url instead of t.co/...
• Hide image's link
• Extract quoted tweet
• Handle new tweet structure i.e text - img - text - img
• Display bookmark by url
• Handle navigation frame detached error
• Limit title's character
• Replace special characters (i.e &, >)
• Handle empty title (tweet link)
• Handle twitter rate limit & long scrape time (tweet link)
• Extract time & date (tweetResult > result > legacy > createdAt)
• Only able to retry based on specific conditions

{
  "status": "failed",
  "type": "thread",
  "url": "https://twitter.com/meowtadi/status/1766781294334144976",
  "message": "Navigating frame was detached"
},
{
  "status": "failed",
  "type": "thread",
  "url": "https://twitter.com/warpdotdev/status/1767250494714466461",
  "message": "Requesting main frame too early!"
}

• Add verified icon☑️ (result > is_blue_verified)
• Add more worker to scrape faster
• Limit paragraph to 2000 limit characters (tweet link)
• Extract preview link's thumbnail image
• Handle requesting frame too early error
• Extract notion's object type (i.e Callout, Rich Text, etc)

Support

Nest is an MIT-licensed open source project. It can grow thanks to the sponsors and support by the amazing backers. If you'd like to join them, please read more here.

Stay in touch

• Author - Kamil Myśliwiec
• Website - https://nestjs.com
• Twitter - @nestframework

License

Nest is MIT licensed.