javascript - How can I JSON stringify the response of a website and save it to a file

Question

How can I JSON stringify the response of a website and use FS to save the JSON stringified response to a file?

This is my code but it didn't convert to JSON:

var request = require("request")
var fs = require('fs');
var url = "http://rubycp.me/"
var http = require('http');


var file = fs.createWriteStream("file.json");
var url = http.get("http://rubycp.me/", function(response) {
    JSON.stringify(response.pipe(file));
});

I simply want to convert the html of the page into JSON and store that into a json file.

Answer 1

response is a stream object that does not hold any data. You first need to collect all the data of the stream using the data event. If all data is collect the end event is triggered, at that even you can stringify your collected data and write it to the file.

const fs = require('fs')
const http = require('http')

var url = 'http://rubycp.me/'

var file = fs.createWriteStream('file.json')

http.get(url, response => {
  // list that will hold all received chunks
  var result = []
  response
    .on('data', chunk => result.push(chunk)) // add received chunk to list
    .on('end', () => {
      file.write(JSON.stringify(Buffer.concat(result).toString())) // when all chunks are received concat, stringify and write it to the file
    })
})