Buffers and Streams in Node.js

Stream is let us start using the data before fully read.

Normally, there are two ways to read the big file, one is we could wait until all of it has been read. But this could take a very long time.

The other is pass a bit of data through a stream. Small chunks of data are packaged up into a buffer and then sent down the stream every time the buffer filled.

Full course:

Complete NodeJS course with express, socket io and MongoDB

Inside the folder, we have a large text file.

createReadStream()

We are going to create a stream to read this big file.

The first argument is where we pass data from, here is largetext.txt.

const readStream = fs.createReadStream('largetext.txt');
readStream.on('data', chunk => {
console.log('##### new chunk #####');