Class PdfByteStreamTokeniser

Tokenizes a byte stream into PDF tokens. Handles all PDF syntax including objects, streams, and xref tables.

Hierarchy (View Summary)

IncrementalParser<number, PdfToken>
- PdfByteStreamTokeniser

Index

Constructors

constructor

new PdfByteStreamTokeniser(
options?: { streamChunkSizeBytes?: number },
): PdfByteStreamTokeniser
Creates a new byte stream tokenizer.
Parameters
- Optionaloptions: { streamChunkSizeBytes?: number }
  Configuration options
  - OptionalstreamChunkSizeBytes?: number
    Size of stream chunks (default: 1024)
Returns PdfByteStreamTokeniser
Overrides IncrementalParser.constructor
- Defined in packages/pdf-lite/src/core/tokeniser.ts:94

Properties

`Protected`buffer

buffer: number[] = []

Buffer holding input items

`Protected`bufferIndex

bufferIndex: number = 0

Current position in the buffer

eof

eof: boolean = false

Whether end of file has been signaled

`Protected`inputOffset

inputOffset: number = 0

Current position in the input stream

`Protected`outputOffset

outputOffset: number = 0

Number of outputs generated

Methods

`Protected`atEof

atEof(): boolean
Checks if end of file has been reached and buffer is exhausted.

Returns boolean
True if no more input is available
Inherited from IncrementalParser.atEof
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:58

`Protected`canCompact

canCompact(): boolean
Override to customize when to compact the buffer By default, compacts when more than 1000 items have been consumed

Returns boolean
boolean indicating whether to compact the buffer
Inherited from IncrementalParser.canCompact
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:183

`Protected`compact

compact(): void
Compacts the buffer by removing consumed items

Returns void
Inherited from IncrementalParser.compact
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:170

`Protected`expect

expect<T extends number>(itemType: T | (new (...args: any[]) => T)): T
Consumes and validates the next item against an expected type or value.
Type Parameters
- T extends number
  The expected item type
Parameters
- itemType: T | (new (...args: any[]) => T)
  Constructor or value to match against
Returns T
The consumed item cast to the expected type

Throws
Error if the item doesn't match the expected type/value
Inherited from IncrementalParser.expect
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:132

feed

feed(...input: (number | number[])[]): void
Feeds input items into the parser buffer.
Parameters
- ...input: (number | number[])[]
  Input items to add to the buffer
Returns void
Inherited from IncrementalParser.feed
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:39

feedBytes

feedBytes(bytes: ByteArray): void
Feeds a byte array into the tokenizer.
Parameters
- bytes: ByteArray
  The bytes to process
Returns void
- Defined in packages/pdf-lite/src/core/tokeniser.ts:104

`Protected`next

next(): number
Consumes and returns the next item from the buffer.

Returns number
The next item

Throws
NoMoreTokensError if more input is needed and EOF not signaled

Throws
EofReachedError if at EOF and no more items available
Inherited from IncrementalParser.next
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:87

nextItems

nextItems(): Generator<PdfToken>
Generates parsed output items from the buffer. Handles backtracking when more input is needed.

Returns Generator<PdfToken>
A generator yielding parsed output items
Inherited from IncrementalParser.nextItems
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:193

`Protected`oneOf

oneOf(...fn: (() => PdfToken)[]): PdfToken
Tries multiple parsing functions and returns the first successful result. Automatically backtracks on failure.
Parameters
- ...fn: (() => PdfToken)[]
  Array of parsing functions to try
Returns PdfToken
The result from the first successful parsing function

Throws
NoMoreTokensError if any function needs more input

Throws
Error if all parsing functions fail
Inherited from IncrementalParser.oneOf
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:148

`Protected`parse

parse(): PdfToken
Abstract method to parse the next output item from the buffer. Subclasses must implement this to define parsing logic.

Returns PdfToken
The parsed output item
Overrides IncrementalParser.parse
- Defined in packages/pdf-lite/src/core/tokeniser.ts:592

`Protected`peek

peek(ahead?: number): number | null
Peeks at an item in the buffer without consuming it.
Parameters
- ahead: number = 0
  Number of positions to look ahead (default: 0)
Returns number | null
The item at the peek position, or null if at EOF

Throws
NoMoreTokensError if more input is needed and EOF not signaled
Inherited from IncrementalParser.peek
- Defined in packages/pdf-lite/src/core/incremental-parser.ts:69

Class PdfByteStreamTokeniser

Hierarchy (View Summary)

Index

Constructors

Properties

Methods

Constructors

constructor

Parameters

OptionalstreamChunkSizeBytes?: number

Returns PdfByteStreamTokeniser

Properties

Protectedbuffer

ProtectedbufferIndex

eof

ProtectedinputOffset

ProtectedoutputOffset

Methods

ProtectedatEof

Returns boolean

ProtectedcanCompact

Returns boolean

Protectedcompact

Returns void

Protectedexpect

Type Parameters

Parameters

Returns T

Throws

feed

Parameters

Returns void

feedBytes

Parameters

Returns void

Protectednext

Returns number

Throws

Throws

nextItems

Returns Generator<PdfToken>

ProtectedoneOf

Parameters

Returns PdfToken

Throws

Throws

Protectedparse

Returns PdfToken

Protectedpeek

Parameters

Returns number | null

Throws

Settings

On This Page

`Optional`streamChunkSizeBytes?: number

`Protected`buffer

`Protected`bufferIndex

`Protected`inputOffset

`Protected`outputOffset

`Protected`atEof

`Protected`canCompact

`Protected`compact

`Protected`expect

`Protected`next

`Protected`oneOf

`Protected`parse

`Protected`peek