R: Function to serialize list-of-character tokens

serialize_tokens {quanteda} | R Documentation

## Function to serialize list-of-character tokens

### Description

Creates a serialized object of tokens, called by `tokens()`.

### Usage

    serialize_tokens(x, types_reserved = NULL, ...)

### Arguments

`x` | a list of character vectors
`types_reserved` | optional pre-existing types for mapping of tokens
`...` | additional arguments

### Value

a list the serialized tokens found in each text

[Package quanteda version 3.0.0 Index]