R: Base method extensions for tokens objects

tokens-class {quanteda} | R Documentation

## Base method extensions for tokens objects

### Description

Extensions of base R functions for tokens objects.

### Usage

    ## S3 method for class 'tokens'
    unlist(x, recursive = FALSE, use.names = TRUE)

    ## S3 method for class 'tokens'
    x[i, drop_docid = TRUE]

    ## S3 method for class 'tokens'
    t1 + t2

    ## S3 method for class 'tokens'
    c(...)

### Arguments

`x` | a tokens object
`recursive` | a required argument for unlist but inapplicable to tokens objects
`i` | document names or indices for documents to extract.
`drop_docid` | if `TRUE`, `docid` for documents are removed as the result of extraction.
`t1` | tokens one to be added
`t2` | tokens two to be added

### Value

`unlist` returns a simple vector of characters from a tokens object.

`c(...)` and `+` return a tokens object whose documents have been added as a single sequence of documents.

### Examples

    toks <- tokens(c(d1 = "one two three", d2 = "four five six", d3 = "seven eight"))
    str(toks)
    toks[c(1,3)]
    # combining tokens
    toks1 <- tokens(c(doc1 = "a b c d e", doc2 = "f g h"))
    toks2 <- tokens(c(doc3 = "1 2 3"))
    toks1 + toks2
    c(toks1, toks2)

[Package quanteda version 3.0.0 Index]