\documentclass[11pt]{article}


<<include=FALSE>>=
library(knitr)
opts_chunk$set(
             cache=TRUE,
             autodep=TRUE,
             echo=TRUE,
             tidy=FALSE,
             concordance=TRUE
)
options(width=60)
@


\usepackage{color}
\usepackage{verbatim}
\usepackage{amsmath}
\usepackage{amsfonts}
\usepackage{url}
\usepackage[margin=1.5in]{geometry}

\newcommand{\notes}[1]{\textcolor{red}{#1}}
\newcommand{\adjmat}{\mathbf{Y}}
\newcommand{\obsadj}{\mathbf{y}}
\newcommand{\grphSpace}{\mathcal{Y}}
\newcommand{\dyadSpace}{\mathbb{Y}}
\newcommand{\form}{^+}
\newcommand{\diss}{^-}
\newcommand{\paramVec}{\theta}
\newcommand{\covmat}{\mathbf{X}}

% \VignetteIndexEntry{STERGM Vignette}
% \VignetteEngine{knitr::knitr}

<<echo=FALSE,message=FALSE>>=
library('tergm')
@


\begin{document}


\title{STERGM -- Separable Temporal ERGMs for modeling discrete relational dynamics with \emph{statnet}}
\author{Pavel N.~Krivitsky, Steven M.~Goodreau,\\ The \texttt{Statnet} Development Team}
\maketitle

\tableofcontents

\section{Intro}
This document is a brief vignette intended to quickly demonstrate the core functionality of \texttt{tergm}.  For a more in-depth tutorial, please see the workshop materials on the \texttt{statnet} wiki: \url{http://statnet.csde.washington.edu/workshops/SUNBELT/current/tergm/tergm_tutorial.pdf}

\section{Getting the software}

If you have not already done so, please download and install \texttt{ergm} version 3.2 and \texttt{networkDynamic} version 0.7. 
You will also want to make sure you have a reasonably new version of R, preferably the latest (3.1).

<<eval=FALSE>>=
install.packages("ergm")
install.packages("networkDynamic")
library(ergm)
library(networkDynamic)
@

\section{A quick review of static ERGMs}

Exponential-family random graph models (ERGMs) represent a general class of models based in exponential-family theory for specifying the probability distribution 
underlying a set of random graphs or networks. Within this framework, one can---among other tasks---obtain maximum-likehood estimates for the parameters of a specified model 
for a given data set; simulate additional networks with the underlying probability distribution implied by that model; test individual models for goodness-of-fit, 
and perform various types of model comparison.

The basic expression for the ERGM class can be written as:
\begin{equation}
P(Y=y)=\frac{\exp(\theta'g(y))}{k(y)}
\end{equation}
where Y is the random variable for the state of the network (with realization y), $g(y)$ is the vector of model statistics for network y, 
$\theta$ is the vector of coefficients for those statistics, and $k(y)$ represents the quantity in the numerator summed over all possible networks 
(typically constrained to be all networks with the same node set as y).

This can be re-expressed in terms of the conditional log-odds of a single actor pair:
\begin{equation}
\operatorname{logit}{(Y_{ij}=1|y^{c}_{ij})=\theta'\delta(y_{ij})}
\end{equation}
where $Y_{ij}$ is the random variable for the state of the actor pair $i,j$ (with realization $y_{ij}$), and $y^{c}_{ij}$ signifies the complement of $y_{ij}$, i.e. all dyads in the network other than $y_{ij}$. 
The variable $\delta(y_{ij})$ equals $g(y^{+}_{ij})-g(y^{-}_{ij})$, where $y^{+}_{ij}$ is defined as $y^{c}_{ij}$ along with $y_{ij}$ set to 1, and $y^{-}_{ij}$ is defined as $y^{c}_{ij}$ along with $y_{ij}$ set to 0.  
That is, $\delta(y_{ij})$ equals the value of $g(y)$ when $y_{ij}=1$ minus the value of $g(y)$ when $y_{ij}=0$, but all other dyads are as in $g(y)$.  
This emphasizes the log-odds of an individual tie conditional on all others. 
We call $g(y)$ the statistics of the model, and $\delta(y_{ij})$ the ``change statistics'' for actor pair $y_{ij}$.

Fitting an ERGM usually begins with obtaining data:

<<>>=
library(ergm)
data("florentine")
ls()
@

<<flobusplot, fig.height=3>>=
plot(flobusiness)
@

To refresh our memories on ERGM syntax, let us fit a cross-sectional example. Just by looking at the plot of \texttt{flobusiness}, 
we might guess that there are more triangles than expected by chance for a network of this size and density, and thus that there is some
sort of explicit triangle closure effect going on.  One useful way to model this effect in ERGMs that has been explored in the literature 
is with a \texttt{gwesp} statistic.

<<>>=
fit1 <- ergm(flobusiness~edges+gwesp(0,fixed=T))
summary(fit1)
@

With the estimation in place, we can simulate a new network from the given model:

<<sim1plot, fig.height=3>>=
sim1 <- simulate(fit1,nsim=1,
          control=control.simulate.ergm(MCMC.burnin=1000))
plot(sim1)
@

\section{An Introduction to STERGMs (non-technical)}

Separable Temporal ERGMs (STERGMs) are an extension of ERGMs for modeling dynamic networks in discrete time, introduced in Krivitsky and Handcock (2010). 
The cross-sectional ERGM entails a single network, and a single model on that network. 
STERGMs, in contrast, posit two models: one ERGM underlying relational formation, and a second one underlying relational dissolution.
Specifying a STERGM thus entails writing two ERGM formulas instead of one.  It also requires dynamic data, of course; 
such data can come in many forms, and we will cover a few examples today.

This approach is not simply a methodological development, but a theoretical one as well, and one which matches common sense for many social processes.
Think of romantic relations.  It seems intuitive that the statistical model underlying relational formation 
(i.e. affecting who becomes partners with whom, out of the set of people who aren't already) is likely to be different than the model underlying relational dissolution
(i.e. affecting who breaks up with whom, out of the set of people currently in relationships).  Any reasonable model of the former would 
need to include a variety of homophily parameters (mixing on age, for example).  The latter may or may not.  (Conditional on being in a relationship, 
does your difference in age affect your probability of breaking up?  Perhaps, but probably not as fundametally or as strongly as for formation).

\section{An Introduction to STERGMs (a bit more technical)}

We first review the ERGM framework for \emph{cross-sectional} or static networks, observed at a single point in time. Let $\dyadSpace\subseteq \{1,\dotsc,n\}^2$ be the set of potential relations (dyads) among $n$ nodes, ordered for directed networks and unordered for undirected. 
We can represent a network $\obsadj$ as a set of ties, with the set of possible sets of ties, $\grphSpace\subseteq 2^\dyadSpace$, being the sample space: $\obsadj \in \grphSpace$. Let $\obsadj_{ij}$ be 1 if $(i,j)\in\obsadj$ --- a relation of interest exists from $i$ to $j$ --- and 0 otherwise.

The network also has an associated 
covariate array $\covmat$ containing attributes of the nodes, the dyads, or both.
An exponential-family random graph model (ERGM) represents the pmf of $\adjmat$ as a function of a $p$-vector of network statistics $g(\adjmat,\covmat)$, with parameters $\paramVec \in \mathbb{R}^p$, as follows:
\begin{equation}\label{eq:XsecModel}
\mbox{Pr}_{\paramVec}\left(\adjmat = \obsadj \mid \covmat\right) = 
\frac{\exp\left\{\paramVec\cdot g(\obsadj, \covmat)\right\} }
{c(\paramVec, \covmat, \grphSpace)},
\end{equation}
where the normalizing constant 
\[
c(\paramVec, \covmat, \grphSpace)  = \sum\limits_{\obsadj' \in \grphSpace}\exp
\left\{\paramVec\cdot g(\obsadj', \covmat)\right\}
\]
is a summation over the space of possible networks on $n$ nodes, $\grphSpace$.
%The normalizing constant is a function of parameters ($\paramVec$), the space of possible networks ($\grphSpace$), and covariate values ($\covmat$).  
Where $\grphSpace$ and $\covmat$ are held constant, as in a typical cross-sectional model, they may be suppressed in the notation.  Here, on the other hand, the dependence on $\grphSpace$ and $\covmat$ is made explicit.

In modeling the transition from a network $\adjmat^{t}$ at time $t$ to a network $\adjmat^{t+1}$ at time $t+1$, the separable temporal ERGM assumes that the formation and dissolution of ties occur independently from each other within each time step, with each half of the process modeled as an ERGM. For two networks (sets of ties) $\obsadj,\obsadj'\in \grphSpace$, let $\obsadj \supseteq \obsadj'$ if any tie present in $\obsadj'$ is also present in $\obsadj$. Define $\grphSpace\form(\obsadj)=\{\obsadj'\in\grphSpace:\obsadj'\supseteq\obsadj\}$, the networks that can be constructed by forming ties in $\obsadj$; and $\grphSpace\diss(\obsadj)=\{\obsadj'\in\grphSpace:\obsadj'\subseteq\obsadj\}$, the networks that can be constructed dissolving ties in $\obsadj$.

Given $\obsadj^{t}$, a \emph{formation network} $\adjmat\form$ is generated from an ERGM controlled by a $p$-vector of formation parameters $\paramVec\form$ and formation statistics $g\form(\obsadj\form, \covmat)$, conditional on only adding ties:
\begin{equation}\label{formation}
\Pr\left(\adjmat\form = \obsadj\form\mid \adjmat^{t};\paramVec\form\right) = \frac{\exp\left\{\paramVec\form\cdot g\form(\obsadj\form, \covmat)\right\} }
%{c(\paramVec\form, \covmat, \grphSpace\form)}, 
{c\left(\paramVec\form, \covmat, \grphSpace\form(\adjmat^{t})\right)}, \quad \obsadj\form \in \grphSpace\form(\obsadj^{t}).
\end{equation}
 A \emph{dissolution network} $\adjmat\diss$ is simultaneously generated from an ERGM controlled by a (possibly different) $q$-vector of dissolution parameters $\paramVec\diss$ and corresponding statistics $g\diss(\obsadj\diss, \covmat)$, conditional on only dissolving ties from $\obsadj^{t}$:
\begin{equation}\label{dissolution}
\Pr\left(\adjmat\diss = \obsadj\diss\mid \adjmat^{t};\paramVec\diss\right) = \frac{\exp\left\{\paramVec\diss\cdot g\diss(\obsadj\diss, \covmat)\right\} }
%{c(\paramVec\diss, \covmat, \grphSpace\diss)},
{c\left(\paramVec\diss, \covmat, \grphSpace\diss(\adjmat^{t})\right)}, \quad
\obsadj\diss \in \grphSpace\diss(\obsadj^{t}).
\end{equation}
%is a normalizing constant.  
The cross-sectional network at time $t+1$ is then constructed by applying the changes in $\adjmat^+$ and $\adjmat\diss$ to $\obsadj^{t}$:
\[\adjmat^{t+1} = \adjmat^{t}\cup (\adjmat\form - \adjmat^{t}) \, - \, ( \adjmat^{t} - \adjmat\diss).\]
which simplifies to either:
\[\adjmat^{t+1} = \adjmat\form - (\adjmat^{t} - \adjmat\diss)\]
\[\adjmat^{t+1} = \adjmat\diss\cup (\adjmat\form - \adjmat^{t})\]
Visually, we can sum this up as:
\begin{figure}[h]
\begin{center}
\includegraphics[height=1.5in]{Proc_diss_and_form}
\label{Proc_diss_and_form}
\end{center}
\end{figure}

\section{Notes on model specification and syntax}
Within \emph{statnet}, an ERGM involves one network and one set of network statistics, so these are specified together using R's formula notation:

\begin{center}
\texttt{my.network $\sim$ my.vector.of.g.statistics}
\end{center}

For a call to \texttt{stergm}, there is still one network, but two formulas. These are now passed as three separate arguments: the network (argument \texttt{nw}), the formation formula (argument \texttt{formation}), 
and the dissolution formula (argument \texttt{dissolution}).  The latter two both take the form of a one-sided formula.  E.g.:

\begin{verbatim}
        stergm(my.network,
            formation= ~edges+kstar(2),
            dissolution= ~edges+triangle
        )
\end{verbatim}

There are other features of a call to either \texttt{ergm} or \texttt{stergm} that will be important for us here. 
We list the features here; each will be illustrated in one or more examples during the workshop.

\begin{enumerate}

\item{To fix the coefficient for a particular network statistic, one uses offset notation.  
For instance, to fix a dissolution model with only an edges term with parameter value 4.2, the dissolution formula woud be:

\begin{center}
\texttt{dissolution= $\sim$offset(edges)}
\end{center}

and the corresponding argument for passing the parameter value would be:

\begin{center}
\texttt{offset.coef.diss = 4.2}
\end{center}

}

\item{In parallel with \texttt{ergm}, any information used to specify the nature of the fitting algorithm is passed by specifying a vector called \texttt{control.stergm} 
to the \texttt{control} argument. For example:
	
\begin{center}
\texttt{control=control.stergm(MCMC.burnin=10000)}
\end{center}

For a list of options, type \texttt{?control.stergm}
}
  
\item{Another argument that the user must supply is \texttt{estimate}, which controls the estimation method. 
Unlike with cross-sectional ERGMs, there is not necessarily an obvious default here, as different scenarios are best fit with different approaches.
The most important for the new user to recognize are \texttt{EGMME} (equilibrium generalized method of moments estimation) and \texttt{CMLE} (conditional maximum likelihood estimation). 
A good rule of thumb is that when fitting to two networks, one should use \texttt{estimate="CMLE"} while when fitting to a single cross-section with some duration information, 
use \texttt{estimate="EGMME"}.
}

\item{For cross-sectional ERGMs, the model is by default fit using the sufficient statistics present in the cross-sectional network.  
For STERGMs, the presence of multiple models makes the default less clear.  Thus, the user is required to supply this information via the \texttt{targets} argument.  
This can take a one-sided formula listing the terms to be fit; or, if the formula is identical to either the formation or dissolution model, 
the user can simply pass the string \texttt{"formation"} or \texttt{"dissolution"}, respectively. If one is specifying
targets="formation", dissolution should be an offset, and vice versa.
If the values to be targeted for those terms are anything other than the sufficient statistics present in the cross-sectional network, 
then those values can be passed with the argument \texttt{target.stats}.

}

\end{enumerate}

\section{STERGM estimation and simulation, Example 1}

Let us imagine that we have observed two things: a cross-sectional network, and a mean relational duration. 
Let us say the cross-sectional network is flobusiness, and the mean relational duration we have witnessed is 10 time steps. 
Furthermore, we are willing to (for reasons of theory or convenience) assume a purely homogeneous dissolution process 
(that is, every existing relationship has the same probability of dissolving as all others, and at all times).  
For a cross-sectional ERGM, a purely homogeneous model is one with just a single term in it for an edge count. 
The same is true for either of the two formulas in a STERGM.  

The steps we will go through are:

\begin{enumerate}

\item Specify formation and dissolution models (\texttt{formation} and \texttt{dissolution}).

We will begin by assuming a formation model identical to the model we fit in the cross-sectional case:
\begin{center}
\texttt{formation = $\sim$edges+gwesp(0,fixed=T)}
\end{center}

Analogously to cross-sectional ERGMs, our assumption of completely homogeneous dissolution corresponds to a model with only an edgecount term in it.  In STERGM notation this is:

\begin{center}
\texttt{dissolution = $\sim$edges}
\end{center}

which correspond to the probability statement:
\begin{equation}\label{disslogit}
\ln{\frac{P(Y_{ij,t+1}=1 \mid Y_{ij,t}=1)}{P(Y_{ij,t+1}=0\mid Y_{ij,t}=1)}} = \theta*\delta(y)
\end{equation}
where the one term in the $\delta(y)$ vector is the edge count of the network. 

\item Calculate \texttt{theta.diss}.

Our dissolution model is applied to the set of ties that exist at any given time point, as reflected in the conditional present in both the
numerator and denominator of Equation (\ref{disslogit}). The numerator thus represents the case where a tie persists to the next step, 
and the denomiator represents the case where it dissolves.  
Furthermore, $\delta(y_{ij})=1$ for all $i,j$ for the case of the edge count statistic.  
We define the probability of persistance from one time step to the next for actor pair $i,j$ as $p_{ij}$, 
and the probability of dissolution as $q_{ij}=1-p_{ij}$.
Our dissolution model is Bernoulli; that is, all edges have the same probability of dissolution, and thus of persistence,
so we further define $p_{ij}=p \forall i,j$ and $q_{ij}=q \forall i,j$. Then:

\[
\ln{(\frac{p_{ij}}{1-p_{ij}})}=\theta * \delta({y_{ij})}
\]
\[
\ln{(\frac{p}{1-p})}=\theta
\]
\[
\ln{(\frac{1-q}{q})}=\theta
\]
\[
\ln{(\frac{1}{q}-1)}=\theta	
\]

And because this is a discrete memoryless process, durations are geometric; symbolizing mean relational duration as $d$, we have $d = \frac{1}{q}$, and thus:
\begin{equation}
\theta = \ln{(d-1)}
\end{equation}
So, for our dissolution model, theta.diss = $\ln{(10-1)}$ = $\ln{9}$ = $2.197$:

<<>>=
theta.diss <- log(9)
@

In short, because our dissolution model is dyadic independent, we can calculate it using a (rather simple) closed form solution.

\item Estimate the formation model, conditional on the dissolution model.
We put it all together for our first call to \texttt{stergm}, adding in one additional control argument that helps immensely with monitoring model convergence (and is just plain cool): 
plotting the progress of the coefficient estimates and the simulated sufficient statistics in real time.

<<results='hide'>>=

stergm.fit.1 <- stergm(flobusiness,
	formation= ~edges+gwesp(0,fixed=T),
	dissolution = ~offset(edges),
	targets="formation",
	offset.coef.diss = theta.diss,
	estimate = "EGMME"
	)
@
\texttt{Iteration 1 of at most 20:}\\
$\Rightarrow$ Lots of output snipped. $\Leftarrow$ \\
\texttt{== Phase 3: Simulate from the fit and estimate standard errors.==}

First, we should double-check to make sure the fitting went well:
<<fit1diag, include=FALSE, results='hide'>>=
mcmc.diagnostics(stergm.fit.1)
@

\begin{verbatim}
==========================
EGMME diagnostics
==========================
\end{verbatim}

$\Rightarrow$ Lots of output snipped. $\Leftarrow$\\

\begin{figure}[h]
\begin{center}
\includegraphics[height=3in]{\Sexpr{fig_chunk("fit1diag")}}
\end{center}
\end{figure}

Since those look good, we can next query the object in a variety of ways to see what we have:
<<>>=
stergm.fit.1
names(stergm.fit.1)
stergm.fit.1$formation
stergm.fit.1$formation.fit
summary(stergm.fit.1)
@
\end{enumerate}

We have now obtained estimates for the coefficients of a formation model that, 
conditional on the stated dissolution model, yields simulated targets that matched those observed.
Something very useful we have also gained in the process is the ability to simulate networks with the 
desired cross-sectional structure and mean relational duration.  This ability serves us well for any application 
areas that requires us to simulate phenomena on dynamic networks, whether they entail the diffusion of information or disease, or some other process.  

<<>>=
stergm.sim.1 <- simulate(stergm.fit.1, nsim=1, 
    time.slices = 1000)
@

Understanding this object requires us to learn about an additional piece of \emph{statnet} functionality: 
the \emph{networkDynamic} package.

\section{networkDynamic}

In \emph{statnet}, cross-sectional networks are stored using objects of class \emph{network}.  
Tools to create, edit, and query network objects are in the package \emph{network}. Dynamic networks 
are now stored as objects with two classes (\emph{network} and \emph{networkDynamic}).
They can thus be edited or queried using standard functions from the \emph{network} package, or using additional 
functions tailored specifically to the case of dynamic networks in the package \emph{networkDynamic}.

To illustrate, let us begin with the network that we just created:

<<results='hide'>>=
stergm.sim.1
@

\texttt{networkDynamic with 985 distinct change times:}\\
$\Rightarrow$ Lots of output snipped. $\Leftarrow$
\begin{verbatim}
 Network attributes:
  vertices = 16 
  directed = FALSE 
  hyper = FALSE 
  loops = FALSE 
  multiple = FALSE 
  bipartite = FALSE 
  total edges= 120 
    missing edges= 0 
    non-missing edges= 120 

 Vertex attribute names: 
    priorates totalties vertex.names wealth 
\end{verbatim}

We can deduce from the number of edges that this likely represents the cumulative network---that is, the union of all edges that exist at any point in time over the course of the simulation.  
What does the network look like at different time points? The function \texttt{network.extract} allows us to pull out the network at an instantanoues time point (with the argument \texttt{at}),
or over any given spell (with the arguments \texttt{onset} and \texttt{terminus}).

<<>>=
network.extract(stergm.sim.1,at=429)
@

For any one of these time points, we can look at the network structure:

<<simex, fig.height=3>>=
plot(network.extract(stergm.sim.1,at=882))
@

How well do the cross-sectional networks within our simulated dynamic network fit the probability distribution implied by our model?  
We can check by considering the summary statistics for our observed network, and those for our cross-sectional networks.

<<>>=
summary(flobusiness~edges+gwesp(0,fixed=T))
colMeans(attributes(stergm.sim.1)$stats)
@

And we can also easily look at a time series and histogram for each statistic:

<<statsform1, fig.height=6>>=
plot(attr(stergm.sim.1,"stats"))
@

We should also check to make sure that our mean duration is what we expect (10 time steps). This requires knowing an additional function: \texttt{as.data.frame}, 
which, when applied to an object of class \texttt{networkDynamic}, generates a timed edgelist. 
Although right-censoring is present for some edges in our simulation, with a mean duration of 10 time steps and a simulation 1000 time steps long, 
its effect on our observed mean duration should be trivial.

<<>>=
stergm.sim.1.dm <- as.data.frame(stergm.sim.1)
names(stergm.sim.1.dm)
mean(stergm.sim.1.dm$duration)
@

The information on when an edge is active and when it is inactive is stored within our \texttt{network} object as the edge attribute \texttt{active}.  
Vertices, too, are capable of becoming active and inactive within \texttt{networkDynamic}, and this information is stored as a vertex attribute.
Most of the time, users should access this information indirectly, through functions like \texttt{network.extract} or \texttt{as.data.frame}.  
Additional functions to query or set activity include \texttt{is.active}, \texttt{activate.vertex}, \texttt{deactivate.vertex}, \texttt{activate.edge},
and \texttt{deactivate.edge}, all documented in \texttt{help(package="networkDynamic")}.

For those who want to look under the hood, they can see the activity spells directly.  For a single edge, say, edge number 25, use:

<<>>=
get.edge.value(stergm.sim.1, "active", unlist=FALSE)[[25]]
@

Note that \texttt{networkDynamic} stores spells in the form [onset,terminus), meaning that the spell is inclusive of the onset and exclusive of the terminus.  
So a spell of 3,7 means the edge begins at time point 3 and ends just before time point 7.  networkDynamic can handle continuous-time spell information.  
However, since STERGMs are discrete-time with integer steps, what this means for STERGM is that the edge is inactive up through time step 2;
 active at time steps 3, 4, 5, and 6; and inactive again at time step 7 and on. Its duration is thus 4 time steps.

\section{Independence within and across time steps}

STERGMs assume that the formation and dissolution processes are indepedent of each other \emph{within the the same time step}.  

This does not necessarily mean that they will be independent across time. In fact, for any dyadic dependent model, they will not. To see this point, think of a romantic relationship example with:

\begin{verbatim}
     formation = ~edges+degree(2:10)
     dissolution = ~edges
\end{verbatim}

\noindent with increasingly negative parameters on the degree terms.  
What this means is that there is some underlying tendency for relational formation to occur, 
which is considerably reduced with each pre-existing tie that the two actors involved are already in.
In other words, there is a strong prohibition against being in multiple simultaneous romantic relationships. 
However, dissolution is fully independent---all existing relationships have the same underlying dissolution probability at every time step.
(The latter assumption is probably unrealistic; in practice, if someone just acquired a second partner, their first is likely to be at increased risk of dissoving their relation.
We ignore this now for simplicity).

Imagine that Chris and Pat are in a relationship at time \texttt{t}. During the time period between \texttt{t} and \texttt{t+1}, 
whether they break up does not depend on when either of them acquires a new partner, and vice versa. Let us assume that they do *not* break up during this time.
Now, during the time period between \texttt{t+1} and \texttt{t+2}, whether or not they break up is dependent on the state of the network at time \texttt{t+1}, 
and that depends on whether either of them they acquired new partners between \texttt{t} and \texttt{t+1}.

The simple implication of this is that in this framework, formation and dissolution can be dependent, but that dependence occurs in subsequent time steps, not simultaneously. 

Note that a time step here is abritrary, and left to the user to define.  One reason to select a smaller time interval is that it makes this assumption more justifiable. With a time step of 1 month, 
then if I start a new relationship today, the earliest I can break up with my first partner as a direct result of that new partnership is in one month. If my time step is a day, then it is in 1 day; 
the latter is likely much more reasonable. The tradeoff is that a shorter time interval means longer computation time for both model estimation and simulation, as will be seen below. You will see throughout this talk that there are multiple 
positives and negatives to having a short time step and having a long time step.  We will discuss them as they go, and review them collectively at the end.

At the limit, this can in practice approximate a continuous-time model---the only issue is computational limitations.

\section{Example 2: Long durations}

For the type of model we saw in Example 1 (with a known dissolution model that contains a subset of terms from the formation model), 
it can be shown that a good set of starting values for the estimation of the formation model are as follows: 
(1) fit the terms in the formation model as a static ERGM on the cross-sectional network; and (2) subtract the values 
of the dissolution parameters from the corresponding values in the cross-sectional model.  
The result is a vector of parameter values that form a reasonable place to start the MCMC chain for the estimation of the formation model.  
This is in fact exactly what the \texttt{stergm} estimation code does by default for this type of model.

When mean relational duration is very long, this approximation is so good that it may not be necessary to run a STERGM estimation at all.
Especially if your purpose is mainly for simulation, the approximation may be all you need.  This is a very useful finding, since models with long mean duration are precisely the ones that 
are the slowest and most difficult to fit using EGMME.  That's because, with long durations, very few ties will change between one time step and another, giving the fitting algorithm 
very little information on which to perform the estimation.  

Of course, in order to be able to take advantage of this method, it is necessary for the terms in your dissolution model to be a subset of the terms in your formation model. 

To illustrate, let us reconsider Example 1, with a mean relational duration of 100 time steps.

<<>>=
theta.diss.100 <- log(99)
@

First, we treat the formation process as if it were a stand-alone cross-sectional model, and estimate it using a standard cross-sectional ERGM. 
We did, in fact, fit this cross-sectional model earlier:

<<>>=
summary(fit1)
theta.form <- fit1$coef 
theta.form
@

Then, we subtract the values of the dissolution $\theta$ from each of the corresponding values in the formation model. 
In this example, the dissolution model contains only an edges term, so this coefficient should be subtracted from the starting value for the edges term in the formation model. 

<<>>=
theta.form[1] <- theta.form[1] - theta.diss.100
@

How well does this approximation do in capturing our desired dynamic network properties? First, we can simulate from it:

<<>>=
stergm.sim.2 <- simulate(flobusiness,
	formation=~edges+gwesp(0,fixed=T),
	dissolution=~edges,
	monitor="all",
	coef.form=theta.form,
	coef.diss=theta.diss.100,
	time.slices=10000)
@

Then check the results in terms of cross-sectional network structure and mean relational duration?

<<simform, fig.height=6>>=
summary(flobusiness~edges+gwesp(0,fixed=T))
colMeans(attributes(stergm.sim.2)$stats)
stergm.sim.dm.2 <- as.data.frame(stergm.sim.2)
mean(stergm.sim.dm.2$duration)
plot(attr(stergm.sim.2, "stats"))
@

\section{Example 3: Two network cross-sections}

Another common data form for modeling dynamic network processes consists of observations of network structure at two or more points in time on the same node set.  
Many classic network studies were of this type, and data of this form continue to be collected and analyzed.

Let us consider the first two time points in the famous Sampson monastery data:

<<>>=
data(samplk)
ls(pattern="samp*")
@

To pass them into \texttt{stergm}, we need to combine them into a list:
<<>>=
samp <- list()
samp[[1]] <- samplk1
samp[[2]] <- samplk2
@

Now we must decide on a model to fit to them.  Plotting one network:

\begin{center}
<<>>=
plot(samplk1)
@
\end{center}

\noindent we might get the idea to consider mutuality as a predictor of a directed edge.  Also, since this is a directed network, 
and there appear to be a considerable number of triadic relations, it might be worth investigating the role of cyclic vs. transitive triads in the network.
Of course, since we have two network snapshots, and we have separate formation and dissolution models, 
we can estimate the degree to which closing a mutual dyad or closing a triad of each type predicts the creation of a tie, 
and also estimate the degree to which maintaining a mutual dyad or maintaining a triad of each type predicts the persistence of an existing tie. 
We might see different phenomena at work in each case; or the same phenomena, but with different coefficients.

Because of the different structure of our model, we need to change our arguments slightly.  Our estimation method should now be conditional maximum likelihood estimation (CMLE).
Moreover, we no longer need the target argument (and it is in fact not allowed for CMLE, since the algorithm automatically targets the sufficient statistics present in each of the two networks).
In this case, we have no offsets, since there are no coefficients set in either the formation or dissolution model.

<<results='hide'>>=
stergm.fit.3 <- stergm(samp,
	formation= ~edges+mutual+ctriad+ttriad,
	dissolution = ~edges+mutual+ctriad+ttriad,
	estimate = "CMLE"
	)
@

\texttt{Fitting formation:}\\
\texttt{Iteration 1 of at most 20:}\\
$\Rightarrow$ Lots of output snipped. $\Leftarrow$\\
\texttt{Time points not specified for a list. Modeling transition from the first to the second network. This behavior may change in the future.}\\

And the results:

<<>>=
summary(stergm.fit.3)
@

So, a relationship is more likely than chance to form if it will close a mutual pair. 
And it is also more likely than chance to persist if it will retain a mutual pair, although the coefficient is smaller.
A relationship is more likely than chance to form if it will close a transitive triad, and more likely to persist if it 
sustains a transitive triad, although these effects appear to be less clearly significant. 

\section{Example 4: Simulation driven by egocentric data}

In many cases, people's primary interest in using dynamic networks is to simulate some diffusion process on one or more networks with similar features.
Increasingly, our knowledge about those features come in the form of egocentrically sampled data, not from the traditional network census in a bounded population.
Both \emph{ergm} and \emph{stergm} have methods for handling these situations.

For example, imagine that you want to model HIV transmission among a population of gay men in steady partnerships. 50\% of the men are White and 50\% are Black. 
You collect egocentric partnership data from a random (ha! ha!) sample of these men. Your data say:

\begin{enumerate}
\item{There are no significant differences in the distribution of momentary degree (the number of ongoing partnerships at one point in time) 
reported by White vs. Black men. The mean is 0.90, and the overall distribution is:}
\begin{enumerate}
\item{36\% degree 0}
\item{46\% degree 1}
\item{18\% degree 2+}
\end{enumerate}
\item{83.3\% of relationships are racially homogeneous}
\end{enumerate}

We also have data (from these same men, or elsewhere) that tell us that the mean duration for a racially homogenous relationship is 10 months, 
while for a racially mixed one it is 20 months.  
(Perhaps this is because the social pressure against cross-race ties makes it such that those who are willing to enter them are a select group, 
more committed to their relationships).

Before we model the disease transmission, we need a dynamic network that possesses each of thse features to simulate it on. 

Our first step is to create a 500-node undirected network, and assign the first 250 nodes to race 0 and the second to race 1. The choice of 500 nodes is arbitary.

<<>>=
msm.net <- network.initialize(500, directed=F)	
msm.net %v% 'race' <- c(rep(0,250),rep(1,250))
msm.net
@

ERGM and STERGM have functionality that allow us to simply state what the target statistics are that we want to match; we do not actually need to generate 
a network that has them.  The formation formula and target statistics that we need are:

<<>>=
msm.form.formula <- ~edges+nodematch('race')+degree(0)+
    concurrent
msm.target.stats <- c(225,187,180,90)
@

Why don't we specify \texttt{degree(1)} as well?
How did we get those values?

Now let us turn to dissolution. We are back to the case where we can solve these explicitly, 
although this is complicated slightly by the fact that our disslution probabilities differ by the race composition of the members.  
One dissolution formula for representing this is:

<<>>=
msm.diss.formula <- ~offset(edges)+offset(nodematch("race"))
@

These two model statistics means that there will be two model coefficients.  Let us call them $\theta_1$ and $\theta_2$ for the edges and nodematch terms, respectively. 
Let us also refer to the change statistics for actor pair $i,j$ for each of these as $\delta_1(y_{ij})$ and $\delta_2(y_{ij})$, respectively.

Thus the log-odds expression for dissolution that we saw earlier would here be expressed as:
\begin{equation}\label{disslogit}
\ln{\frac{P(Y_{ij,t+1}=1 \mid Y_{ij,t}=1)}{P(Y_{ij,t+1}=0\mid Y_{ij,t}=1)}} = \theta_1\delta_1(y_{ij})+\theta_2\delta_2(y_{ij})
\end{equation}
Note that $\delta_1(y_{ij})$ would equal 1 for all actor pairs, while $\delta_2(y_{ij})$ would equal 1 for race homophilous pairs and 0 for others.  
That means that the log-odds of tie persistence will equal $\theta_1$ for mixed-race couples and $\theta_1 + \theta_2$ for race-homophilous couples.  
This suggests that we should be able to calculate $\theta_1$ directly, and subsequently calculate $\theta_2$.

Following the logic we saw in the Example 1, we can see that:
\begin{equation}
\theta_1 = \ln{d_{mixed}-1}
\end{equation}
and therefore $\theta_1 = \ln{(20-1)} = \ln{19} = 2.944$.

Furthermore, 
\begin{equation}
\theta_1 + \theta_2 = \ln{d_{homoph}-1}
\end{equation}
and therefore $\theta_2 = \ln{(d_{homoph}-1)}-\theta_1 = \ln{(10-1)} - 2.944 = -0.747$.

So, we have:

<<>>=
msm.theta.diss <- c(2.944, -0.747) 
@

We add in one additional control parameter---\texttt{SA.init.gain}---giving it a small value (the default is 0.1).  
As the help page for \texttt{control.stergm} sagely advises, ``If the process initially goes crazy beyond recovery, lower this value.''
This slows down estimation, but also makes it more stable. 
From trial and error, we know that this model, fit to this relatively large network, does better with this smaller value.

Putting it all together gives us:

<<results='hide'>>=
set.seed(0)
msm.fit <- stergm(msm.net,
	formation= msm.form.formula,
	dissolution= msm.diss.formula,
	targets="formation",
	target.stats= msm.target.stats,
	offset.coef.diss = msm.theta.diss,
	estimate = "EGMME"
)
@

\texttt{Iteration 1 of at most 20:}\\
$\Rightarrow$ Lots of output snipped. $\Leftarrow$ \\
\texttt{========  Phase 3: Simulate from the fit and estimate standard errors. ========}\\

Let's first check to make sure it fit well:

<<msmdiag, include=FALSE, results='hide'>>=
mcmc.diagnostics(msm.fit)
@
$\Rightarrow$ Lots of output snipped. $\Leftarrow$\\
\begin{figure}[h]
\begin{center}
\includegraphics[height=3in]{\Sexpr{fig_chunk("msmdiag")}}
\end{center}
\end{figure}

and see what the results tell us:

<<>>=
summary(msm.fit)
@

Now, we simulate a dynamic network:

<<>>=
msm.sim <- simulate(msm.fit,time.slices=1000)
@

and compare the outputs to what we expect, in terms of cross-sectional structure:

<<>>=
colMeans(attributes(msm.sim)$stats)
msm.target.stats
@

Here's another interesting way to look at one aspect of the network structure:

<<msmht, fig.height=3>>=
msm.sim.dm <- as.data.frame(msm.sim)
plot(msm.sim.dm$head,msm.sim.dm$tail)
@

And relationship length:

<<>>=
names(msm.sim.dm)
msm.sim.dm$race1 <- msm.sim.dm$head>250
msm.sim.dm$race2 <- msm.sim.dm$tail>250
msm.sim.dm$homoph <- msm.sim.dm$race1 == msm.sim.dm$race2
mean(msm.sim.dm$duration[msm.sim.dm$homoph==T & 
  msm.sim.dm$onset.censored==F & msm.sim.dm$terminus.censored==F ])
mean(msm.sim.dm$duration[msm.sim.dm$homoph==F & 
  msm.sim.dm$onset.censored==F & msm.sim.dm$terminus.censored==F ])
@

\section{Additional functionality}

Both the \texttt{stergm} functions and the \texttt{networkDynamic} package have additional functionality, 
which you can learn about and explore through the use of R's many help features. 
Remember that both of these have only been released publicly for the first time in recent weeks.  
If you begin to use them in depth in the near future, you will likely have further questions.  If so, we encourage you to join the statnet users' group 
(\url{http://csde.washington.edu/statnet/statnet_users_group.shtml}), where you can then post your questions (and possibly answer others).  You may also encounter bugs; please use the same 
place to report them. Happy stergming!
\\
\\
\\
References:\\
\\
Pavel N. Krivitsky and Mark S. Handcock. A Separable Model for Dynamic
Networks. 2010. \url{http://arxiv.org/abs/1011.1937}

\end{document}
