Find high scoring directed acyclic graphs using heuristic search.
Source:R/search_hillclimber.R
searchHillClimber.Rd
Find high scoring network (DAG) structures using a random re-starts greedy hill-climber heuristic search.
Usage
searchHillClimber(score.cache, score = "mlik", num.searches = 1, seed = 42,
start.dag = NULL, support.threshold = 0.5, timing.on = TRUE,
dag.retained = NULL, verbose = FALSE, ...)
Arguments
- score.cache
output from
buildScoreCache()
.- score
character giving which network score should be used to select the structure. Currently
'mlik'
only.- num.searches
number of times to run the search.
- seed
non-negative integer which sets the seed in the GSL random number generator.
- start.dag
a DAG given as a matrix, see details for format, which can be used to provide a starting point for the structural search explicitly.
- support.threshold
the proportion of search results - each locally optimal DAG - in which each arc must appear to be a part of the consensus network.
- timing.on
extra output in terms of duration computation.
- dag.retained
a DAG given as a matrix, see details for format. This is necessary if the score.cache was created using an explicit retain matrix, and the same retain matrix should be used here. dag.retained is used by the algorithm which generates the initial random DAG to ensure that the necessary arcs are retained.
- verbose
extra output.
- ...
further arguments passed to or from other methods.
Value
A list with entries:
- init.score
a vector giving network score for initial network from which the search commenced
- final.score
a vector giving the network score for the locally optimal network
- init.dag
list of matrices, initial DAGs
- final.dag
list of matrices, locally optimal DAGs
- consensus
a matrix holding a binary graph, not necessary a DAG!
- support.threshold
percentage supported used to create consensus matrix
Details
The procedure runs a greedy hill-climbing search similar, but not identical,
to the method presented initially in Heckerman et al. 1995.
(Machine Learning, 20, 197-243).
Each search begins with a randomly chosen DAG structure where this is
constructed in such a way as to attempt to choose a DAG uniformly from
the vast landscape of possible structures. The algorithm used is as follows:
given a node cache (from buildScoreCache
,
then within this set of all allowed local parent combinations,
a random combination is chosen for each node.
This is then combined into a full DAG, which is then checked for cycles,
where this check iterates over the nodes in a random order.
If all nodes have at least one child (i.e., at least one cycle is present),
then the first node examined has all its children removed, and the check for
cycles is then repeated. If this has removed the only cycle present,
then this DAG is used at the starting point for the search,
if not, a second node is chosen (randomly) and the process is then
repeated until a DAG is obtained.
The actual hill-climbing algorithm itself differs slightly from that presented in Heckerman et al. as a full cache of all possible local combinations are available. At each hill-climbing step, everything in the node cache is considered. In other words, all possible single swaps between members of cache currently present in the DAG and those in the full cache. The single swap, which provides the greatest increase in goodness of fit is chosen. A single swap here is the removal or addition of any one node-parent combination present in the cache while avoiding a cycle. This means that as well as all single arc changes (addition or removal), multiple arc changes are also considered at each same step, note however that arc reversal in this scheme takes two steps (as this requires first removal of a parent arc from one node and then addition of a parent arc to a different node). The original algorithm perturbed the current DAG by only a single arc at each step but also included arc reversal. The current implementation may not be any more efficient than the original but is arguably more natural given a pre-computed cache of local scores.
A start DAG may be provided in which case num.searches must equal 1 - this option is really just to provide a local search around a previously identified optimal DAG.
This function is designed for two different purposes:
i) interactive visualization; and
ii) longer batch processing. The former provides easy visual "eyeballing" of
data in terms of its majority consensus network (or similar threshold),
which is a graphical structure which comprises of all arcs which feature in
a given proportion (support.threshold
) of locally optimal DAGs already
identified during the run. The general hope is that this structure will
stabilize - become fixed - relatively quickly, at least for problems with
smaller numbers of nodes.