|
Advertisement | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
J. Biol. Chem., Vol. 276, Issue 39, 36168-36173, September 28, 2001
From the Institute of Microbiology CAS, Videnska 1083, 142 20 Prague, Czech Republic
Received for publication, May 15, 2001, and in revised form, June 4, 2001
Many cell control processes consist of networks
of interacting elements that affect the state of each other over
time. Such an arrangement resembles the principles of artificial neural
networks, in which the state of a particular node depends on the
combination of the states of other neurons. The Recently developed analytical techniques such as gene chips and
proteomics generate data reflecting the status of an entire cell or
organism at a given time and therefore provide a snapshot of all the
pathways that compose the genetic network of a cell or organism. A set
of these snapshots taken at short time intervals forms time series of
mRNA or protein amounts. Such time series reflect regulatory
interactions among the members of the system. The availability of such
kind of data makes it possible to utilize existing, or to design new
mathematical models of the regulatory processes, which make it possible
to analyze the dynamics of the processes and identify interactions
among genes and their products. Knowledge of the principles of the
system control can lead to the design of simulation models that can
predict situations that can not be achieved experimentally and thus
provide a feedback to experimental biologists.
A number of different mathematical models of cell regulatory processes
have appeared in recent years. One of the approaches formalizes gene
regulation into a network with nodes representing genes and connections
among genes, which define the regulatory action of one gene product on
another gene. Mathematically such processes can be expressed by a
neural network. A number of models were suggested based on two-stage
Boolean or linear (feed forward) representation (1-8). Recurrent
neural networks used for the description of dynamics of genetic
networks, in particular of eukaryotic systems (9, 10), or suggested as
a general model of transcription and translation (11) form a special
case of this type of model. The advantages and disadvantages of this
approach were discussed in Ref. 11. Comparative analysis of performance of the neural network-based models can be found in Ref. 12. Recurrent
neural networks can also deal with feedback, which can occur in natural
gene control processes, and they are flexible enough to fit
experimental data. If the components of the system and their regulatory
interactions are known, recurrent neural networks can be used to model
and simulate the dynamics of gene expression in such systems.
Several other models of genetic networks utilizing the apparent analogy
between gene control and electronic circuits have been designed
(13-18).
The The Model
The model is based on the assumption that the regulatory
effect on the expression of a particular gene can be expressed as a
neural network (Fig. 1). Each node of the
network represents a particular gene, and the wiring between the nodes
defines regulatory interactions (11). It can be assumed that the state
of gene expression at time t + dt
depends on the state of expression at time t and the
connection weights (Fig. 1). Generalization of this principle leads to
the definition of the rate of expression as a change of accumulation of
gene i product over time
(dzi/dt). The rate of expression of gene
i can be derived from the expression levels
(yj) at the time t and connection weights
(wij) of all genes connected to the given gene. Thus
gi, a regulatory effect on gene i,
is
Let the rate of expression of a target gene i
(dzi/dt) be given by the regulatory
effects of other genes Equation 3 represents a special case of a class of recurrent neural
networks described by a general formula,
is an external input to the node i. These
types of networks have been used as associative memories and as models
of brain activity, and their dynamics have been studied thoroughly.
Depending on the weight matrix, the state transition of the network can
lead to a point attractor (stationary state), can become oscillatory
(limit cycle), or can even become chaotic depending on the weights and
the complexity of the network. Several methods of "training,"
i.e. computation of the weight matrix and the other
parameters from experimental time series, have been suggested (20,
21).
Phage Bacteriophage The Decision Network--
A simplified schematic representation of
the Transcribing RNA polymerase molecules stop just at the end of N and cro, respectively. The N and cro mRNAs are translated into their respective proteins (22-24). The N protein is a positive regulator that enables the transcription of genes to the left of N including cIII and the recombination genes and genes to the right of cro including cII and the DNA replication genes O, P, and Q (25). N works as a positive regulator by enabling RNA polymerase to transcribe through the regions of DNA that would otherwise cause the mRNA to terminate. CIII protects CII from proteolytic degradation (26). Because CII works as an activator, it enables RNA polymerase to bind and begin transcription at two promoters that would otherwise remain silent: PRE and PI. cI can be transcribed from two promoters, PRM and PRE. Transcription from PRM is maintained by CI in a self-inducing feedback loop, and transcription from PRE depends on the concentration of CII. Starting at PRE, polymerase transcribes leftward to the end of the cI gene. When this mRNA is translated it produces CI but not Cro, which is encoded on the other strand. CI binds to OL and OR. CI bound to these two sites turns on transcription of its own gene and blocks transcription of lytic genes and early ones necessary for phage construction. In the meantime Cro binds to OR3 to block synthesis of CI. It then binds to the second operator, OL, to turn off transcription initiated at PL and to the remaining sites of OR, as described above. Both CI and Cro bind to OR to stop their own transcription at higher concentrations. This occurs far after the decision has been made and does not influence the process of decision and therefore is not considered in the model. This analysis defines both the timing of the process and regulatory interactions among the members of the system. Formalization of the process to a neural network is shown in Fig. 1. The Decision-- The scenario of the process is not fully understood but it can be deduced that the decision, which of the two alternative pathways is to be chosen, depends on the activity of CII (26, 27). It has been found that if CII is highly active, the infecting phage lysogenizes; otherwise it grows lytically. In cells in which CII is rapidly degraded, no CI is synthesized. If Cro binds to OR3 before CI is bound to OR1 and OR2, the phage will not establish lysogeny. This never occurs if the CII protein is highly active. It has been shown that the rate of expression of cI depends on the activity of the PRE promotor, which is controlled by CII. The CIII protein also helps to establish lysogeny; its role is to protect CII from degradation (the half-life of CII is about 5 min in the presence of CIII but <1 min in the absence of CIII (26)). If CIII is absent, CII is virtually always inactivated, and the phage can grow only lytically. In the cells where protease levels are high, no CI is synthesized, the Cro protein is synthesized, and lytic growth ensues. Therefore the rate of synthesis of CI depends on the activity of CII, which depends on the environmental conditions. CII is the crucial element of the decision network and its activity determines which of the two pathways will be chosen. Simulation of the Lytic/Lysogenic Decision The elements of the decision circuit have been identified above.
The "influence" matrix, which is just the formalization of the
analysis of the decision network made above, can then be derived (Fig.
1b). The kinetic profiles of individual gene products were computed numerically from the set of differential equations defined in
Equation 3 with the weight matrix from Fig. 1b. There, + and
The Role of CII-- It has been found that the variable influencing the decision to which side the "switch" will flip is the stability of CII. The simulation of the two principal situations (low and high stability of CII) is shown in Fig. 3. Results of simulations shown in Fig. 3, a and b, revealed that when the CII half-life is short, practically immediately after the network initiation Cro dominates the field and represses expression of all other members of the network. Fig. 3b shows the time course of the changes in number of molecules of N, CII, and CI transcribed from PRE and PRM. First of all, N is synthesized followed by CII, which initiates transcription of cI from PRE, but CI never reaches the amount necessary to activate the self-inducing loop of expression of cI from PRM.1 Fig. 3, c and d, shows the simulation of the situation when CII is well protected from cleavage. CI from PRE reaches a sufficiently high value to start up the self-inducing expression from PRM, which immediately starts to block the synthesis of N, CII, and Cro and consequently of its own transcription from PRE. The amount of cI product transcribed from PRM is high enough to maintain the self-inducing loop. CI reaches a concentration that maintains its dominance, represses all other members of the network, and establishes lysogeny. Dependence of the Lytic/Lysogenic Decision on Multiplicity of
Infection--
It has been observed that probability of lysogeny
increases markedly with increasing
MOI2 up to an MOI of ~7
(28). As the simulation reveals (Fig. 4), at low MOI both CII and CIII are synthesized at low levels, and the CII
concentration is too low to activate PRE and initiate transcription of cI from PRM.
Concentration of Cro is therefore high enough to establish lysis. With
increasing MOI, the concentration of CII increases until it reaches an
amount necessary to initiate the self-inducing production of CI. Any
further increase of MOI does not substantially change the concentration
of CII. The peak concentration of CII is maintained by the balance
between its production and the concentration of the CI repressor,
which, after establishing the lysogenic path, blocks the synthesis of
CII.
The infection of a population of cells with an average MOI produces a distribution of MOI across the population. Because the concentration of CII markedly depends on MOI, the result is a distribution of lytic/lysogeny outcomes, which has been observed. Effect of Ultra Violet Irradiation-- Ultraviolet light stimulates proteases that cleave CI, breaking the PRM feedback loop, which maintains the transcription of cI (29). In the prophage stage, promoters PR and PL are no longer repressed by CI and cro, other lytic genes can be expressed, and phage replication and lysis are initiated. This situation is principally analogous to the simulation shown in Fig. 3a. Sensitivity of Lytic/Lysogenic Switch--
The question
remains: how sensitive is the switch? In other words, does there exist
a transition region of CII half-life where the decision is uncertain?
To investigate this question, a set of simulations was run, in which
the value of the half-life of CII was gradually increased, and the
terminal state of the network was checked until it switched from lysis
to lysogeny. It was found that there exists a point at which an almost
infinitesimal change of the half-life of CII caused inversion of the
terminal state of the network. This is illustrated in Fig.
5, in which the simulated time courses of
the members of the
The parameters and weight matrix of the model were chosen to give
values in the range of the experimentally observed one. To test whether
the switch works the same way using other combinations of parameters,
the behavior of ~100 networks with randomly generated parameter
values was simulated. The range of parameter values was constrained
only by the known and observed limits, which were mentioned above. The
"switch point" moved to different positions, and the amplitude of
time courses of components of the network was different; but in all
cases the principle of the bifunctional switch remained the same. The
transition region was always almost infinitesimally narrow. Such
behavior has never been reported before. This is of course not a
mathematical proof that the system always relaxes to this terminal
state, but it at least supports the notion that this is the natural
behavior of the A similar phenomenon is exhibited by the dependence of the lysis/lysogeny decision on MOI. At low MOI the concentration of CII is never high enough to establish lysogeny. With increasing MOI the concentration of CII increases as well, up to a point when it is high enough to initiate transcription of cI from PRM. This flips the switch and establishes lysogeny. A further increase of MOI does not substantially increase the concentration of CII, which is already sufficient to start up the lysogenic path.
Values of the weight matrix in all simulations were set to follow
constraints found during qualitative analysis of the behavior of the
system to give outputs in a range roughly corresponding to the
experimentally observed ones. Biochemically correct values can only be
obtained from experimental time series, which are not presently available.
In a single cell all biochemical reactions occur on a nanomolar
scale, i.e. with countable amounts of molecules. The
direction the reaction pathway takes depends on the amounts of reagents at a particular time in a particular place. The fluctuations of these
amounts are stochastic, and the output of a regulatory process can be
stochastic as well. This topic has been analyzed thoroughly in the work
of McAdams and Arkin (14, 16). In principle, such a stochastic nature
of cell molecular processes can lead to instability. Any instability is
potentially dangerous because of the resonance effect the instability
can propagate in time and finally can cause breakup of the system. It
implies that in the evolutionary process, the regulatory systems in the
cell evolved such that they were capable of eliminating such stochastic
behavior and thus inherited instability. Very often the stability of
natural processes is maintained by redundancy. The It would be possible to design a circuit, much simpler than the In this paper the ability of a neural network model to simulate and predict the behavior of already quite complex system is presented. The model generates time series of amounts of components of the system. With progress in the development of techniques such as quantitative and functional proteomics (11, 30), mainly mass spectroscopy-based (31, 32) or DNA chip technology, the problem can be turned around, and the problem of identifying the network from experimental time series arises. This means the determination of the values of the weight matrix and other parameters from experimentally measured time series3 (training of the network in the neural network terminology). The weight matrix can then be translated in terms of mutual control of the elements of the system. Values close to zero mean no control, and high positive or negative ones mean positive or negative control, respectively. The weight matrix directly determines the connections in the neural network. Together with other independent observations the neural network can be translated to a pathway. This reverse engineering can become a base for a very efficient method for reconstructing regulatory pathways from experimentally measured data. The modeling approach has an advantage of any mathematical model; it can predict situations that cannot be reached experimentally. If quantitative data obtained from a well designed experiment allow a model to be constructed, the functionality of which is tested by comparison with experiments, the model can serve to investigate an infinite number of different situations such as those caused by mutagenesis, changes in activity of the elements of the system, etc. The model allows the dynamics of the process and the terminal states of the system to be investigated. It can bypass experimental limitations and thus explore biological situations currently restricted by experimental accessibility. It also brings deeper understanding of the nature of the whole process. The simulation capabilities are unlimited and can provide a check on the intuitive understanding of a process. Neural networks are known as models of brain activity or tools capable
of recognizing an input pattern. A neural network, out of a possible
infinite number of states, tends to relax to a limited number of
terminal configurations depending on the initial state of the variables
forming the network. This resembles the principles of complex
coordination of the functions within a cell. The cell is an extremely
complex system and without tight control would reach an infinite number
of states. In practice it reaches a very limited number of
configurations that maintain the healthy state of the cell and its
overall stability. Many control systems exist in a cell that eliminates
any perturbations that would lead to cell instability and its
subsequent breakdown. I am convinced, and in this paper I am trying to
bring the evidence, that the neural networks are capable of simulating
natural processes and can be used to model cell regulatory systems.
I thank Rein Aasland, Jiri Adamec, Pavel Janscak, Patric Viollier, J. Weiser, and Jeremy Ramsden for discussion of the topic and comments on the manuscript.
* This work was supported by Grant Agency of the Czech Republic Grant 204/00/1253.The costs of publication of this article were defrayed in part by the payment of page charges. The article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.
Published, JBC Papers in Press, June 6, 2001, DOI 10.1074/jbc.M104391200
1 The curve of the cI product transcribed from PRM remains close to zero. Nevertheless, detailed inspection of the curve shows that very little CI from PRM is being synthesized.
3 It is possible to take advantage of the theory of recurrent neural networks, which suggests appropriate methods (e.g. Ref. 33 or 19). Such methods were designed for recurrent neural networks in general. The use of these approaches for the modeling of control of gene expression is discussed in Ref. 11 or 12.
The abbreviation used is: MOI, multiplicity of infection.
Copyright © 2001 by The American Society for Biochemistry and Molecular Biology, Inc. This article has been cited by other articles:
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Advertisement | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||