Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM...

58
Intermittent transformative non- stationary dynamics in complex systems. Collaborators: Tangled Nature Collaborators: Paul Anderson, Kim Christensen, Simone A di Collobiano, Matt Hall, Dominic Jones, Simon Laird, Daniel Lawson, Paolo Sibani Tangled Economy David Robalino, Xiaoye Chen Nicky Zachariou, Kim Christensen, Eduardo Vigas, Misako and Hideki Takayasu Henrik Jeldtoft Jensen Complexity & Networks Group and Department of Mathematics

Transcript of Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM...

Page 1: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Intermittent transformative non-stationary dynamics in complex systems.

!

Collaborators: Tangled NatureCollaborators:

Paul Anderson, Kim Christensen, Simone A di Collobiano, Matt Hall, Dominic Jones, Simon Laird, Daniel Lawson, Paolo Sibani

Tangled EconomyDavid Robalino, Xiaoye Chen

Nicky Zachariou, Kim Christensen, Eduardo Vigas, Misako and Hideki Takayasu

Henrik Jeldtoft Jensen Complexity & Networks Group and Department of Mathematics

Page 2: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Outline

1. Complex systems dynamics2. Generic model - ecology as paradigm3. Intermittency4. Record dynamics5. Economics - current investigations6. Summary & conclusions

Page 3: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Follows the combined O’Keeffe-Einstein principle

O’Keeffe: Nothing is less real than realism. Details are confusing. It is only by selection, by elimination, by emphasis, that we get at the real meaning of things.

Einstein:Make everything as simple as possible, but not simpler.

Page 4: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

The essential characteristics of a complex system

SystemMany interacting componentsEmergenceEvolution

Math modelHigh dimensional Multiple levelsNon-stationary

Page 5: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

ModelsIndividuals interacting according to type, S, and current environmentFixed rate of micro dynamicsEmergent macro dynamics: n(S,t )

IntermittencyAdaptationEvolving network structures

Topology: E.g. degree distribution, connectance Stability

Page 6: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

☻Non-stationary macro dynamics

Fossil record: Decreasing extinction rate.

From:

Newman and Sibani, Proc. Roy. Soc. B. 266, 1593

(1999)

Page 7: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

# of transitions in window

Matt Hall

Intermittency & decreasing extinction rate

Page 8: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Dunne, Jennifer A. et al. (2002) Proc. Natl. Acad. Sci. USA 99, 12917-12922Dunne, Jennifer A. et al. (2002) Proc. Natl. Acad. Sci. USA 99, 12917-12922

Dunne, Jennifer A. et al. (2002) Proc. Natl. Acad. Sci. USA 99, 12917-12922

Degree distribution

Page 9: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

The evolved degree distribution Correlated

0 5 10 15 20 25Degree, k

1e-05

0.0001

0.001

0.01

0.1

1

P(k)

D=29D=26D=19Binomial, D=29

Figure 1: Degree distributions for the Tangled Nature model simulations. Shown are ensembleaveraged data taken from all networks with diversity, D = {19, 26, 29} over 50 simulation runsof 106 generations each. The exponential forms are highlighted by comparison with a binomialdistribution of D = 29 and equivalent connectance, C!0.145 to the simulation data of the samediversity.

a greater degree of resilience to random species extinctions. The stability argumentsare certainly valid but it may actually be the case that the distributional forms appearas a consequence of the internal dynamics. When we perform simulations with randominheritance the degree distributions revert back to binomial form. This implies thatthe correlations are an essential requirement for constructing our exponential networks.To support this theory we shall now present a network model that produces a range ofnon-binomial distributions through correlated dynamics, without any form of selection.

4 Network evolution model

We consider a system with a fixed number of species, D, each defined by generalisedinteractions with subsets of the other system members. Self-connections are excluded hereand as the interaction types are not explicitly considered, the connections are regardedas undirected. This represents a simplified species interaction network that, in principle,embodies interaction types such as mutualism in addition to the usual food-web basedpredator-prey relationships. As a result, the networks we consider here are not expected toassume non-cyclic tree structures nor the stratified trophic levels associated with resourceflow.

We now initiate dynamics representing extinction and correlated speciation with theconstraint of an invariant species number. Newly speciated members are seen to super-sede extinct members without any implication of cause nor e!ect. This invariance ofthe species number can be treated as a consequence of a carrying capacity and whilstsimplistic is a reasonable approximation to an ecosystem. At a timestep, we randomly

5

Exponential becomes 1/k in limit of vanishing mutation rate

From Laird & Jensen, Ecol. Model. In PressSee also Laird & Jensen, EPL, 76, 710 (2006)

Page 10: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Connectance 4.3. Network properties CHAPTER 4.

Figure 4.11: Field data showing connectance versus diversity for a variety of eco-logical systems. Data is taken from articles by Montoya et al [18] and Williams etal [19] mostly representing the same ecosystems. The connectances of the originalarticles have been doubled to make their measures consistent with the connectancedefinition in this thesis (see text).

4.3.2 May-wigner criterion for ecosystem stability

It was a commonly held view that the stability of an ecological network was en-

hanced by increased complexity. There are many notions of complexity [73], but

here we primarily mean the connectance. The perception was that the larger num-

ber of interaction paths between species acts to dampen any natural fluctuations or

environmentally-sourced perturbations. This seemed reasonable and is intuitive if we

think of the concurrent e!ects of the feedback loops as being averaged out. This

intuition can be misleading though. If we consider, as an approximation, that the

interaction e!ects occur as random normally distributed fluctuations each identically

distributed and independent then the dampening viewpoint is inappropriate. The

volatility of these fluctuations is measured by the standard deviation of the normal

distribution. As the summed e!ects of multiple sources of the fluctuations leads to

a variance which is a sum of the individual variances we have an overall standard

87

REFERENCES REFERENCES

[15] Raup DM Biological extinction in earth history, Science, 231, 1528-1533 (1986)

[16] Sole RV, Manrubia SC, Benton M, Bak P Self-similarity of extinction statisticsin the fossil record, Nature, 388, 764-767 (1997)

[17] Drossel B Biological evolution and statistical physics, Adv. Phys. 50, 2, 209-295, (2001)

[18] Montoya JM, Sole RV Topological properties of food webs: from real data tocommunity assembly models, OIKOS 102, 614-622 (2003)

[19] Williams RJ, Berlow EL, Dunne JA, Barabasi AL, Martinez ND Two degreesof separation in complex food webs, PNAS 99, 12913-12916 (2002)

[20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology, Princeton UP, (1974)

[21] Pimm SL Lawton JH, Cohen JE Food web patterns and their consequences,Nature 350, 669-674, (1991)

[22] Warren PH Making connections in food webs, Trends Ecol. Evol. 4 136-140(1994)

[23] McCann KS The diversity stability debate, Nature 405, 228-233, (2000)

[24] Dunne J, Williams R J, Martinez N D Food web structure and network theory:The role of connectance and size, PNAS, 99, 12917-12922 (2002)

[25] Kaufmann SA, The origins of order: Self-organization and selection in evolu-tion, Oxford UP, (1993)

[26] Derrida B Random energy model: An exactly solvable model of disordered sys-tems, Phys. Rev. B 24, 5, 2613-2626, (1981)

[27] Kaufmann SA, Johnsen S Coevolution to the edge of chaos: Coupled fitnesslandscapes, poised states and coevolutionary avalanches, J. Theor. Biol. 149,467-505, (1991)

[28] Havens K Scale and structure in natural food webs, Science 257, 5073, 1107-1109, (1992)

[29] Eigen M Self-organization of matter and the evolution of biological macro-molecules, Naturwissenschaften 58, 465-523, (1971)

[30] Eigen M Schuster P The hypercycle: A principle of natural self-organization,Berlin: Springer, (1979)

142

Page 11: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

0 25 50 75 100Diversity

0

0.2

0.4

0.6

0.8

1

Mea

n co

nnec

tanc

e

Figure 4: Plot of ensemble-averaged mean connectances, < C > against species diversity. Errorbars represent the standard error. The lower dotted line marks the null system connectance,CJ = 0.05, which the evolved systems clearly surpass. The overlaid functional form is that givenby Eq.(8) using the correct background connectance, CJ = 0.05 and with a value of, s = 5.5 forthe selection parameter.

underlying point remains valid. Selection is driving the system to higher edge numbersand equivalently higher connectances. But as we increase the number of nodes in oursubnetwork the probability of achieving a given connectance diminishes, resulting in adecreasing functional form. If we compare Eq.(8) to the ensemble data acquired from theTangled Nature model we see that the form is qualitatively appropriate, Fig.(4). Witha background connectance of CJ = 0.05, the value used in the simulations, the fit isgood but not ideal. The simulation networks presented exponential-like degree distribu-tions though so a formulation based upon binomial networks could be responsible for thisdeviation at higher diversities.

6 Discussion

We have shown here that the exponential degree distributions of the correlated TangledNature model may be attributed to dynamical rather than selective processes. Ournetwork evolution model dynamics generate distributions ranging from binomial throughexponential to power-law which encompasses the Tangled Nature model results and manyof the forms observed in real ecological systems. In the case of the power law distributionour exponent !!1 compares well with the low values associated with ecological networksthat take power law form. The network dynamics are appropriate given the type of systembut the model is idealised and ignores other determining factors, such as migration. Therandom introduction of species acts to decorrelate the system so future work would needto take account of such wider considerations.

Several theories have been proposed to explain the inverse relationship between con-

10

The evolved connectance Correlated

From Laird & Jensen, Ecol Compl. 3, 253 (2006)

Page 12: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Model

Collaborators: Simon Laird, Daniel Lawson, Paul Anderson, Kim Christensen, Matt Hall, Simone A di Collobiano, Paolo Sibani, Dominic Jones,Andrea Cairoli

Page 13: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Tangled Nature - paradigm

• Individuals reproducing in type space

• Your success depends on who you are amongst

Type - S

Type - S

n(S)= Number of individuals n(S)= Number of individuals

SS

Page 14: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Definition Individuals

, where

and

L= 3 Dynamics – a time step

Annihilation Choose indiv. at random, remove with probability

Henrik Jeldtoft Jensen Imperial College London14

Page 15: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Reproduction:

► Choose indiv. at random ► Determine

occupancy at the location

Henrik Jeldtoft Jensen Imperial College London15

Page 16: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

The coupling matrix J(S,S’)

Either consider J(S,S’) to be uncorrelated

or to vary smoothly through type space

and sparse or dense

How Tangled is Nature? A Model of Evolutionary EcologyPaul Anderson and Henrik Jeldtoft Jensen

Department of Mathematics, Imperial College London, South Kensington campus, London SW7 2AZ, United Kingdom

Introduction

An important characteristic of an ecosystem is the set of all interactionsbetween the various individuals. Organisms may influence each other inmany ways and it is di!cult to monitor and quantify most relationshipsexcept for the most obvious. Here, we look at the e"ect of di"erent levelsof connectivity between species within the framework of a simple model ofecosystem assembly and evolution: the Tangled Nature model [1, 2, 3].All work presented in this poster appears in [4]. We compare the earlyand late time connectivity and cluster properties of ecosystems evolvingin two di"erently connected spaces: genotypes influence either a small ora large number of other genotypes.

The Model and Methods

!!An individual is represented by a vector S! = (S!1 , S!

2 , ..., S!L) in the

genotype space S, where the “genes” S!i may take the values ±1, i.e.

S! denotes a corner of the L-dimensional hypercube. We take L = 20.The evolutionary dynamics determines whether a genotype is occupiedor not. The total number of occupied sites is called the diversity.

!! For simplicity, an individual is removed from the system with a con-stant probability pkill per time step.

!!The probability that an individual reproduces, poff , is controlled bya weight function H(S!, t) related to its interactions with other sites.Reproduction is asexual and mimics fission: two individuals are pro-duced with the parent being killed.

!! Each gene of the o"spring has a fixed probability of mutating per timestep, pmut. 500 individuals are placed randomly on the network tostart the simulation.

!!A time step consists of one annihilation attempt followed by one re-production attempt. One generation consists of N(t)/pkill time steps,which is the average time taken to kill all currently living individuals.Generation time is used throughout.

We are interested in the e"ect of changing the background connectivity,". This determines the probability that any two sites are interacting. Ifthey are, then the strength of the interaction is given by Jab = J(Sa,Sb),a number between "1 and +1. All connections are calculated at t = 0.Thus the network properties at any given time depend on which sitesare occupied. Interactions between other genotypes can be explored bymutations away from the current site.

Our main results are explained in the figures. We consider two val-ues for ": 1

200 (low ") and 14 (high "), and three time values: t = 500

(primal time), t = 5000 (early time) and t = 500000 (late time). Anensemble of 500 runs for low and high " were run on a cluster of under-graduate machines left running overnight and at weekends.

The degree and strength distribution plots below show results from thesimulation and the null hypothesis. For this, the number of individualsat a given time was read in from the simulation and these were thenthrown down at random on to the network with the constraint that thediversity was the same. This provides a check on whether any trends arereal or just illusions created by an expanding diversity.

Other features of the Tangled Nature model include a punctuated dy-namic as shown below — where the network spends long periods in aso-called quasi-Evolutionary Stable Strategy (q-ESS) terminated by hec-tic rearrangements of genotype space until a new q-ESS is found — andthe appearance of quasi-species [5].

0 10000 20000 30000 400000

2e+05

4e+05

6e+05

8e+05

1e+06

Time

Gen

oty

pe

Posi

tion

Conclusion

Our most important results are that non-trivial temporal evolution of thenetwork properties of an ecosystem and a realistic form for the speciesabundance are only seen if the genotype space is well connected. Thisis interpreted here as meaning that an occupied genotype is likely tointeract with many other (potentially occupied) genotypes. No evolutionat the level of ecosystems can occur in a world where most genotypeshave very little influence on other organisms. It is easy to overlook theimportance of the entire network of interactions when dealing with smallcommunities of organisms on a macroscopic scale, but easier to visualisewith colonies of billions of bacteria.

From our results, it is tempting to speculate that the observed degreeof diversity, complexity and adaptation of living matter may be directlyrelated to a high level of interdependence between organisms. Hence,Darwin’s entangled bank may be a particularly useful image to keep inmind when studying the evolution of large collections of individuals.

References[1] Kim Christensen, Simone A. di Collobiano, Matt Hall, and Henrik J. Jensen. Tangled Nature: A

Model of Evolutionary Ecology. J. theor. Biol., 216:73–84, 2002.

[2] Matt Hall, Kim Christensen, Simone A. di Collobiano, and Henrik J. Jensen. Time-dependent ex-tinction rate and species abundance in a tangled-nature model of biological evolution. Phys. Rev. E,66(011904):1–10, 2002.

[3] Simone A. di Collobiano, Kim Christensen, and Henrik J. Jensen. The tangled nature model as anevolving quasi-species model. J. Phys. A: Math. Gen., 36:883–891, 2003.

[4] Paul Anderson and Henrik Jensen. Network properties, species abundance and evolution in a model ofevolutionary ecology. submitted to Proceedings of the Royal Society B. Pre-print at cond-mat/0307114.

[5] Manfred Eigen, John McCaskill, and Peter Schuster. Molecular Quasi-Species. J. Phys. Chem.,92:6881–6891, 1988.

AcknowledgementsWe are extremely grateful to G. Pruessner for extensive help with the development of the parallelisedcode and the poster itself. A. Thomas helped provide computer support. Thanks as well to Drs. K.Christensen, S. di Collobiano and M. Hall who have contributed so much to Tangled Nature. P. Andersonthanks EPSRC for research funding.

Further informationMore information can be found in the papers cited above and at H. J. Jensen’s webpage:http://www.ma.imperial.ac.uk/!hjjens. Please send e-mail to [email protected].

Results

unoccupied site.Links are deactivated

positive interaction

negative interaction

Not all sites are occupied. There are several isolated species, in the sense thatthey are not interacting with anyone. Most sites are in two-clusters. These act asbuilding blocks for larger groups. They are usually plugged together by mutants.Large clusters do not persist and the mutually positive two-clusters are the onlylong-living structures. There is no tendency to form larger clusters at later times.

0 2 4 6 8

Number of interactions, x

0

10000

20000

30000

40000

Num

ber

of s

ites

wit

h x

inte

ract

ions

Null modelSimulation

Degree Distribution for Low Species Connectivity

The degree distribution shifts out at latertimes due to an increased diversity but doesnot evolve away from the null model since iso-lated sites are over represented in the null case.

-1 -0.5 0 0.5 1

Interaction strength, J

0

0.5

1

1.5

2

2.5

3

Nor

mal

ised

den

sity

of

indi

vidu

als

wit

h st

reng

th J

Null model and simulation at t=0Null model at t=500000Simulation at t=500Simulation at t=500000

Strength of Interactions for Low Species Connectivity

A change from the null model is seen, butthis is not due to any fundamental change incluster structure but rather the eventual dom-inance of mutually positive two-clusters.

1 10 100Number of individuals per site, !

0

0.0001

0.0002

0.0003

0.0004

Pro

port

ion o

f si

tes

wit

h !

indiv

idual

s

Simulation at t=500Simulation at t=5000Simulation at t=500000

Species Abundance Distribution for Low Species Connectivity

The species abundance distribution (SAD) is skewed to the right at later times asthe heavily populated two-clusters flourish. Thus patches of clusters do not

produce the log-normal form expected from field studies.

Low connectivity ! unrealistic SAD

Not all sites are occupied. Notice how all nodes are connected in one giant clusterand there are no isolated species. With such a high background connectivity, alloccupied sites belong to one cluster at all time steps, although an individual speciesmay only be interacting with a few other genotypes. In the simulation, the nodessit on the corners of a 220 dimensional hypercube.

0 50 100 150

Number of interactions, x

0

1000

2000

3000

4000

Num

ber

of s

ites

wit

h x

inte

ract

ions

Null modelSimulation

Degree Distribution for High Species Connectivity

The degree distribution shifts out at latertimes due to an increased diversity but, as forthe low connectivity case, does not evolve awayfrom the null model.

-1 -0.5 0 0.5 1

Interaction strength, J

0

0.1

0.2

0.3

0.4

0.5

Nor

mal

ised

den

sity

of

indi

vidu

als

wit

h st

reng

th J

Strength of Interactions for High Species Connectivity

-1 -0.5 0 0.5 10

0.5

1

1.5

2

2.5

3

Null and simulation at t=0Null model at t=500000Simulation at t=500Simulation at t=500000

A definite shift towards more positive interac-tions occurs. This is what drives the increas-ing diversity and is non-trivial since all sitesare tangled together in one giant cluster.

1 10 100Number of individuals per site, !

0

0.0002

0.0004

0.0006

0.0008

Pro

port

ion o

f si

tes

wit

h !

indiv

idual

s

Simulation at t=500Simulation at t=5000Simulation at t=500000

Species Abundance Distribution for High Species Connectivity

The species abundance distribution (SAD) evolves and becomes a closer fit to alog-normal at later times. Thus the single cluster of highly interdependent

genotypes produces a similar SAD to those observed by ecologists.

High connectivity ! realistic SAD

Henrik Jeldtoft Jensen Imperial College London16

Page 17: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

reproduction probability

1

Henrik Jeldtoft Jensen Imperial College London17

Smooth function

R! [0, 1]

Page 18: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Henrik Jeldtoft Jensen Imperial College London

Intermittency:

# of transitions in window Matt

1 generation =

18

Page 19: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Time evolution of Distribution of active coupling strengths

Non correlated

Comparisons with this will reveal whether the network isreally evolving, or the results are just by-products ofincreasing diversity. Simulated data is always shown as adotted line and random data as a continuous line.

3. Results

3.1. Connectivity

We study the temporal evolution of the networkconnectivity in the space of occupied positions fordifferent y values. Note that the hard-wired configura-

tion of couplings J!Sa;Sb" between all 220 positions ingenotype space is determined at t # 0 and remainsconstant. The network of occupied sites will neverthelesschange with time and so the network properties at anygiven time depend on which genotypes are inhabited.Interactions between other sites can be explored bymutations away from the occupied sites. The degreedistributions in Fig. 2 show the number of genotypeshaving x active interactions.

The leftmost pair of curves represents primal time, thenext, early time and the rightmost late time. Consideringonly the simulation data for now, a clear shift to agreater number of active links is seen in the high y case,whilst a slight change occurs for low y: The differencebetween early and late time is bigger than that betweenearly and primal time. The degree of a site is equal to thenumber of direct interactions it has with all otheroccupied sites. This explains why any particular site inthe low y runs only has at most nine and usually onlyone or two direct interactions. The data is summed upover the entire ensemble.

How much of this shift is due to a genuine change innetwork connectivity? For high y; the null model datashows that there is very little difference between evolvingthe network and throwing individuals down randomly.Low y appears to show a change. However, any site thatdoes not interact with any others will die very quicklyin a simulation. If for any instant in time geno-type positions are chosen by chance, such a lowconnectivity will give a disproportionate number ofisolated genomes that would be forbidden by thedynamics. There is no fair way to simulate this effect,but it can be seen that the differences between the timecurves in the random and simulated runs is similar andthus the network connectivity does not evolve for eithervalue of y:

ARTICLE IN PRESS

0 4 6 80

10000

20000

30000

40000

0 50 100 150

Number of interactions, x

0

1000

2000

3000

4000

Num

ber

of

site

s w

ith x

inte

ract

ions

2

Fig. 2. Degree histograms. Top: Degree histogram for y # 0:005:Bottom: y # 0:25: Solid lines, random; dotted lines, simulation. Fromthe left, the pairs of curves are for t # 500; 5000 and 500,000. At latertimes, the number of active links increases for both the simulation andrandom data.

-1 -0.5 0 0.5 1

Interaction strength, J

0

0.1

0.2

0.3

0.4

0.5

Norm

alis

ed d

ensi

ty o

f in

div

idual

s w

ith s

tren

gth

J

-1 -0.5 0 0.5 10

1

2

3

0

1

2

3

Fig. 3. Interaction distributions. Top: Distribution of interactionstrengths between individuals for y # 0:005: Bottom: y # 0:25: Inset:Entire distribution. Solid lines, random; crosses, simulation at t # 500;dotted lines, simulation at t # 500; 000: All plots are normalized sothat their area is one. For high y; a significant increase in positiveinteractions is seen. For low y; a change is seen but for trivial reasons.

0 100000 200000 300000 400000 500000

Time

150

200

250

300

Max

imum

clu

ster

siz

e

Fig. 4. Maximum cluster size. Maximum cluster size across allrealisations for y # 0:005: Solid line, random; dotted line, simulation.Clusters produced by the simulation are larger than those produced ina history-independent network.

P.E. Anderson, H.J. Jensen / Journal of Theoretical Biology 232 (2005) 551–558554

Low connectivity

High connectivity

Paul Anderson

Henrik Jeldtoft Jensen Imperial College London19

Page 20: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Time evolution of Distribution of active coupling strengths

Correlated

Simon Laird

Henrik Jeldtoft Jensen Imperial College London

High connectivity

20

Page 21: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Time evolution of Species abundance distribution

Non Correlated

Low connectivity High connectivity

Henrik Jeldtoft Jensen Imperial College London21

Page 22: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Henrik Jeldtoft Jensen Imperial College London

Complex dynamics:Intermittent, non-stationary

Jumping through collective adaptation space: quake driven

Transitions

Log(t)

f(t)

Page 23: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Record dynamics

Distribution of the number of records during t time steps independent of the nature of the fluctuating signal: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14

P1(t) =1t

The first out of t is the biggest

P(1,m)(t) =1

(m! 1)tTwo records during t: one at t=1 with prob (m-1) & one at t=m with prob 1/t.

Two records during t !

Pn(t) ! (ln t)n!1

(n" 1)!1t

= e!!!n!1

(n" 1)!

!with ! = ln t

log Poisson

P2(t) =t!

m=2

1(m! 1)t

" ln t

t

Page 24: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Poisson process in logarithmic time

Mean and variance

Rate of records constant as function of ln(t)

Rate decreases

Non-stationary “1/f fluctuations”

!Q" # ln t and !(Q$ !Q")2" # ln t

! = ln(tk)! ln(kk!1) = ln(tk

tk!1) exponentially distributed

Record dynamics

! 1/t

Page 25: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Record dynamics:

Tangled Nature Cumulative distribution of transitions

Paul Anderson

Page 26: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Record dynamics

Spin glasses (Internal energy)

Relaxation of magnetic field in superconductors (Flux lines entering the sample)

Hungry ants (Exit times)

Earthquakes (Omori law)

Page 27: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Stability

Tangled Nature -

Page 28: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Dominic Jones

Population size

Page 29: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Dominic Jones

Total Core

Dynamics - correlations

I =!

J1,J2

P (J1, J2) log[P (J1, J2)

P (J1)P (J2)]

Page 30: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Origin of adaptation? Effect of mutation Let

convex

30

Page 31: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

31

Origin of adaptation?

4

1 2 3 4 5 6 7 8 9 100.8

1

1.2

1.4

1.6

1.8

2

2.2

2.4x 10

!9

Time(105 gens)

Mutu

al In

form

ation (

avera

ged o

ver

250 r

ealis

ations):

Random

netw

ork

s

FIG. 3:

100

101

102

103

104

950

1000

1050

1100

1150

Avera

ge p

opula

tion

Time (100 generations)

100

101

102

103

104

1350

1400

1450

Avera

ge p

opula

tion

Time (100 generations)

FIG. 4:

poff (H)

pkill

pkill

Dominic Jones

Page 32: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Macro dynamics - the transitionsNon correlated

Graph courtesy to Matt Hall

Henrik Jeldtoft Jensen Imperial College London

decease. The fitness poff !Sa; t" of individuals at aposition Sa depends on the occupancy n(Sb, t) ofall the sites Sb with which site Sa is connectedthrough couplings Jab. Accordingly, a smallperturbation in the occupancy at one positionis able to disturb the balance between poff !S; t"and pkill on connected sites. In this way, animbalance at one site can spread as a chainreaction through the system, possibly a!ecting aglobal reconfiguration of the genotypical com-position of the population.

Dynamical Behaviour

We consider two di!erent types of popula-tions: (1) a purely asexual population and (2) apurely sexual population.

ASEXUAL REPRODUCTION

In this subsection, we discuss the model whenall reproduction is assumed to be asexual.

INITIATION

Let us consider the initiation of the model.First, we place the entire population N(0) at arandomly chosen location S* in genome space.The H-function in eqn (2) will be given byH(S*,0)=#mN(0) since n(S)=0 for SaS* andJ(S*, S*)=0. If no mutations can occur thepopulation will remain confined at the locationS* and the size of the population n(S*, t) willaccording to eqn (4) approach the value

N$ %1

mln

1# pkill

pkill

! "

:

Mutations do occur, however, and the popula-tion will migrate away from the original locationS* into the surrounding region of genome space.In Fig. 2, we show a cladogram indicating theevolution of the first 110 generations. Duringthis initial period, the newly invaded positionsare only occupied for a few generations (in-dicated by the short horizontal lines in Fig. 2).After this period of rapid changes, a relativelystable configuration is achieved, and the occu-pied positions to the right in Fig. 2 indicate thatthe system has entered its first q-ESS.

We have also studied simulations started outfrom an initial population spread out over manyrandomly chosen positions in genome space.Most of these initially occupied positions rapidlybecome extinct. In this way, the diversity ingenome space passes through a ‘‘bottleneck’’before the population starts to migrate out intogenome space from one or a few positions whichwere able to pass through the bottleneck. Fromthen on, the evolution of the ecology behaves inthe same way as when started out from onesingle position in genome space.

LONG TIME BEHAVIOUR

Now, we turn to a discussion of the nature ofthe long time dynamics of the model. The modelconsists of a variable number of co-evolvingindividuals all subject to the same physicalenvironment. An individual’s ability to thrive

Fig. 2. The initial diversification from a single positionin genome space. The system is initialized at time t=0 with500 identical individuals and allowed to develop autono-mously. Time is plotted horizontally. Similar to ordinarycladograms di!erent genotypes are located at di!erentvertical positions. Vertical lines represent parentages.Horizontal lines starts at the time a genotype is createdand stops when the genotype becomes extinct. The systemmutates away from the initial location, which becomesextinct relatively quickly. After 34 branchings the systemfinds a stable configuration and enters the first q-ESS (seeFigs 3 and 4).

TANGLED NATURE 77

32

Page 33: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Consider simple adiabatic approximation.

Stability of genotype S assuming:

Consider

Stationary solution

Fluctuation

Fulfil

i.e. stability

Stability of the meta-stable configurations

Henrik Jeldtoft Jensen Imperial College London33

Page 34: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Transitions between meta-stable configurations caused by co-evolutionary collective fluctuations

Henrik Jeldtoft Jensen Imperial College London34

Page 35: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

The error threshold

Henrik Jeldtoft Jensen Imperial College London

Too large mutation rate prevents qEES to establish.

Mean field analysis:

Collobiano, Christensen and Jensen, J Phys A 36, 883, (2003)

na(t + 1) = na(t) +na(t)

!!a na!(t)

[paoff (t)(2p0 ! 1)! pkill]

Number of individuals on site a

!na = +1p2o + (!1)(1! P0)2 = 2p0 ! 1

!

p0 = (1! pmut)L

35

Page 36: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Assume steady state, time average and use

! na(t)!!

a na!(t)pa

off (t)" = ! na(t)!!

a na!(t)"!pa

off (t)"

then we obtain

pq =pkill

2(1! pmut)L ! 1for the on average off-spring probability for those site which are able to counterbalance the kill by off-spring production. Leading to a corresponding weight function H for the wild-types in the q-ESS Hq = ln(

pq

1! pq) = ln(

pkill

2(1! pmut)L ! 1! pkill)

In the hectic states we assume the a simple balance between reproduction and killing

poff = pkill

or Hhectic = ln(pkill

1! pkill)

36

Page 37: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Hq = ln(pq

1! pq) = ln(

pkill

2(1! pmut)L ! 1! pkill)Hhectic = ln(

pkill

1! pkill)

A hectic transition can only develop into a q-ESS if hectic peak overlaps with q-EES peak

Hhectic + !k ! HqWe assume width of hectic peak proportional to with of distribution of J given by k

37

Page 38: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

α is used as fitting parameter

q-ESS region

No q-ESS region

=1/k

38

Page 39: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Dynamical systems approach Mean field

Fixed point analysis Stability matrix

In progress

Page 40: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

David Robalino

Stochastic dynamics

Economics

Page 41: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Use correlated J(S1,S2)Consider S to label economical entities, say companies of capital C(S,t)

Dynamics:Define Pgain(S, t) =

exp[H(S, t)]1 + exp[H(S, t)]

With probability

letJ+(S) =

!S! J(S,S!)![J(S,S!)]

J!(S) =!

S! J(S,S")![!J(S,S")]

C(S, t + 1) = C(S, t)(1 + cgJ+(S)JTot(S)

)

C(S, t + 1) = C(S, t)(1 + clJ!(S)JTot(S)

)With probability 1! Pgain(S, t)

Pgain(S, t) :

:

n(S, t)! C(S, t)

Replacement

Page 42: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Comparison between data and model:Volume as GDP

In model

GDP(t) =!

S

C(S, t)

David Robalino, MSci Thesis

Page 43: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Comparison between data and model:Growth rate

David Robalino, MSci Thesis

Page 44: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Comparison between data and model:Size of companies

David Robalino, MSci Thesis

Page 45: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Comparison between data and model:Company age

David Robalino, MSci Thesis

Page 46: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Comparison between data and model:Number of companies

David Robalino, MSci Thesis

Page 47: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Deterministic dynamics with

stochastic node addition

Xiaoye Chen

Economics

Page 48: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Robustness versus diversity

Simple dynamical network model of N nodes and k edges:

Each node i = one company possessing: Ci = Cash - liquidity Mi = Material - goods or services Pi = position in “production chain” Ai = Ci + Mi(Pi+1) = assets Ei = Maximum fraction of cash it uses in trade each

turn. Represents the amount of risk a company is willing to take.

Ii = in degree Oi = out degree

.

Summer project by Xiaoye Chen

Page 49: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Each link aij = 1 represents flow direction of cash between two companies

Cash in flow

Material in

flow

Money source

Money sink

Page 50: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Dynamics: nodes are created and disappear

1.Initially No nodes. And K=N0m edges

2. New companies: -> Select company preferentially according to assets. New subsidiary created by transferring 1/2 the assets of mother company.

-> New company is linked to mother company + preferential attachment according to assets.

3. Bankruptcy -> A company with negative cash is bankrupt. It is merged with another company selected preferentially on cash. The cash of the company is decreased accordingly. The bankrupt is removed from the system.

stoc

hast

ic

Page 51: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Time step

1. Fixed cash payment: running cost2. Trade with adjacent companies i & j:

Tij = min{CiEi/Oi , Mj(Pj+1)/Ij}

3. Cash update of company i:

4. Materials update:

(ci)t+1 = (Ci)t !!

j

aijTij +!

j

ajiTji ! PAYMENT

Cash spent buying materials

Cash gainedselling materials

(Mi)t+1 = (Mi)t +!

j

aijTij/(Pj + 1)!!

j

ajiTji/(Pi + 1)

Page 52: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Source and sink

Before each exchange/trading round a source and a sink is added.They are linked to the m=4 nodes of most extreme position.

These nodes are removed again after each exchange round.

Material in

flow

Money source

Money sink

Cash in flow

Page 53: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Fluctuations and perturbation

100 200 300 400 500 600 7000

0.05

0.1

0.15

0.2

0.25

h

P(h)

hc = 100

hc = 140hc = 250

hc = 350

Page 54: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Size distribution of spontaneous “crashes”

Page 55: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Spread in degreed decreases robustness

Page 56: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Spread in risk willingness increases robustness

Page 57: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

Summary + Conclusion

Multi-level dynamics intermittency at macro-level

Non-stationary collective adaptation

Transition times found to follow record statistics

not always but often

Page 58: Intermittent transformative non- stationary dynamics in complex … · 2012-03-23 · [20] May RM Stability and complexity in model ecosystems: monographs in popu-lation biology,

!

Web sites: www.ma.ic.ac.uk/~hjjens www3.imperial.ac.uk/complexityandnetworks

Thank you