Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
SPIEDigitalLibrary.org/conference-proceedings-of-spie
John P. Ralston
ABSTRACT
There is great interest in quantum mechanics as an ”emergent” phenomenon. The program holds that non-
obvious patterns and laws can emerge from complicated physical systems operating by more fundamental rules.
We find a new approach where quantum mechanics itself should be viewed as an emergent information man-
agement tool not derived from physics nor depending on physics. The main accomplishment of quantum-style
theory comes in expanding the notion of probability. We construct a quantum probability map from macroscopic
information as “data” to quantum information. The map permits a hidden variable description for quantum
states, and efficient use of the helpful tools of quantum mechanics in unlimited circumstances. We construct a
dynamical quantum map from generalized Hamiltonian dynamics to quantum dynamics. We show that under
wide circumstances Hamiltonian dynamics emerges from structureless dynamical systems by embedding them in
an appropriate phase space. The uses of the quantum information management tools are illustrated by numerical
experiments and practical applications.
Keywords: Quantum mechanics, photons, entanglement, quantum probability, density matrix theory
1. PHYSICS EVOLVES
The concept of photons was developed more than a century ago, yet engineers and physicists are still asking
“what are photons?” We have a concise proposal: Photons are a theory.
Quantum theory has evolved. Photons no longer mean the “light quantum” Einstein proposed. Yet historical
holdovers impede the development and communication of physics. We will explore an approach breaking with
the historical development. We view quantum theory as emergent, a word that has two meanings. The word
“emergent” means discovering non-obvious characteristics or orderliness in macro-systems that are not put in by
hand in the micro-system. Some look to deeper physics beyond the Standard Model to provide this.1, 2 By clearing
away historical prejudice we have developed a different view. We find that the framework of quantum mechanics
itself lacks fundamental information about micro-systems. We find it is descriptive for when customized to
systems desired to be described, not predictive. Many redundant postulates of quantum mechanics also emerge
as outcomes, in that they can be derived, by simply dealing with the topic from a modern perspective and
minimal mathematics.
We believe that adding new assumptions to explain old ones would be the wrong road. It appears that
“axioms” seldom matter for what physicists and engineers do in practice. Unlike mathematics, there is no
conservation law on the number of assumptions needed to set up physics. What was minimal in the mid-1920’s
has evolved because concepts and the larger theory has evolved. It was once a great accomplishment to set up
a new quantum principle and defend it. We say it is a great accomplishment to get rid of redundant principles,
one by one. The exaggeration of mystery found in early quantum mechanics has probably run its course.
We maintain that much of quantum theory is practical and procedural, and that the traditional restriction of
quantum methods to describing micro-physical objects of fundamental physical character will soon be obsolete.
But rather than dispute with those who might be offended about what constitutes quantum mechanics, we will
say that in our approach of un-Quantum systems there are no deep postulates.
E-mail: ralston@ku.edu; telephone: 1 785 864 4626
Textbooks will present a derivation from the path-integral approach to quantum mechanics, following a long road
needing many independent physical assumptions in advance, one would think.
Find another path. Much of 21st century physics is about correlations. The concept is more general than
quantum theory. A correlation is a function, or a collection of numbers, obtained on some statistical basis,
Symbol δ/δJ(x) is a functional derivative, needed when label x is continuous, otherwise a partial derivative. We
are expressing nothing profound here beyond the fact that given the correlations we can define Z(J) as a Taylor
series; the symbol |J=0 evaluates all J → 0 after the derivatives are computed. Define a Fourier transform Z̃(φ)
from J(x) → φ(x):
Z
Z̃(φ) = d[φ] Z(J)eiJx φx .
Symbol d[φ] is a functional measure, and Jx φx stands for dN x J(x)φ(x), which is the continuous sum when label
R
x is continuous. The functions for which the calculations can be done at arbitrary dimensionality are Gaussians,
so we will be describing coupled Gaussian correlations, and related tricks, in most applications. Replace symbol
Z̃(φ) → e−S(φ) , which defines S. By definition
Z
δ δ
iN
d[φ] e−S(φ) φ(y1 )...φ(yp ) = ... Z(J)|J=0 = C(y1 ...yp ). (2)
δJ(y1 ) δJ(yp )
All features of the correlations, and in particular their symmetries, so important to physics, must be encoded
in S. If the measure and the fields φ are invariant under a symmetry, and S is invariant, then the correlation
will be invariant. It’s no wonder that S was noticed and given the name “the action.”
In the way we obtained it, Eq. 2 is so general that it is empty mathematical formalism. We don’t advertise it
as our accomplishment, because it actually is mere formalism and well-known in several contexts. The formula
is not specific about how correlations are found or used. Our contribution is to find it unhelpful to say the
path integral of Eq. 1 comes from quantum physics, depends on many quantum mechanical principles and
assumptions, or is the culmination of modern theory. That confuses the long road to an elementary result with
the result. We are drawing a line between the physical model, wherein lies all the information, and the machinery
organizing it, which has none.
2.2 Entanglement
The hyperbolic promotion of “entanglement” as a uniquely quantum mechanical effect is breathtaking. At the
level of calculus I, a student will challenge a presentation based on asserting a general function f = f (x, y, z) =
X(x)Y (y)Z(z), because it is not general. Yet if a finite dimensional quantum wave function ψab 6= ψa ψb its
entanglement is taken to be something serious. Does that make sense?.
We prefer to think in terms of division.7 Division is the inverse of making direct products. Consider a
list of data DI , where I = 1...N . Partition the list into adjacent bins of length n labeled by J = 1...Jmax . If
Jmax = N/n is not an integer, discard data to make all bins the same length. Within each bin label the points
j = 1...n, that is, j = (modJ, n). The result is a map from one to two indices,
DI → DiJ = ΓIiJ DI .
The symbol ΓIiJ represents a linear transformation with an array of numbers (1’s and 0’s) that reproduce what
we just described with words. The transformation is invertible by flattening out DiJ → DI .
This is the singular value decomposition, svd. The factors are orthonormal:
β
eα
i ei = δ
αβ
; fJα fJβ = δ αβ .
(The usual conjugation of inner produces is used if data is complex.) The sum over α extends up to the dimension
of the smaller space, or less. That forces the “coupling” to the larger space to be restricted to a subspace of the
same dimension. This has unexpected consequences whether or not one is considering fundamental microscopic
physics.
C = |X1 > (α1 |0 > +β1 |1 >) + |X2 > (α2 |0 > +β2 |1 >).
Given that actuaries are an intelligent and well-paid group, we suspect they will find a business opportunity in
using linear combinations of alive and dead people.
In the past, however, engineers and physicists were not given the same freedom. They used classical statistical
methods for classical systems, and quantum statistical methods for quantum systems. The use of linear combi-
nations was approved after a system had been set up as a microphysical theory with numerous assumptions and
much reference to Planck’s constant. It may seem reckless, but we propose that the helpful organizational math-
ematics developed for quantum systems has many more uses than being restricted to fundamental microphysics.
If there is a way for an insurance company to make money from it, they will not hesitate to use it.
Here
X
DD† = |eα > (Λα )2 < eα |; (6)
α
X
D† D = |sα > (Λα )2 < sα |.
α
The singular values Λα are invariant when the data is transformed by independent orthogonal (complex unitary
) transformations on the object and sample spaces.
We turn to an instructive illustration of mapping data into probabilities.
2.3.2 The Probabilistic Quantum Map
Example: Suppose the data consists of integer numbers of “objects” called |zebra >, |giraf f e > or |other >.
This is classical mutually exclusive (me , alive or dead) type of data: by existing in different spaces, <
zebra|giraf f e >= 0. Sufficiently fine sampling will produce samples which are either 1 or 0. Typical data
is then
|D >= (|zebra >, |other >, |giraf f e >, |zebra >, |giraf f e >,
. . . |zebra >).
The expression only makes sense if these me objects are normalized, < zebra|zebra >= 1, and so on, else the
normalization would conflict with the number of zebras. Expand in the natural basis we started with,
The diagonal form of svd has appeared, up to a normalization. Whenever data consists of disjoint me objects,
one can show those same objects are automatically the svd factors. The fact of strict correlation comes with
projecting onto one object such as |zebra > and producing its sample vector, which is automatically orthogonal
to all the other sample vectors:
Conversely, selecting one of the me sampling histories automatically selects a unique object. These are features
of classical “events.”
To reach the svd form implies samples that are normalized: sα | sβ = δ αβ . Let Nzebra be the total number
of zebras observed. Let Ntot be the total of zebras and giraffes. Remember that we normalized our data. Then
(1, 0, 0, 1, 0, . . . 1) →
p p
Nzebra /Ntot (1, 0, 0, 1, 0, . . . 1)/ Ntot /Nzebra
p
= Nzebra /Ntot |szebra > . (8)
Next suppose there is a unitary transformation of our data on either object of sample or both spaces - but
not mixing them. The result will involve linear combinations of the form α|zebra > +β|giraf f e >, which is
The form ρobject we summed over the sample history (symbol trs ). This identity now defines the me |objectα >=
|eα >. By construction, whenever me data is used, we have a convenient invariant formula for the probability of
finding such an object:
P (|eα > |ρobject ) =< eα |ρobject |eα >= tr(ρobject |eα >< eα |).
The symbol P (|eα > |ρobject ) is read as the probability of |eα > given ρobject , and exactly coincides with counting
numbers: thus
p
P (|zebra > |ρ) = ( Nzebra /Ntot )2 = Nzebra /Ntot .
Notice the right hand side defines probability by frequencies, just as experiments do. In general form the
probability P to get an observable < Â > is
P = tr(ρÂ)/tr(ρ). (9)
There is a sum over all the fields that transform. This is Noether’s Theorem, which finds the total, particular
collective momentum of the field, conjugate to the particular transformation specified, as a basic element of
classical Lagrangian mechanics. Noether’s Theorem is usually developed as a local conservation law ∂µ J µ = 0
with prior assumptions of relativistic Lorentz invariant field theory. The steps we are using coincide while being
slightly more general.
~ x), which existed in electrodynamics long before quantum mechanics.
Consider the classical vector potential A(~
Under a rotation represented by a 3 × 3 matrix R, (RRT = 1), the field rotates by the rule
~ x) → A(~
A(~ ~ x)0 = R · A(R
~ −1 · ~x). (10)
~ 2 /2 − B
L=E ~˙ 2 /2 − (∇
~ 2 = (A) ~ × A)
~ 2 /2. (11)
The canonical momenta πj = Ȧj = −Ej , where E stands for the electric field. This is found in many textbooks.
Noether’s classical theorem predicts two parts for the angular momentum of the electromagnetic field, represented
by vector potential A.~ The two parts come because Eq. 10 has two infinitesimal changes from the rotation of
the polarization (just reviewed) and the related infinitesimal shift of the position, Ai → A0i = Ai − (θ~ · ~x × ∇)A
~ i.
The result for the total angular momentum L ~ is
Z
~ j = d3 x Ai jik Ek + Ei xa abj ∂Ai /∂xb .
(L) (12)
The first term is the spin angular momentum in the gauge A0 = 0. It has the form ~q × ~π where A ~ → ~q and
~π = −E, ~ point by point in x. This term uses no spatial gradients. The angular momentum in the tumbling
polarization variables has a perfectly Newtonian form (point by point) because the kinetic energy is quadratic in
~˙ like Newton’s. The other term involves the operator ~x × ∇,
A, ~ and represents the orbital angular momentum.
The linear momentum operator ∇ ~ comes from classical physics. The orbital angular momentum operator ~x × ∇ ~
comes from classical physics of fields sloshing around in space. Both spin and orbital angular momentum are
basic feature of classical physics.
How does this approach relate to the old quantum tradition? The old tradition makes physical postulates to
explain things that can be derived by modern theory. In Eq. 12 the spin-part is a “sandwich” of some matrix
elements abk between the momentum −Ei and the field Ai . So long as a general change δA ∼ A under the
variable transformation, there will always be one or other matrix in a sandwich. The matrix is also the generator
of the transformation under discussion. For rotations of 3-vectors our calculations have found the generators are
We don’t need to make this a postulate because we’ve just obtained it.
Some will be expecting to see a “correct” commutation relation involving Planck’s constant. Define a symbol
Jk ≡ ~jk . Then
We are not going to make this a postulate because we’ve just obtained it from our definitions. Obviously, ~2
cancels out on both sides of Eq. 15, which does not depend on ~ overall. If one were given Eq. 16 as a inexplicable
postulate, it would naturally be much harder to discover that ~ cancels out.
2.4.1 Discusson
The fact that spin is a derived attribute of classical polarization ought to be better known. What explains the
gaps that keeps it a secret? Lie groups were known for decades before quantum theory, but not generally known
by physicists. In the first years of quantum mechanics physicists misidentified many consequences of mathematics
as physics discoveries. The momenta of the electromagnetic field are also somewhat subtle. The canonical result
disagrees with the expected angular momentum density going like ~x × (E ~ × B).
~ When ~x × (E~ × B)~ is asserted
Symbol Ĥ is the Hamiltonian operator.The canonical momentum πψ (x) = ∂LSE /∂ ψ̇(x) = iψ ∗ (x). (Later we
will see how the complex numbers themselves originate in coordinate conventions.) Let us derive the collective
(total) momentum conjugate to spatial translations. Under a translation of coordinates
~x → ~x + ~a;
ψ(~x) → ψa (~x) = ψ(~x − ~a).
The rate of change with respect to parameters ~a is ∂ψa (~x)|~a=0 = −∂ψ/∂~x. Noether predicts the classical
translational momentum is
Z
∂ψ ~ >.
p~a = d3 x πψ (x)(− ) =< ψ| − i∇|ψ
∂~x
Here is the momentum operator∗ −i∇.~ Once we derive this on our own, it is not helpful to call it an independent
postulate.
Under a rotation by Cartesian angles θ~ a scalar function transforms ψ(~x) → ψθ (~x) = ψ(~x − θ~ × ~x). The
classical angular momentum is
Z
~ ∂ψ ~ >.
L = d3 x πψ (x)( ) =< ψ| − i~x × ∇|ψ
∂ θ~
~ “is postulated to be the angular momentum operator.”
There is nothing to gain by declaring that “−i~x × ∇
~ → ψ+θ× ψ.
A matter wave function transforming like a 3-vector, spin-1, will have additional transformation ψ ~
~ ~ ~
That will lead to an addition angular momentum from the polarization Lspin−1 =< ψ|j|ψ >, where j is given
by Eq. 13 and the inner product sums over the polarization components, just as with the vector field.
Elsewhere5 we have considered these facts using Poisson bracket notation. Any sandwich of the form <
ψ|Q̂|ψ >→ Q, where Q̂ is Hermitian operator, is a map from canonical coordinates πψ , ψ into a number. Poisson
brackets are an efficient way to determine transformation properties of such maps. If the Poisson brackets of
∗
An earlier convention multiplied the Lagrangian by ~. Since it cancels out, there’s no point in doing it, explaining
why ~ is absent.
1 ∂2Ω 1 ∂Ω ∂ 2 Ω
ai = +( 2) .
m ∂qi ∂t m ∂qj ∂qi ∂qj
The right hand side is an exact derivative:
~ q ),
m~a = −∇φ(~ (20)
" #
∂Ω ~ 2
(∇Ω)
where φ = − + . (21)
∂t 2m
Given φ from data will predict Ω from solving Eq. 21 as a partial differential equation:
X 1 ∂Ω 2 ∂Ω
( ) + φ(q) + = 0. (22)
j
2 ∂q j ∂t
~2 /2m + φ(~
Hef f = p q , t).
~=
• Gradient flow is exceptional. When A 6 0 the acceleration is
~a = E q˙ × B,
~ +~ ~ (26)
~
where E ~ − ∂A ;
~ = −∇φ ~ =∇
B ~ × A.
~
∂t
~ and B
Eq. 26 is called the Lorentz force, where E ~ are prescribed electric and magnetic fields, respectively. Evaluating
Eq. 25 as a Hamilton-Jacobi equation, the Hamiltonian coming from Eq. 25 is
X
H= (pi − Ai )2 /2 + φ. (27)
i
It is the generalized Hamiltonian of a charged system on an arbitrary number of dimensions. For 3-vector ~
q the
Hamiltonian is
H = (~ ~ 2 /2 + φ.
p − A) (28)
Such systems are classical but not Newtonian. The momentum conjugate to ~
q from Eq. 28 is
q˙ = ∂H/∂~
~ p;
p
~=~ ˙ ~
q + A. (29)
We are not including a mass parameter. It simply sets the scale of the Hamiltonian, i.e. the units of time.
There is no sum over i. Eq. 31 shows that Hamiltonian systems with 2N q’s and p’s have N conservation
laws, which is one of Poincarè’s theorems. It is extraordinary for a dynamical system to have those conservation
laws, which (one can show) are equivalent to requiring Hamilton’s equations. Yet we see that any flow can be
embedded in the extremely special Hamiltonian systems. Discovering this degree of order hidden in generic flows
is very unexpected.
Note we have not shown that one Hamiltonian function governs all flows, always. The flow of one physics
experiment may lead to a different Hamiltonian than another experiment. If the description happens to be
second order in the time derivatives of q, (or if that approximation suffices), we have found emergent classical
Hamiltonian behavior.
Pause to Assess: Our perspective has shifted again. Recall the quantum Eherenfest relations for < ~x >
(t) =< ψ(t)i|~x|ψ(t) >. When first discovered physicists assumed particles existed and assumed Newton’s laws
in Hamiltonian form. Eherenfest showed a way quantum waves might be compatible. While welcome early, the
arguments lack controlled error estimates and do not pass the quality-control standard of 21st century physics.
Our result suggests a way that the flow of qi (t) might be such that classical Hamiltonian physics cannot-not be
obtained. There are consequences. The parameters of the macroscopic theory do not need to be related to those
of the microscopic theory in any naive way. In another paper6 we have recommended abandoning macroscopic
definitions and measurements of physical constants, in particular “mass,” when determining the constants of
more fundamental quantum physics. Use quantum definitions for quantum theory.
Defining the 2N dimensional multiplet η = (q1 ...qN , p1 ...pN ), Hamilton’s equations are
∂H
η̇i = Jij . (33)
∂ηj
Calculation gives
Ψ = Uη; UU † = 1.
Then
i 1N ×N 0
UJU † = − .
0 −i 1N ×N .
∂Ψ ∂H(Ψ, Ψ∗ )
i = . (35)
∂t ∂Ψ∗
Since it is an important point we show the algebra for one degree of freedom and its conjugate momentum. We
are given
∂H ∂H
q̇ = ; ṗ = − .
∂p ∂q
Combine two real numbers into one complex one:
√
ψ = (q + ip)/ 2. (36)
Continuing: When H(q, p) is bilinear then H(Ψ, Ψ∗ ) is bilinear. Quantum mechanics always uses such Hamil-
tonian functions or models. It is not always recognized, due to language developed for Hamiltonian operators.
The bilinear form is simply parameterized by certain operators matrix elements. The general form is
H(Ψ, Ψ∗ ) = Ψ∗ · Ω̂ · Ψ. (38)
Here Ω̂ is the coordinate-free notation for the operator, more commonly designated a symbol Ĥ. Eq. 35 and 38
give
∂Ψ
i = Ω̂ · Ψ. (39)
∂t
This is Schrödinger’s equation Ĥ|ψ >= i|ψ˙ >, which is nothing more than Hamilton’s equation in complex
notation. We mix the symbols deliberately, while we prefer symbol Ω̂ to Ĥ. In the form above Ω̂ is called the
frequency operator. Its eigenvalues are frequencies. The eigenvalues equation is
Ω̂ · ψn = ωn ψn .
The solutions ψn are known as normal modes. The expansion in normal modes solves the dynamics:
X
ψ(t) = ψn e−iωn t . (40)
n
In our approach this does not come from any new principles: None are needed.
3.1.1 Linear Theories
Linear equations of motion are generated by Hamiltonians that are bilinear in qi , pi :
1
H(q, p) = η T Hη η;
2
1 hqq hqp
Hη = (41)
2 hTqp hpp
Matrix multiplication is implied, and hqq , hqp ...etc are N × N arrays of constant parameters. Any linear terms
like αq + βp have already been removed by translating coordinates. We have no commitment to the bilinear
form, which is cited to reproduce what is familiar. It is not our responsibility to defend the model.
More familiar matrix notation is§
• Unitarity: Eq. 40 is the solution to time evolution. In coordinate-free notation it is ψ(t) = e−iΩ̂t ·ψ(0). The
textbook expression writes e−iΩ̂t = e−iĤt/~ , where Ĥ = ~Ω, and ~ cancels out. Unitarity of time evolution
is automatic when Ω̂ has real eigenvalues. Otherwise a more general real dynamical system will have
eigenvalues which are complex conjugate pairs. Hermiticity of the Hamiltonian is equivalent to choosing
models that do not have exponentially growing and decreasing oscillations. This seems to be good judgment
more than a principle. As noticed in Ref.15 , it is better to classify Hermitian systems by their eigenvalues
than by the self-adjoint matrix rule Ĥ = Ĥ † . If the self-adjoint rule is satisfied, then Hermeticity follows,
but if general coordinate transformations are applied to a Hermitian operator, the self-adjoint property can
easily fail. One of the main reasons for insisting that quantum coordinate transformations be unitary is to
maintain the notation of Eq. 39 form-unchanged. Now that we realize complex notation is optional, that is
not compelling. When more general symplectic transformations are applied, Hamilton’s equations are form-
unchanged, showing that the full symmetries of quantum dynamics are Sp(2N ). Unitary transformations
are also the largest group maintaining the values of quantum probability: this is compelling.
• “Non-Linear Operators” : There is confusion about quantum Hamiltonians, which tends to draw questions
whether the step ∂H/∂ψ ∗ → Ω̂ψ imposes some kind of restriction on our part. The step is as general as
quantum dynamics. That is because conventional quantum dynamics uses a linear model. It is not our
burden of proof here to justify the model, or explain why it might work. Our dynamical formalism has the
generality to explore genuinely non-linear quantum dynamics, if desired.
Some physicists will cite quantum Hamiltonians as being “non-linear.” A common misunderstanding says
that “only quantum harmonic oscillators have quadratic Hamiltonians. The interesting systems have non-
linear Hamiltonians.” Mixups come from different uses of the word “Hamiltonian.” In physics and in
our usage H(η) → H(Ψ, Ψ∗ ) is that function on the phase space variables η by which η̇ = ∂H/∂η. To
repeat, H(ψ, ψ ∗ ) =< ψ|Ĥ|ψ > is a number with a classical dynamical meaning. In the other usage, Ĥ
refers to the operator, namely a matrix of parameters, used to compute the number. In wave theories the
matrix is infinite dimensional, and conventionally built out of powers of −i∇~ and ~x. We are not concerned
with guessing the Hamiltonian’s parameters. Our results are the same whether or not the operator Ĥ
is a complicated function of other operators. No matter how many operators are piled together in the
formula for Ĥ, it is still a linear operator acting in the linear differential equations iψ̇ = Ĥψ. (And
this remains true in relativistic quantum field theory. A Schrödinger picture exists, satisfying the linear
Hamilton-Schrödinger Eq. 39.)
• Hamiltonian Prediction Recipes: The historical recipes to “predict” a system Hamiltonians are quaint, but
irrelevant. Physics has evolved to ignore the classical limit and select Hamiltonian parameters by fitting
data. For some reason this is kept secret. It is also irrelevant that the Heisenberg equations of motion
appear very challenging when operators are composed into non-linear combinations of operators. The linear
system’s dynamics is trivial in the mathematical sense, solved by Eq. 40.
• Counting Degrees of Freedom: Confusion exists in counting the number of dynamical degrees of freedom,
dof . We count each generalized coordinate as one dof . The dimension of ηi labels (twice the number)
of dof . Degrees of freedom are real numbers, put into pairs to make complex numbers by an act of
notation. The number of dof depends on the system. The possibility to describe an arbitrary number of
dof always existed in Hamiltonian physics, but only became important with quantum Hamiltonian physics.
The dynamical discovery of the complex Schrödinger notation is good, but not breakthrough. However the
discovery that electrons are waves, requiring infinitely many dof for their description, is a breakthrough
model that violates every conception of pre-quantum physics.
Unfortunately there is a different quantum usage that identifies operators in the Heisenberg picture as
dynamical “operator degrees of freedom”. That is a disabling choice of words. In that usage three infinite-
dimensional operators ~x would be called “one quantum particle.” In that usage the word “particle” is
abused, and the word “one” means three sets of continuous infinity. We suggest not using those words.
4. CONSEQUENCES OF SYMMETRY
So far we have left the details of models open. Symmetries can restrict models enough so there is a position that
little but the consequences of symmetries has been discovered so far in physics.
Let D(~x, t) be a list of data measuring “something about the photons” in an experiment. Perhaps we have a
number of hits in a particle detector. Perhaps we have a sequence of field amplitudes measured in a radio beam.
We choose not to be more specific, and treat the data as very general.
Let e(~x) be a time-independent “space pattern” occurring in the data. We cannot know the data in advance,
and must find the pattern from the data. By definition the pattern is normalized: we treat the normalization of
the data separately. The overlap at time t, < e|d(t) >, measures how well the pattern represents the data. We
define an optimal pattern as having the maximum time-averaged overlap-squared:
Z
dt | < e|d(t) > |2 → max.
By the Rayleigh-Ritz variational theorem, Eq. 42 is extremized at the eigenvectors of the matrix Cxx0 :
Cxx0 eα
x0 = λ
(α) α
ex .
The optimal patterns are automatically orthogonal. In its diagonal frame C is written
X
C= |eα > λ(α) < eα |, (43)
α
Since the basis guarantees the maximal-squared projections for each state α, truncating the expansion at any
given number of terms α = 1..p will give the best possible p− dimensional approximation. Ref.16 seems to be
the origin of these facts.
Similarly, let f (t) be a space-independent “time pattern” occurring in the data. Define the optimal time
pattern to have the maximum overlap-squared, averaged over space. Repeating the argument above gives
C̃tt0 ftα0 = λ̃(α) ftα ;
Z
C̃tt0 = d3 x Dxt Dx∗0 t .
The expansion coefficients Dαβ =< eα | < f β |D >= δ αβ (λα )2 , thus Λα = (λα )2 . Remarkably, the joint ex-
pansion is diagonal, and the correlation coefficients λ(α) = λ̃(α) . The joint expansion is just the singular value
decomposition. The sum over α can only range over the dimension of the smaller space, here the number of
points on the time axis.
Notice that Cxx0 is a standard spatial correlation obtained from the data. C̃tt0 is a standard time correlation.
This is very general, and so far we have used no physical information. Information comes from a model.
Translational symmetry of correlations is a fine model. Translations (T ) are described by
~x → ~xT = ~x + ~x0 ;
~x0 → ~x0T = ~x0 + ~x0 ;
t → tT = t + t0 ;
t0 → t0T = t0 + t0 . (44)
Symmetry under Eq. 44 specifies four relations. Then C and C̃ depends only on differences:
Z
~ 0
Cxx0 = C(~x − ~x0 ) = d3 k eik·(~x−~x ) C(~k)
Z
0
C̃tt = C̃(t − t ) = dω e−iω(t−t ) C̃(ω)
0
0
(45)
We reverted to function notation, and used the same letters C for the Fourier transforms as the correlation,
because the arguments ~k, ω are sufficient to label them. Each of the Fourier transforms happen to be in diagonal
form (Eq. 43):
X
C̃(t − t0 ) = < t|ω > C̃(ω) < ω|t0 >;
ω
X
C̃ = |ω > C̃(ω) < ω|.
ω
This result is remarkable. It has much more information than a generic expansion in Fourier modes. The double
Fourier expansion is doubly-optimal, and controlled by one (1) set of singular values, whose dimension cannot
exceed the dimension of the smaller space. The smaller space here is labeled by ω, representing one infinity. The
larger space is labeled by ~k, representing three infinities. The matched singular values imply a dispersion relation
ω = ω(~k) generated by the diagonal character of the sum¶ . (Otherwise, D → D(~k, ω) would be a function of
four variables.) We emphasize that no physical assumptions – other than translational symmetry – has been
put in. Yet when we seek to reproduce physical correlations, we be led to a “wave equation” ωD = ω(~k)D to
reproduce the data.
Suppose data correlations are rotationally invariant. That is, the correlations may depend on angles, but
not on the angular origin of coordinates. Let n̂, n̂0 be unit vectors on the sphere. Rotational symmetry implies
The eigenvalues λ̃α (ω) = λα (~k). By the implicit function theorem and with mild assumptions of differentiability,
¶
one set of variables ω = ω(~k) can be eliminated as a local function in some domain. This is also written ~k = ~k(ω), a
2-dimensional surface in the space of ~k.
Here θ, φ are the angular coordinates of n̂, with similar notation for n̂0 . The correlation has been factored into
diagonal form, showing the spherical harmonics are the optimal basis for angular correlations. Suppose the time
correlations have no preferred origin. Repeating the singular value decomposition for data that depends on polar
coordinates gives
X
D(θ, φ, ω) = f`m (ω`m )Y`m (θ, φ);
`m
f`m (ω) = δ(ω − ω`m )f`m (ω)
These expressions are “trying to look like” quantum mechanics. The dispersion relation and wave equation
emerges whether or not there is an underlying “wave character” producing the data.
4.0.3 Numerical Experiment One
As an experiment we took a mundane 48 × 54 matrix M sampled at 8-bit accuracy. We cyclically permuted the
rows (label x) 48 times, and added (M · M T )xx0 from each permutation. We cyclically permuted the columns
(label t) 54 times, adding (M T ·M )tt0 each time. The sums give two correlations, Cxx0 and Ctt00 . As predicted the
eigenvectors are pure Fourier modes, degenerate under k → −k, ω → −ω (Figure 1). The optimal expansion of
the total data is a joint Fourier expansion in discrete Fourier series eikx−iωt , where ω = ω(k) is a 1-1 relation on
the smaller space of dimension 48. This dispersion relation is shown in Figure 2. The relation is approximately
ω ∼ k, mainly because low Fourier modes tend to coincide and dominate, but differs somewhat because essential
information is encoded by svd in the singular values. One might say the result is something like a photon
dispersion relation.
The interpretation of free-space dispersion relations has evolved greatly. When Einstein propose E 2 =
p~ c + m2 c4 it was bold and heuristic. We now believe the dispersion relation ω 2 = ~k 2 c2 + µ2 is an immediate
2 2
One cannot learn much from the single-number summary S. However it is a measure that is unique in being
extensive, additive for non-interactive subsystems, etc. as Von Neumann17 showed. From its definition 0 ≤
S ≤ log(N ) on an N -dimensional complex (2N dimensional real) system. The maximum is reached when
ρ = 1N ×N /N , the unit matrix, which has no preferred subspaces. The minimum is reached when ρ = |ψ >< ψ|,
namely when ρ is rank-1. Then (as we mentioned) description by a wave function happens to be consistent.
None of this procedure assumes probability defined by distributions (informally) or defined by Kolmogorov-
style axioms (very formally). Instead we use our method as a generalization of probability that can be applied to
30
ω 25
20
15
10
k
0 5 10 15 20
any system, regardless of its origin. We propose that physicists associate “order” and “simplicity” with relatively
low entropy. This habit, which actually originates in the physics of classical probability, carries straight over to
un-Quantum systems. A numerical experiment provides an illustration.
4
S
3
0
0 20 40 60 80 100 120
N
Figure 3. The bottom curve shows the quantum entropy S of the data used in Section 4 divided on dimension N as a
function of N . The entropy is considerably smaller than the maximum possible entropy (dashed line) and the entropy of
a matrix of random numbers (middle curve). Dips occur in the entropy at divisions which are especially orderly. the first
dip is indicated by the arrow at N = 54.
0.8
S 0.6
0.4
0.2
0.0
0 20 40 60 80 100 120
N
Figure 4. Dips in the entropy versus dimension N of Figure 3 on a smaller scale. The dips occur at N =54, 108,... which
identifies particularly orderly representation of the data. The first dip is indicated by an arrow.
6. OUTLOOK
Our view of the topic known as “quantum theory” has evolved to draw a sharp distinction between successful
physical models and claims of a profound framework. The first breakthrough was discovering the electron and
photon have infinite dimensional phase spaces. Since then, successful models come from painstaking experimen-
tation and meticulous theoretical consistency checks, rather than a predictive framework. We do not find the
framework of linear algebra, transformation theory, and quantum probabilities customized to mesh with it to
have much physics in it. However the methodology of quantum probability for data representation and analysis is
a breakthrough compared to the older definitions of probability based on mutually exclusive equivalence classes.
As Feynman must have said, sometimes it is a new breakthrough to use an old breakthrough on a new class
of problems. We mentioned in Section 1 there are no reasons to restrict un-Quantum methods to micro-physical
objects. We have been acting on this opportunity for some time. Several examples show that the methods are
useful and powerful:
• The radio frequency emissions of relativistic protons were used to construct density matrices in Ref.18 By
distinguishing signal-based and noised-based density matrices, the signal to noise ratio was improved by a
factor of more than 100, producing the first detection of virtual Cherenkov radiation from protons.
• In Refs.19 observational data from the cosmic microwave background was analyzed to test the “cosmological
principle” based on isotropy. The alignment of spherical harmonic multipoles and the entropy of their power
distribution contradicts isotropy at a high degree of statistical significance. The observations cannot be
explained by galactic foreground subtractions.20
• In Ref.21 density matrices were constructed from high-dimensional spectroscopic data of a pharmaceutical
protein. The principal values were sorted to make projections onto certain subspaces from which the phases
of the protein could be determined by inspection. Ref.22 reviews subsequent progress. The method has
been used to make empirical phase diagrams towards characterizing the active states, phase transitions
and shelf-life of about 100 pharmaceutical compounds and vaccines
REFERENCES
[1] There are too many references to cite. A good introduction is the book by S. L. Adler, Quantum theory
as an emergent phenomenon: The statistical mechanics of matrix models as the precursor of quantum field
theory, Cambridge, UK: Univ. Pr. (2004) 225 p. See also G. ’t Hooft, “Emergent Quantum Mechanics and
Emergent Symmetries,” AIP Conf. Proc. 957, 154 (2007) [arXiv:0707.4568 [hep-th]]
[2] An extensive blbliography with wide discussion is given by the Archiv preprint of B. Hu, Emergence: Key
Physical Issues for Deeper Philosphical Enquiries, J. Phys. Conf. Ser. 361 (2012) 012003, arXiv:1204.1077
[physics.hist-ph]. See also H. -T. Elze, “Does quantum mechanics tell an atomistic spacetime?,” J. Phys.
Conf. Ser. 174, 012009 (2009) [arXiv:0906.1101 [quant-ph]].; “Deterministic models of quantum fields,” J.
Phys. Conf. Ser. 33, 399 (2006) [gr-qc/0512016]; “Symmetry aspects in emergent quantum mechanics,” J.
Phys. Conf. Ser. 171, 012034 (2009); M. Blasone, P. Jizba and F. Scardigli, “Can quantum mechanics be an
emergent phenomenon?,” J. Phys. Conf. Ser. 174, 012034 (2009) [arXiv:0901.3907 [quant-ph]]; G. ’t Hooft,
“Classical cellular automata and quantum field theory,” Int. J. Mod. Phys. A 25, 4385 (2010).
[3] Klein, O. and Nishina, Y. ”ber die Streuung von Strahlung durch freie Elektronen nach der neuen relativis-
tischen Quantendynamik von Dirac”. Z. Phys. 52 (11-12): 853; ibid 869, (1929).
[4] Lamb, W., and Scully, M. ”The photoelectric effect without photons,” in [Polarization, Matire et Rayon-
nement,] Volume in Honour of A. Kastler (Presses Universitaires de France, Paris, 1969)
[5] Ralston, J. P., “Embedding P T Quantum Mechanics in Symplectic Quantum Mechanics,” J. Phys. A: Math.
Theor. 40, 9883 (2007).
[6] Ralston, J. P., “Quantum Mechanics without Planck’s Constant,” arXiv:1203.5557 [hep-ph].
[7] Ralston, J. P., “Emergent un-Quantum Mechanics,” in Advances in Quantum Mechanics, edited by Paul
Bracken, (2013), ISBN 978-953-51-1089-7.
[8] A typical text is Kaku, M., [Quantum Field Theory: A Modern Introduction], (Oxford University Press,
1993).
[9] Dirac, P.A.M., [The Principles of Quantum Mechanics], (Cambridge University Press, 1967).
[10] Feynman, R.P., [The Feynman Lectures on Physics], Vol.III (Addison Wesley, 1964); Sakurai, J.J., [Modern
Quantum Mechanics], (Addison Wesley, 1998).
[11] d’ Espangat, B. [Conceptual Foundations of Quantum Mechanics], (2nd ed. Addison Wesley, 1979).
[12] Dewdney, C., Holland, P.R., Kyprianidis, A., “What happens in a spin measurement?,” Phys. Lett. A119,
259 (1986).
[13] Bell, J. S. ”On the Einstein Podolsky Rosen paradox”, Physics 1,195,( 1964). See also [Speakable and
Unspeakable in Quantum Mechanics], Cambridge Univ. Press (1987).
[14] Werner, R. S. “Quantum states with Einstein-Podolsky-Rosen correlations admitting a hidden-variable
model,” Phys. Rev. A 40, 4277, (1989); Peres, A.“Separability Criterion for Density Matrices,” Phys. Rev.
Lett. 77, 1413 (1996).
[15] Bender, C. M., and Boettcher, S. “Real Spectra in Non-Hermitian Hamiltonians Having PT Symmetry,”
Phys. Rev. Lett. 80, 5243 (1998) [arXiv:physics/9712001]; Bender, C. M., Boettcher, S. and Meisinger, P.
“PT-Symmetric Quantum Mechanics,” J. Math. Phys. 40, 2201 (1999) [arXiv:quant-ph/9809072].
[16] Karhunen, H. Ann. Acad. Science. Fenn, Ser A. I. 37, (1947); Loeve, M. supplement to P. Levy, P. [Processes
Stochastic et Mouvement Brownien], Paris, Gauthier Villars, (1948); Hotelling, H. J. Educ. Psychology 24,
417, (1933); ibid 24, 448, (1933).
[17] Von Neumann, J., [Mathematische Grundlagen der Quantenmechanik] Springer, Berlin; English translation
in [The Mathematical Foundations of Quantum Mechanics], (Princeton University Press, Princeton, 1971).
[18] Bean, A., Ralston, J. P. and Snow, J. “Evidence for Observation of Virtual Radio Cherenkov Fields,” Nucl.
Instrum. Meth. A 596, 172 (2008) [arXiv:1008.0029 [physics.ins-det]].