Quantum mechanics of 4-derivative theories.

A renormalizable theory of gravity is obtained if the dimension-less 4-derivative kinetic term of the graviton, which classically suffers from negative unbounded energy, admits a sensible quantization. We find that a 4-derivative degree of freedom involves a canonical coordinate with unusual time-inversion parity, and that a correspondingly unusual representation must be employed for the relative quantum operator. The resulting theory has positive energy eigenvalues, normalizable wavefunctions, unitary evolution in a negative-norm configuration space. We present a formalism for quantum mechanics with a generic norm.

Introduction

Newton invented classical mechanics putting two time derivatives in his equation , which corresponds to a kinetic energy with two time derivatives, . Later Ostrogradski proved a no-go theorem: non-degenerate classical systems with more than two time derivatives contain arbitrarily negative energies and develop fatal run-away instabilities [1]. Classically, they do not make sense.

The discovery that nature is relativistic and quantum opened the quest for an extension of Newtonian gravity. A century ago Einstein and Hilbert found the classical theory of relativistic gravity. However, its quantum version is not renormalizable in 3+1 space-time dimensions. Sticking to the observed number of space-time dimensions, a renormalizable extension of general relativity is found by adding terms quadratic in the curvature tensor to the Einstein–Hilbert Lagrangian, such that the graviton acquires a 4-derivative kinetic term. Stelle proposed and dismissed this extension [2] (see also [3-13]).

Recently the Higgs mass hierarchy problem brought interest to dimension-less theories. In this context, gravitons must have dimension 0 (being a dimension-less metric) and thereby must have a 4-derivative kinetic term. If these theories could make sense at the quantum level, despite the negative classical energy, a great deal would be gained: relativistic quantum gravity, plus hierarchies among dynamically generated mass scales [12], plus inflation [14, 15].

Quantization can eliminate arbitrarily negative classical energies. The following example is well known: the classical relativistic spin 1/2 field is described by a spinor with Dirac Lagrangian containing one time derivative. Treating as a classical field (as initially proposed by Schrödinger), and inserting the plane-wave expansionin the Hamiltonian one finds negative energies in half of the configurations space:1 This classical arbitrarily negative energy is avoided by quantization with anti-commutators, if the vacuum state is appropriately chosen. Indeed, the two-state solution to shows that one can switch annihilation with creation operators by choosing the vacuum to be the state with lower energy.

The spin 0 and spin 1 relativistic fields (described by dimension-1 fields with two derivatives) do not have this issue: the negative-frequency solutions to the Klein–Gordon equation correspond to Hamiltonians with positive energy.

The general lesson is that quantization depends on the number of time derivatives.

The goal of this study is describing if/how systems with four derivatives can be quantized obtaining a consistent theory, in particular of quantum gravity. We will find that a unique structure emerges, which again involves switching annihilation and creation operators.

This will bring us into the territory of negative-norm quanta, avoided like a plague by serious theorists that call them ‘ghosts’, and explored only by notorious crackpots such as Dirac [18], Pauli [19], Heisenberg [20], Pais, Uhlenbeck [21], Lee, Wick [22, 23], Cutkosky [24], Coleman [25], Feynman [26], Gross [27], Hawking [28, 29], ’t Hooft [30, 31] and others, also more recently [32-52]. These works sometimes contain bizarre and confusing statements and obsolete motivations, together with interesting ideas and ad hoc prescriptions.

This paper is structured as follows. In Sect. 2 we review the canonical Ostrogradski formalism. In Sect. 3 we present negative-norm quantum mechanics, the negative-norm harmonic oscillator (Sect. 3.3), and the associated negative-norm representation of a canonical coordinate (Sect. 3.4), with unusual parity under time-inversion T. In Sect. 4 we recall that a 4-derivative degree of freedom q(t) is described by two canonical coordinates: and . While is T-even as usual, is T-odd: we argue that thereby it naturally follows the negative-norm representation. The resulting quantum theory is unitary: time evolution preserves the negative norm. The path integral formulation is discussed in Sect. 5. In Sect. 6 we discuss the interacting theory, outline the extension to quantum field theory, and discuss the issue of giving a sensible interpretation to negative norms, via a postulate that generalizes the Born rule. Conclusions are given in Sect. 7.

The Ostrogradski classical canonical formalism

Let us now introduce the main issues in the simplest relevant case. Our final goal will be 4-derivative gravity; however, the graviton components can be Fourier expanded into modes with given momentum and four time derivatives, and at leading order in the perturbative expansion one has decoupled harmonic oscillators. So, we start considering a single mode q(t), described by the Lagrangianwhere V(q) is some interaction. We assume real , , because we are interested in ghosts (negative kinetic and potential energy), not in tachyonic instabilities (potential unstable with respect to the kinetic term). The sign means that the ghost is the state with larger ; we choose and do not explicitly discuss here the degenerate case .

Ostrogradski introduced an auxiliary coordinate that allows one to describe the 4-derivative oscillator in canonical Hamiltonian form (see also ref. [21] for a review of this method):where for a generic variable x we have introduced the variational derivativeWhile Ostrogradski assumed , we introduced an arbitrary constant . The system in Eq. (3) can be solved for q and its time derivatives,and the Hamiltonian turns out to beIn view of its first term, the classical Hamiltonian H has no minimal energy configuration: this is the essence of the Ostrogradski no-go classical theorem. Using the Poisson parentheses one computes the Hamiltonian equations of motion:For any they imply the classical Lagrangian equation of motion. Setting , it isThe corresponding classical solution, for given initial conditions at , isThis is a well-behaved oscillator without run-away issues because the positive-energy and negative-energy components are decoupled. Run-away solutions appear when they interact through a generic interaction, such as a .

Quantizing the Ostrogradski Hamiltonian

The classical equation differs from the usual 2-derivative equation , so that, trying to quantize the theory, we do not define the usual annihilation operator . Rather, it is convenient to define the operators as the coefficients of a given frequency:The can be expressed in terms of canonical Hamiltonian coordinates: Using the canonical quantization one finds the commutation relations for the :

having normalized and . The Hamiltonian isThe state 1 with higher frequency is a ghost.

As better discussed later in Sect. 3.3, this system can be quantized in two different ways:If the situation is bad, as emphasized by [16, 17]: the positive-norm quantization gives a normalizable wavefunction but negative energies; the negative-norm quantization gives a ground-state wavefunction not normalizable in . Excited states have the same problem.

Positive norm, negative energy One redefines , such that it has the usual commutation . The vacuum state is defined as usual by and . By solving this condition as a differential equation for with one obtains the ground-state wavefunction:

Negative norm, positive energy The vacuum is now defined as and . Using one obtains the ground-state wavefunction

However, as we will show in Sect. 4, consistency requires the negative-norm Dirac–Pauli representation of a canonical coordinate which roughly amounts to choosing an imaginary , e.g. . One then obtains positive energy, negative norm, and a wavefunction normalizable in and . As we will now discuss, despite the strange i factor, as well as the Ostrogradski Hamiltonian is self-adjoint, so that time evolution is unitary.

Quantum mechanics with negative norm

We here discuss quantum mechanics with negative norm from a general point of view. Negative-norm states require putting some minus sign here and there. It is convenient to be more general and consider a Hilbert-like space with generic, possibly negative, constant norm (called Krein space by mathematicians) and develop a basis-independent formalism. This will let us to clarify confusions, in particular about self-adjoint operators that are represented (in some basis) by non-hermitian matrices, allowing us to understand the unusual imaginary introduced in the previous section.

We follow the notations used in general relativity, rewriting the quantum-state metric as and defining the inverse metric , the contravariant ket such that and . Summations over repeated indices are implicit. As usual, bras denote complex conjugate of kets.

A generic state can be expanded in either the ‘covariant’ or the ‘contravariant’ basis:ThenA generic linear operator A can be written as a matrix in 4 different ways:ThenThe components of the matrices are related by , which is an iso-spectral transformation: the eigenvalues do not change because the matrix A gets left-multiplied by and right-multiplied by its inverse.

The unity operator is represented by and and expanded asOperator multiplication becomes, in components, . Expectation values are given by .

The adjoint of an operator A is defined, as usual, as the operator such that implies . Thereby for generic matrix elements one has , and the relation for the componentsThe covariant components of a self-adjoint operator A satisfy the usual condition: a self-adjoint operator is described by a hermitian matrix, . The same result holds for the contravariant matrix . The mixed components satisfy a different condition, where complex conjugation is supplemented by an iso-spectral transformation: .2

A self-adjoint operator, has real expectation values , although the matrix that represents it can be anti-hermitian.

The mixed components directly enter into the eigenvector equation :where is the eigenvalue. Let us now consider a self-adjoint operator H (later it will be the Hamiltonian), with eigenstates and eigenvalues . The identitytells that H can have three different kinds of eigenstates:In the classical analog, the latter possibility corresponds to a ghost which is also a tachyon, which is a different kind of instability, to be avoided even in absence of ghosts.

) orthogonal eigenstates with real and norm ;

) orthogonal eigenstates with real and norm ;

0) pairs of complex conjugated eigenvalues, with and zero norm, .

It is often convenient to choose a basis of eigenstates of H: . The associated contravariant states then satisfy . In this basis the space splits into two sectors: positive norm and negative norm, plus the possible pairs of zero-norm states. The two sectors experience a joint dynamics only if the initial state has a quantum entanglement among them.

Unitary time evolution

The evolution equation becomesThe norm of any state is conserved by time evolution if H is self-adjoint:A self-adjoint Hamiltonian H leads to unitary time evolution. The explicit solution can be written as with , where T is the usual time-ordering. In components,Having written generic-metric quantum mechanics in an abstract formalism that resembles as much as possible the usual positive-norm formalism, let us now emphasize the key differences. For simplicity, let us consider a time-independent H. One can then expand .Practical computations often employ perturbation theory, which can now easily be generalized to generic norm. Decomposing , the interaction picture is related to the Schrödinger picture as where A is any operator (including V). Time evolution is given byThe above explicit form of shows that the energy conserved by quantum evolution (up to the usual quantum uncertainty ) are the eigenvalues of H. Let us consider for example a time-independent interaction V and an initial state and a final state which are energy eigenstates with eigenvalues and . Defining , at first order one hasThis means that energy conservation reads , up to the usual quantum uncertainty . Higher order corrections give the usual sum over intermediate quasi-on-shell states.

Writing U in mixed components, is the naive exponentiation of the matrix . However, the mixed components of a self-adjoint H do not form a hermitian matrix. Rather, the self-adjoint condition in Eq. (22) dictates that they are hermitian up to an iso-spectral transformation.

The covariant components of a self-adjoint H satisfy the usual Hermiticity . However, the covariant components are not given by the naive matrix exponentiation of . Rather, extra metric factors appear to covariantize the expansion: Correspondingly, the unitarity condition written in covariant components is , while in mixed components one gets the usual .

Example: the indefinite-norm two-state system

Let us consider a two-state system: with positive unit norm, and with negative unit norm. Without loss of generality, by redefining the relative phase of the two states and adding a constant overall energy, one can trivially write the most generic self-adjoint Hamiltonian ashaving used . We see that the components are hermitian, unlike the components. The eigenvalues of H are with . The corresponding eigenstates arewhere is a ‘boost factor’ that substitutes the usual mixing angle.This runaway happens whenever H has a pair of complex eigenvalues , as clear writing time evolution in terms of energy eigenstates, . Both the norm of and the real expectation value of H are preserved by time evolution:

If the eigenvalues of H are real, the orthogonal eigenvectors satisfy , and tend to get closer to the ‘light-cone’ of zero-norm states as increases. The components of oscillate in time: The unusual feature is that oscillates between 1 and .

In the critical case, , such that , the two eigenstates become degenerate with energy . The two eigenvectors also become degenerate, and parallel to the zero-norm state . The evolution operator is This exemplifies a more general result: zero-norm eigenstates with complex eigenvalues appear when, increasing the interaction, a level crossing between a positive-norm and a negative-norm eigenstate takes place; the Hamiltonian becomes degenerate at the critical transition.

If the interaction is strong enough, , one has a pair of complex conjugated eigenvalues, with zero-norm eigenvectors that satisfy and describe tachyonic ghosts: their time-evolution factor also contains a real exponential, in analogy to tachyonic states present in positive-norm theories. In the extreme limit the eigenvalues of H are , and the time evolution operator is

The negative-norm harmonic oscillator

We here study the concrete system that lies at the basis of perturbative Quantum Field Theory: the harmonic oscillator. As discussed by Lee and Wick [22, 23] it admits two inequivalent quantizations: positive norm, and indefinite norm.

Let us first recall the standard oscillator, described (up to irrelevant constants) by the Hamiltonian with . Definingone has and .

Let us next consider a more general system described by the following Hamiltonian and commutation relations:For this reduces to the usual oscillator. We now show that defines another consistent positive-energy theory. The symbol here indicates the adjoint of a, which generalizes the Hermitian conjugate to negative norm.

We again define the vacuum as and the excited states as . Its inverse is . The state metric is . The norm is determined by the dynamics, and odd states have negative norm for . The inverse metric is and the contravariant states are . In components one has In components the commutation relations readand the Hamiltonian iswhere are the Hamiltonian eigenvalues, . We see that positive-energy eigenvalues are obtained for (the usual case with positive H and positive norm), but also for (negative H and negative norm).

Concerning the negative-norm case, , notice that the harmonic oscillator does not predict tachyonic ghosts with zero norm. Furthermore the matrix elements are not the hermitian conjugates of , such that the operators and are represented by matrices and which are not Hermitian. This is why various authors who look at these matrices improperly speak of ‘anti-Hermitian’ operators. Nevertheless, q and p are self-adjoint operators. We will now find their coordinate representation.

The negative-norm coordinate representation

Starting from the harmonic oscillator, we now describe a more general representation of a pair of canonical coordinate variables q, p. Parity flips and . In the harmonic oscillator case, this means and : so eigenstates with even (odd) n are even (odd) under parity. In the negative-norm quantization, states with odd n also have negative norm. Going to the coordinate wavefunction representation (we use the notation x for the coordinate, which later will become field space), this means that the norm isThe corresponding unit operator is . Switching to the formalism appropriate for generic norm, one has the norm . Thereby the contravariant state is and it satisfies the usual . As already discussed in the text surrounding Eq. (17), a state can be expanded as with and .

What is emerging from the harmonic oscillator computation is a more general structure: a coordinate space representation of a pair q, p of conjugated canonical variables that differs from the usual positive-norm representationwhich implies so that it satisfies .

The negative-norm coordinate representation, originally discussed by Dirac [18] and Pauli [19], isAlthough q looks anti-hermitian, taking into account the extra i as well as the negative norm, these unusual features combine to form a self-adjoint q:This means that is real. A similar result holds for p. When acting on wavefunctions one has and , giving the desired commutator. Defining momentum eigenstates as one finds , . The operator q acts as . One can again define such that .

The i factor that differentiates the usual representation from the Dirac–Pauli representation has an impact on the time-inversion parity. As usual, a positive-energy spectrum requires that the time inversion symmetry is anti-unitary. Then, in the Dirac–Pauli quantization q is naturally T-odd and p is naturally T-even (while the opposite holds in the usual quantization, unless T is defined adding ad hoc extra signs). This will play a key role in Sect. 4.

We are now ready to come back to the harmonic oscillator. Inserting into the condition the standard positive-norm representation such that gives a differential equation which implies the ground-state wavefunction . This is normalizable for (positive norm) and non-normalizable for , where s was defined in Eq. (38). This problem was emphasized e.g. by Woodard [16, 17] who thereby dismissed the negative-norm quantization as purely formal. However, the problem arises because the positive-norm representation of q, p was used together with the negative-norm oscillator: the problem is just a manifestation of the inconsistency of the assumptions. Consistency requires that the negative-norm harmonic oscillator must be accompanied by the negative-norm Dirac–Pauli coordinate space representation of the self-adjoint q, p operators, Eq. (45). Then the condition leads to a normalizable wavefunction for the ground state , as well as for the excited states. The Dirac–Pauli choice thereby provides a self-consistent description of the negative-norm oscillator. Furthermore, as discussed in the next section, in the 4-derivative case the Dirac–Pauli representation is required by simple considerations.

For four derivatives Dirac–Pauli is desirable

As discussed in the previous section, and as summarized in Table 1, quantum mechanics has two faces: a canonical coordinate can be representedAs we now show, for theories with four derivatives the latter quantization choice (which, in the gravitational case, corresponds to a renormalizable theory with positive energy) is desirable.

Table 1

Coordinate representations of a pair of canonical variables , and the associated ground-state wavefunctions for the positive-energy harmonic oscillator

Norm	⟨x|q|ψ⟩	T-parity	⟨x|p|ψ⟩	T-parity	Harmonic oscillator with E>0
Positive	xψ(x)	Even	-idψ/dx	Odd	ψ_0(q)∝e^-q^2/2 and H=+12(q^2+p^2)
Indefinite	-ixψ(x)	Odd	dψ/dx	Even	ψ_0(q)∝e^-q^2/2 and H=-12(q^2+p^2)

in the usual way with positive norm;

in the Dirac–Pauli way, with negative norm, Eq. (45).

A single 4-derivative real coordinate q(t) contains two degrees of freedom. In the Ostrogradski procedure (Sect. 2) one rewrites the theory as a Hamiltonian system of two canonical coordinates, and . The key new feature that arises in 4-derivative theories is that becomes an extra canonical coordinate. In the classical theory is just an auxiliary variable, and is an irrelevant constant: Ostrogradski used .

In the quantum theory, and are operators that allow one to define the basis . We now show that the usual quantization must be used for and that the Dirac–Pauli quantization must be chosen for , which is equivalent to (and more transparent than) fixing an imaginary and using the canonical representation.

As usual, the operator is invariant under time-reversal , and thereby it can follow the usual T-even representation. On the other hand, the operator is T-odd, because of the time derivative: the time-inversion operator T transforms it as . This is the novel key feature.

Taking into account that T is anti-unitary, one can equivalently define a usual T-even coordinate by choosing an imaginary .3 However, it is simpler to forget the factors and just declare that the self-adjoint operator is T-odd and thereby it follows the T-odd Dirac–Pauli representation. Then the Ostrogradski Hamiltonian of Eq. (6) is T-even. The states satisfy since has imaginary eigenvalues and since T is anti-unitary.

The strange extra factor of i has been justified from first principles. With hindsight, it was not so strange. After all, it is well known that the self-adjoint spatial gradient is rather than . In a relativistic theory, one could have guessed that similarly the self-adjoint time derivative is rather than . Loosely speaking, while from a classical perspective was the natural auxiliary variable, from a quantum perspective the natural extra coordinate operator is .4

Using the Heisenberg representation, one has and with unitary U, so q(t) keeps real eigenvalues and keeps imaginary eigenvalues at any t (these statements are not contradictory, given that q(t) also depends on and ).

The frequency eigenstates

We conclude this section by computing what the Dirac–Pauli representation adopted for implies for the frequency eigenstates. We restart from the Hamiltonian Eq. (6) and bring it in diagonal form,through the canonical transformationwhich satisfies . For the sake of generality, we here allow for generic factors and . The non-vanishing commutators, and , can be rewritten in terms of and of reproducing the Hamiltonian of Eq. (14) and the commutators of Eq. (13). The ground-state wave function is easily computed imposing findingFor it is not normalizable [43, 44]. It is normalizable if instead .

The Dirac–Pauli representation for corresponds to imaginary . Imposing that are T-odd and that are T-even (i.e. that and have the unusual T parity) implies that are T-odd and that are T-even (i.e. that the canonical coordinates of the negative-norm mode and have the unusual T parity). This is obtained for imaginary .

As a check, let us connect the basis with the basis for generic and . It is convenient to start from the T-odd basis , in which the ground-state wavefunction isNext, the transition to the T-odd variables is simplyInserting the change of variables dictated by the functions into one obtainswhere and are both complex and linked by and . can be trivially analytically continued to real . For it remains a bounded Gaussian. Finally, one performs the Fourier transform from to , obtaining from the ground-state wavefunction , which agrees with Eq. (16). The same equality holds for excited states, which can be computed acting with creation operators on the ground state.

In the limit one gets the critical situation described in Sect. 3.2.

Path-integral quantization

We now present the path-integral quantization of the same 4-derivative theory.

Path integral for generic norm

Our generic-norm formalism makes easy to write down the equivalent path integral formalism, an issue already considered in [27]. Inserting at intermediate times one hasEach step can be evaluated ashaving definedand using and . The final result is the path integraland with boundary conditions , .

Path integral for 4-derivative quantum theories

Applying the generic path integral of Eq. (61) to the 4-derivative oscillator in the canonical Ostrogradski formalism, one gets the transition amplitudewhere for generality we added currents (such that acting with functional derivatives with respect to them one can form more general matrix elements of time-ordered operators; is T-even and is T-odd). The Dirac–Pauli representation for manifests in two ways:Rewriting the transition amplitude in the usual positive-norm formalism, it acquires an usual sign, becoming . In the limit one has , so that the unusual sign is equivalent to the Dirac–Pauli negative norm.5 Furthermore, the T-odd nature of is hardwired in the path integral, as a geometrical feature. For each trajectory q(t) with boundary conditions and the time-inverted trajectory has the same action and the following boundary conditions:Thereby the propagator given by the path integral satisfies the identitywhich is equivalent to the operator identity given that .Inserting the Ostrogradski Hamiltonian of Eq. (6) in the generic path integral of Eq. (61) one gets the following classical Hamiltonian:This is the same as Eq. (6) with . can be complex because , in the Dirac–Pauli representation, have complex eigenvalues.6 Thanks to the unusual i, it is invariant under time-reversal.

A propagator with an unusual in its external state.

An unusual classical Hamiltonian.

Let us now try to evaluate the path integral. As usual, one can perform the Gaussian path integrals. The path integral formally gives the Dirac delta function , allowing to eliminate the path integral, leavingwhere coincides with the original 4-derivative Lagrangian. By partial integration, the source term for can be transformed into a source for q or for (like in the auxiliary-field method). This computation however has three problems:Given that the theory is well defined in the operator formalism, somehow this path integral must have a sense.

The path integral is, in general, divergent. Thereby the subsequent result is only formal.

The always vanishes if and are real. Thereby the path integral is only formal.

Once interactions are turned on, the Lagrangian admits classical runaway solutions, reflected in the path integral.

Euclidean path integral for 4-derivative quantum theories

A sensible path integral is found by starting from Eq. (62) and continuing it to Euclidean time, , such that i.e. . One gets the Euclidean path integralNow the integral is convergent and gives , such that the path integral just fixes . Next, the remaining terms in are a sum of positive squares so all other integrals are convergent. Performing them one finds the Lagrangian Euclidean path integral:where the classical Euclidean Lagrangian corresponding to Eq. (3) isLet us now check the result. The classical free solution isIt already contains runaway exponentials, characteristic of any Euclidean theory. Interactions compatible with the positivity of the action lead to an equally good path integral. By imposing the boundary conditions at and evaluating the classical action, one finds the normalizable ground-state wave functionThis agrees with the ground-state wavefunction in Eq. (16), which was computed in the Dirac–Pauli formalism in Minkowski space, after identifying and . In other words, coincides with , as computed for . The novel feature introduced by four derivatives is that must not be continued into an imaginary (which would give divergent wavefunctions), because it already describes the T-odd variable , which contains the Dirac–Pauli i factor of Eq. (45).7 The final result is that the Minkowskian theory is an unusual analytic continuation of the Euclidean theory.

Interactions, quantum field theory, probability

Summarizing, we so far considered a 4-derivative harmonic oscillator. One might think that we achieved nothing [43, 44]. After all, a classical 4-derivative harmonic oscillator has no runaway problems, see Eq. (9), given that it splits into two decoupled oscillators, one with negative energy and one with positive energy. The classical trouble starts when they interact. In this section we will explain that we have achieved instead something useful in an interacting quantum field theory.

Adding interactions

The quantum formalism was so far developed for the harmonic oscillator (which corresponds to the modes of a free 4-derivative quantum field theory), finding that the quantum theory has a positive-energy spectrum and no runaway behaviors. Adding interactions, the quantum interacting inherits all these good properties, as long as interactions are perturbative and as long as the interacting Hamiltonian H remains self-adjoint.

The second issue was the main obstacle to past attempts of adding ad hoc unusual i factors in order to make the quantum free theory consistent [33-42] (normalizable wavefunctions and unitary evolution with negative norm and positive energy eigenvalues): adding extra complex factors can render interactions complex, ruining the theory [43, 44].

In our approach the only extra i factor arose from a principal reason: is a T-odd coordinate that follows the negative-norm Dirac–Pauli representation. This satisfies all the properties of quantum mechanics, as generalized to negative norms: itself is self-adjoint, like q and . Thereby any interaction which is a real function of them is self-adjoint. Our procedure immediately generalizes to the interacting case (in agravity [12] all interactions are dictated by general covariance).

The perturbativity assumption means that, as long as the energy spectrum of the free oscillator gets slightly distorted by interactions, the energy eigenvalues will remain real and bounded from below (strongly interacting theories could also be good; however, they seem not needed for the physical application to agravity [12]).

One might worry that, even if all energy eigenvalues are positive, the theory possesses negative-norm states with . Equation (29) shows how transition amplitudes can be computed trough perturbation theory: we see that the energy eigenvalues are the quantity that enters into the conservation of energy. Thereby a theory where all eigenvalues of H (of in the perturbative expansion) are positive is consistent. As usual, perturbative computations can be systematized in terms of the propagator. By expressing in terms of the annihilation and creation operators , through Eqs. (11) and (12) and using the commutation relations we find the propagator where is a small positive quantity and we used and in the last step.

One might worry that, using the Heisenberg picture, operators satisfy the time evolution equation , which looks dangerously similar to the classical equation of motion, as given by Poisson parentheses, which has runaway solutions. However, the quantum solutions are equal to the classical solutions only in a free theory. In general operators are not numbers, and the difference (in particular, the Dirac–Pauli representation) manifests when non-linear interactions are present. As is well known, the Heisenberg equations are in general solved by . So, all good properties of negative-norm states found in the Schrödinger picture remain valid in the Heisenberg picture, given that they are equivalent.

Extension to quantum field theory

As is well known, a single harmonic-oscillator degree of freedom q(t) is the building block for a field such as or . The expansion of a field in Fourier modes with given momentum works in the 4-derivative case similarly to the 2-derivative case. As long as, at the end, we are only interested in S-matrix elements, all the detailed structure of the quantum mechanical theory, such as the wavefunctions, gets hidden behind the commutation relations of Eq. (13), which hold separately for each mode. The usual prescription for the field propagator dictates that amplitudes can be analytically continued from the Euclidean case. Details will be presented elsewhere.

One would like to claim that quantum field theory inherits all good properties of quantum mechanics also when negative norms are present. However, while in quantum mechanics interactions can easily satisfy the condition that avoids ‘tachyonic ghosts’ (namely, the interaction strength between two opposite-norm states must be smaller than their energy difference as discussed in Sect. 3.2), any interesting quantum field theory leads to situations that might violate this condition. The simplest situation where this occurs is the decay of a ghost (for example a massive spin 2 graviton at rest), which can be degenerate with a multi-particle state (for example two photons going in opposite directions with energy equal to half of the ghost mass), such that the interaction, no matter how small, can be smaller than the energy difference. Actually, the ghost is degenerate with an infinite number of similar states, such that an appropriate limit procedure is needed: in the positive-norm case, entropic considerations allow to interpret this situation as particle decay. A 4-derivative kinetic term acquires a positive imaginary part. We will explore if ‘ghost decay’ can be interpreted like in [32].

Ghost does not play dice?

So far we carefully avoided talking about probabilities.

The theory is unitary in a negative-norm space. Thereby the only remaining difficulty is assigning an interpretation to states that entangle positive-norm components with negative-norm components. The Copenhagen interpretation added an extra ingredient external to the deterministic formalism of quantum mechanics: the Born postulate, according to which:

“when an observable corresponding to a self-adjoint operator A is measured in a state , the result is an eigenvalue of A with probability

is the projector over the eigenstate of A”.

For positive norms, these satisfy the probability rules and ; the average value of A satisfies .

At the moment we do not have a satisfactory generalization to indefinite norm. Even worse, the Born postulate is unsatisfactory by itself, given that it describes a non-local collapse of the wavefunction [53-55]. In order to make progress, one needs to operate close to the heart of quantum mechanics. As is well known this presents fatal risks: physicists tend to become philosophers. We conclude by listing some interpretations of quantum mechanics, equivalent to the Copenhagen interpretation, which could lead to a satisfactory indefinitive-norm quantum mechanics.We plan to further investigate such issues.

Feynman clarified the ontological basis of the Born postulate: it agrees with experiments, so ‘shut up and compute’. All experiments have so far been performed with positive-norm states. The negative-norm graviton predicted by agravity is beyond the reach of present experiments. On the one hand, this is good because it means that Einstein’s general relativity is recovered at large distances; on the other hand, however, we do not have experimental guidance. Lee and Wick proposed that the interpretation issue is bypassed, given that in quantum field theory we can only observe asymptotic states, which are made of positive-norm quanta [22, 23]. The Lee–Wick idea may be applied to the gravitational theory proposed by Stelle [2], as discussed in [6, 56].

Any self-adjoint Hamiltonian H gives unitary evolution with respect to many different norms, since each energy eigenstate evolves picking just a phase. Defining ghost parity to be the metrics in the special basis of energy eigenstates and , a possible generalization of the Born postulate to generic norm is (see also [33-42]) The example of Sect. 3.2 gets converted into normal oscillations with mixing angle . However, is real but does not have a probabilistic interpretation, while has a probabilistic interpretation but can be complex.

Various authors claim that the Born postulate is just an emergent phenomenon (somehow like friction) that follows from the fundamental deterministic equations when applied to complex systems in view of spontaneous decoherence [57-59].

Cramer [60, 61] proposed a “transactional interpretation”, claiming that EPR non-locality results from a cancellation of advanced and retarded waves, in a time-symmetric set-up (see also [62]) inspired by the analogous formulation of classical electro-dynamics proposed by Dirac and Feynman–Wheeler. The amplitude in the Dirac–Pauli coordinate representation supports the interpretation as being the overlap of a wave moving forward in time with a wave moving backwards in time.

Conclusions (so far)

We presented the quantization of 4-derivative theories, finding that a unique structure emerges. We can summarize it as follows.

Quantum mechanics has its usual visible face, where a coordinate operator q is represented as . But quantum mechanics also has a hidden face, where , as first pointed out by Dirac and Pauli. Both q and p of a canonical pair are self-adjoint in both representations. The main difference is that the usual representation implies positive norms and q is naturally even under time reflection T, while the DP representation leads to states with indefinite norm and to a naturally T-odd q (in view of the i factor and of the fact that T is anti-unitary).

The Ostrogradski formulation of a 4-derivative degree of freedom q(t) (summarized in Sect. 2) employs two canonical coordinates: and . For the first time we have observed that , which is T-even, naturally follows the usual representation, while , which is T-odd, naturally follows the Dirac–Pauli negative-norm quantization. This leads to a sensible quantum theory with positive energies and normalizable wavefunctions, as discussed in Sect. 4.

In Sect. 3 we presented a new formalism appropriate for generic-norm quantum mechanics, introducing ‘covariant’ and ‘contravariant’ basis states. This clarifies why a self-adjoint linear operator can be represented by a matrix that, in some basis, is not hermitian. A self-adjoint Hamiltonian leads to unitary time evolution, in the sense that the negative norm is preserved. Given that are self-adjoint, a Hamiltonian which is a generic real function of them is self-adjoint, leading to sensible interacting quantum theory provided that one avoids tachyons, an observation that was previously overlooked. The usual condition that the theory should be free of tachyons is generalized to negative-norm quantum mechanics.

In Sect. 5 we presented the path integral formulation of negative-norm quantum mechanics. The classical Hamiltonian becomes complex. Another new result of this paper is the proof that the normalizable wavefunctions found in the operator formalism are recovered from the path integral after performing naive manipulations over ill-defined objects and/or analytic continuations. In particular, the version of the path integral in Euclidean time is well defined, and reproduces the usual wavefunctions taking into account that already coincides with the Dirac–Pauli .

The fact that (1) our approach leads to normalizable wavefunctions and (2) these wavefunctions can also be deduced from a well-defined Euclidean path integral clearly show that the right quantization for is the Dirac–Pauli one.

Two issues must be addressed before these results can be used to obtain a predictive renormalizable quantum theory of gravity: generalization to quantum field theory, and generalization of the Born probabilistic interpretation to negative norms.