Skip to content

Kinds of Continuity

April 15, 2015

Congratulations to John Nash and Louis Nirenberg on the 2015 Abel Prize

Combined from src1, src2.

John Nash and Louis Nirenberg have jointly won the 2015 Abel Prize for their work on partial differential equations (PDEs). They did not write any joint papers, but Nirenberg evidently got Nash excited about David Hilbert’s 19th problem during Nash’s frequent visits to New York University’s Courant Institute in the mid-1950s. Nash in return stimulated Nirenberg by his verbal approach of barraging a problem with off-kilter ideas. The Norwegian Academy of Sciences and Letters recognized their ‘great influence on each other’ in its prize announcement.

Today we congratulate both men on their joint achievement.

Hilbert’s 19th problem asked whether all solutions to certain partial differential equations must be analytic functions—that is, expressible as power series on local neighborhoods. Enough progress had been made since the 1930s that the remaining task could be likened to building a short road bridge without central stanchions or much room below for support. If you just shoot the road across it is hard to maintain the level needed to reach the other side. But if you aim up then you create more room to make an arch for best support.

The level known before Nash went to work—and Ennio De Giorgi slightly earlier in Italy—was that solutions to Hilbert’s equations gave a property on second derivatives (pardoning a negligible set of points with discontinuities or other bad non-differentiable behavior) that was insufficient. The support structure on the other side of the bridge needed some kind of continuity condition on the first partial derivatives. The task was aiming at a condition low enough to prove but high enough to land where needed on the other side. This makes us wonder whether we have similar situations in computational complexity without fully realizing it.

Nirenberg is one of few surviving researchers who worked on the Manhattan Project—in his case, on a part that had been contracted to Canada’s National Research Council in Montreal. Richard Courant’s son Ernst was a co-worker and suggested NYU as a destination for a Master’s, which led to doctoral work and affiliation there. For his PhD thesis he completed an attack by Hermann Weyl on the problem of embedding the 2-sphere equipped with any Riemannian metric having positive Gaussian curvature into {\mathbb{R}^3} as a convex surface with the standard Euclidean metric so that paths of corresponding points have the same length under the respective metrics. With Louis Caffarelli and Joseph Kohn he gave what are still considered the most stringent restrictions on possible singularities in solutions to the Navier-Stokes equations. He is acclaimed as the grand master of enduringly useful inequalities, which he said he “loves” more than equations.

Continuity Conditions

The basic definition for a function {f : A \rightarrow B} to be continuous is that for every {x \in A} and {\epsilon > 0} there exists {\delta > 0} such that whenever {||x - y|| < \delta}, {||f(x) - f(y)|| < \epsilon}. Actually, a more basic definition is that for every open subset {S} of {B}, {f^{-1}(S)} is open as a subset of {A}, but we are presupposing metrics on {A} and {B} so that {||\cdot||} is defined for each.

If for every {\epsilon} there is a {\delta} that works for all {x}, then {f} is uniformly continuous. In much of real or complex analysis this is the strongest uniformity condition one needs. It comes for free if {A} is compact. We can postulate a mapping {g} sending {\epsilon} to {\delta}:

\displaystyle  (\exists g)(\forall \epsilon)(\forall x): ||x - y|| < g(\epsilon) \implies ||f(x) - f(y)|| < \epsilon.

However, this still does not articulate a numerical relationship between {||x - y||} and {||f(x) - f(y)||}. It does not guarantee differentiability, much less that the first derivatives be continuous.

The key conditions have the form

\displaystyle  ||f(x) - f(y)|| \leq C||x - y||^{\alpha},

where {C} and {\alpha} are real constants. If {\alpha = 1} and {C < 1} then {f} is a contracting mapping. Contracting mappings can be called fellow-travelers of Nash’s work. Nash used the Brouwer fixed-point theorem to prove his famous theorem about equilibria in non-zero-sum games, but one can also use a more-general fixed-point theorem together with contracting mappings. Matthias Günther found an alternative proof of Nash’s equally great embedding theorem for Riemannian manifolds into Euclidean space via contracting mappings.

If {\alpha = 1} and {C} is arbitrary, then {f} satisfies a Lipschitz condition, named for Rudolf Lipschitz. Although Lipschitz conditions are commonly available and frequently useful, they were still too high to aim for this problem. What De Giorgi and Nash accomplished was showing that things could work with any appropriately given or chosen {\alpha}. The criterion with {\alpha > 1} allowed is called Hölder continuity, named for Otto Hölder.

Hölder continuity turned out to be the key for Hilbert’s 19th. The proof again was like building a bridge. For any instance of Hilbert’s equations, one could take {\alpha} high enough and find {C} to make the inequality work. Given any {\alpha} (and {C}), analyticity could be shown to follow. I wonder if we can solve open problems in computer theory not by attacking them directly but by trying to set up this kind of proof structure.

Continuity and Containment

Applying this idea could be as simple as the condition for saying one complexity class {C} is contained in another class {D}. Consider the statement

\displaystyle \mathsf{NP = P},

where the classes are represented by standard computable enumerations {[N_i]} of poly-time NTMs and {[P_k]} of poly-time DTMs, respectively. The enumerations are nondecreasing with respect to code size. In terms of those machines, the statement is:

\displaystyle  (\forall i)(\exists k)\,L(N_i) = L(P_k).

We can strengthen this by insisting that {k} be given by a computable mapping of {i}:

\displaystyle  (\exists g)(\forall i): L(N_i) = L(P_{g(i)}).

Thus a complexity class containment involves a mapping between “spaces” of machines. We can ask what further conditions such a mapping may or must meet. If we start with machines {N_i} and {N_j} that are “close” in some respect, how far apart can the machines {P_{g(i)}} and {P_{g(j)}} be?

Because {\mathsf{NP}} has complete sets we get some further properties for free. If {\mathsf{NP = P}} then there is an {s} such that {\mathsf{SAT} = L(P_s)}. The mapping {g} from {N_i} executes the reduction to {\mathsf{SAT}} and composes its output with {P_s} to get {P_k = P_{g(i)}} such that {L(P_k) = L(N_i)}.

It is important to note that although inputs {x} of length {n} given to {P_{g(i)}} are expanded by the reduction into formulas of size more than linear in {n} which are input to {P_s}, the code of {P_{g(i)}} simply embeds that of {N_i} and {P_s} and so has size linear in {|N_i|}. Moreover, if we weaken the mapping condition to say

\displaystyle  (\exists g)(\forall i): L(N_i) \equiv^F L(P_{g(i)}),

where {A \equiv^F B} means that {(A \setminus B) \cup (B \setminus A)} is finite, then we can employ Leonid Levin’s universal search algorithm to write the code of {P_s} in advance. This ensures that the code expansion from {N_i} to {P_{g(i)}} has a reasonable additive constant. In any event, with respect to the ‘metric’ of code size we can deduce a kind of Lipschitz condition: for all {i < j}:

\displaystyle  |P_{g(j)}| - |P_{g(i)}| \leq C\cdot(|N_j| - |N_i|).

And with respect to running time, although that of {P_s} can be astronomical (as we noted in last year’s post), it is still {O(n^{\alpha})} for some fixed {\alpha}. The running time {n^c} of {N_i} does expand inputs {x} into formulas of size {\tilde{O}(n^c)} (the tilde means ignoring polynomials in {\log n}), which makes an overall runtime of {\tilde{O}(n^{c\alpha})}. Rather than use “{\tilde{\Theta}}” for exact runtimes, let us ignore more than just {\log} factors by defining a function {t(n)} to be {\Phi(n^c)} if for all {b < c < d},

\displaystyle  n^b = o(t(n)) = o(n^d).

What we’d like to do take two machines {M} and {N}—deterministic or nondeterministic—that have runtimes in {\Phi(n^b)} and {\Phi(n^c)}, respectively, and define a distance {d(M,N)} in terms of {b} and {c}. We’d further like to arrange at least that under the hypothesized mapping {g},

\displaystyle  d(P_{g(i)},P_{g(j)}) \leq C\cdot d(N_i,N_j)^{\alpha'},

perhaps with {\alpha' > \alpha}. This uses the putative runtime {\Phi(n^\alpha)} of {P_s} to create an analogue of a Hölder condition.

If we define the metric simply on the exponents as {|c - b|} then we get a Lipschitz condition. The running times of {P_{g(i)}} and {P_{g(j)}} become {\Phi(n^{\alpha b})} and {\Phi(n^{\alpha c})}, so their {d}-distance is (at most) {\alpha\cdot|c - b|}. However, we would like to involve quantities like “{n^b}” and “{n^c}” or something else that is exponential in {b} and/or {c} in the metric. We could try {d'(N_i,N_j) = |2^c - 2^b|}, but then to get even a Hölder condition on the mapping we are seeking {\alpha'} such that

\displaystyle  |2^{\alpha c} - 2^{\alpha b}| \leq C\cdot|2^c - 2^b|^{\alpha'}.

This is not valid without further qualification because {2^c - 2^b = 1} is possible, among other things. We would be interested to find a reasonable metric based on running-time and/or program size that gives a Hölder but not Lipschitz condition.

Can {\mathsf{P = NP}} happen anyway with a Hölder or even Lipschitz condition under a metric like {d'}? It does with an oracle. The construction giving

\displaystyle  \mathsf{NP^{QBF} = P^{QBF}}

basically maps each oracle NTM {N_i} to an oracle DTM {P_j} that simply bundles the translation of the code of {N_i} into a formula into the oracle queries, and so has the same polynomial running time as {N_i} up to log factors. Hence we can get a Lipschitz property under various distances {d} that use the exponents {c} in running times {\Phi(n^c)}. This property does not necessarily “relativize,” and it may be interesting to ask what happens if it does.

Some Quotes

Perhaps ideas like this can help probe other complexity class relations. When the classes do not have complete sets (or are not known to have them), even getting a computable embedding function {g} can be problematic. That the concepts may be simple is not a block; the point is to find a combination of ideas that are conducive to deep uses. For instance, the maximum principle simply states that solutions to elliptic and parabolic PDEs attain their maximum on any connected open subset on the boundary of that subset. A Simons Foundation feature on Nirenberg quotes him as saying,

“I have made a living off the maximum principle.”

Of course this is similar to principles in convex optimization which Nash initially studied.

As with similar ideas we’ve posted, we’re casting about for a new handle on open problems. To quote Sylvia Nasar’s biography A Beautiful Mind on pages 218–221 about Hilbert’s 19th problem:

[Nash] had a theory that difficult problems couldn’t be attacked frontally. He approached the problem in an ingeniously roundabout manner, first transforming the nonlinear equations into linear equations and then attacking these by nonlinear means.

At worst we can pass on advice from De Giorgi, who narrowly beat Nash to the solution with a markedly different proof:

“If you can’t prove your theorem, keep shifting parts of the conclusion to the assumptions, until you can.”

Wikipedia’s bio of De Giorgi cites this from a MathOverflow thread titled “Should one attack hard problems?” that leads with {\mathsf{P = NP?}}

Nasar finishes her account by addressing the “shock” of De Giorgi’s earlier proof on Nash, quoting Peter Lax that when the two met at Courant in 1957, “it was like Stanley meeting Livingstone.” She puts more blame for Nash’s subsequent troubles, quoting Nash himself, on “his attempt to resolve the contradictions in quantum theory.” Which we have also been guilty of promoting. Oh well.

Open Problems

Can such ideas of continuity, metrics, and more broadly topology help to gain insight about complexity classes?

[typo fix: oracle NTM to oracle DTM, P_j –> P_k consistently, some other word changes]

A Quantum Two-Finger Exercise

April 8, 2015

More mileage than expected from a little example

Cropped from World Science Festival source

Sean Carroll is a cosmologist in the Department of Physics at Caltech. He also maintains a blog, “Preposterous Universe,” and writes books promoting the public understanding of science. I have recently been enjoying his 2010 book From Eternity to Here: The Quest for the Ultimate Theory of Time.

Today—yes, Carroll would agree that there is a today—I would like to share an interpretation of a little quantum computing example that occurred to me while reading his book.
Read more…

April Fool

April 1, 2015

Non-jokes on April Fool’s Day

Nun’s Priest’s Tale source

Faadosly Polir is the older brother of Lofa Polir. You may recall he invented new ways to apply powerful mathematical techniques to prove trivial theorems, and she once claimed a great result on integer factoring. We have heard from both since, but they haven’t given us any new April Fool’s Day material, mainly because they weren’t fooling to begin with.

Today Ken and I wished to help you enjoy April Fool’s day.
Read more…

Is It New?

March 24, 2015

How to tell algorithms apart


Edgar Daylight was trained both as a computer scientist and as a historian. He writes a historical blog themed for his near-namesake Edsger Dijkstra, titled, “Dijkstra’s Rallying Cry for Generalization.” He is a co-author with Don Knuth of the 2014 book: Algorithmic Barriers Failing: P=NP?, which consists of a series of interviews of Knuth, extending their first book in 2013.

Today I wish to talk about this book, focusing on one aspect.
Read more…

Leprechauns Will Find You

March 17, 2015

And perhaps even find your hidden prime factors



Neil L. is a Leprechaun. He has visited me every St. Patrick’s Day since I began the blog in 2009. In fact he visited me every St. Patrick’s Day before then, but I never talked about him. Sometimes he comes after midnight the night before, or falls asleep on my sofa waiting for me to rise. But this time there was no sign of him as I came back from a long day of teaching and meetings and went out again for errands.

Today Ken and I wish you all a Happy St. Patrick’s Day, and I am glad to report that Neil did find me.
Read more…

The Other Pi Day

March 14, 2015

It’s 3/14/15, do you know how much your Π costs?


Larry Shaw apparently created the concept of Pi Day in 1988. He was then a physicist who worked at the San Francisco Exploratorium. He and his colleagues initially celebrated by marching around in circles, and then eating pies—that is fruit pies. As Homer Simpson would say: hmm.

Today Ken and I want to add to some of the fun of Pi Day, and come back to a different Pi that has occupied us.
Read more…

Lint For Math

March 8, 2015

Can we remove simple errors from math proofs?

simple-talk interview source

Stephen Johnson is one of the world’s top programmers. Top programmers are inherently lazy: they prefer to build tools rather than write code. This led Steve to create some of great software tools that made UNIX so powerful, especially in the “early days.” These included the parser generator named Yacc for “Yet Another Compiler Compiler.”
Read more…


Get every new post delivered to your Inbox.

Join 2,435 other followers