LESSWRONG
LW

Logic & Mathematics World Modeling
Frontpage

45

Discontinuous Linear Functions?!

by Zack_M_Davis
6th Jun 2025
3 min read
11

45

This is a linkpost for http://zackmdavis.net/blog/2025/06/discontinuous-linear-functions/
Logic & Mathematics World Modeling
Frontpage

45

Discontinuous Linear Functions?!
12Jeffrey Liang
6CuriouslyNuclear
4Jeffrey Liang
4Zack_M_Davis
7Gurkenglas
2Zack_M_Davis
2Gurkenglas
2Zack_M_Davis
12Gurkenglas
3Alex Gibson
5CuriouslyNuclear
New Comment
11 comments, sorted by
top scoring
Click to highlight new comments since: Today at 4:37 PM
[-]Jeffrey Liang3mo123

Okay I took the nerd bait and signed up for LW to say:

For your example to work you need to restrict the domain of your functions to some compact e.g. C1([0,1])because the uniform norm requires the functions to be bounded.

Also note this example works because you're not using the "usual" topology on C1([0,1]) which also includes the uniform norm of the derivative and makes the space complete. It is much more difficult if the domain is complete!

Reply
[-]CuriouslyNuclear3mo60

For your example to work you need to restrict the domain of your functions to some compact e.g. C1([0,1])because the uniform norm requires the functions to be bounded.

Hmm, is this really a substantive problem? Call it an "extended norm" instead of a norm and everything in the post works, right? My reasoning: An extended norm yields an extended metric space, which still generates a topology — it's just that points which are infinitely far apart are in different connected components. Since you get a perfectly valid topology, it makes perfect sense for the post to talk about continuity. Or at least I think so; am I missing something?

Reply
[-]Jeffrey Liang3mo40

Perhaps! I'm not familiar with extended norms. But when you say "let's put the uniform norm on C1(R)" warning bells start going off in my head 😅

Reply
[-]Zack_M_Davis3mo40

Thanks for commenting—and for your patience. I've changed the domain to be an arbitrary closed interval and credited you at the bottom.

Reply
[-]Gurkenglas3mo72

for any ε, we can take k:=⌈1ε⌉

You mean take N:=⌈1ε⌉.

sqrt(x) is continuous at 0 with an infinitely steep slope.

Reply
[-]Zack_M_Davis3mo20

Thanks for commenting—and for your patience. I've corrected the k/N slip-up, deleted the misleading clause about "a function not having any 'jumps' impl[ying] that it can't have an 'infinitely steep' slope", and thanked you at the bottom.

Reply
[-]Gurkenglas3mo20

you haven't deleted it.

Reply
[-]Zack_M_Davis3mo20

Now I have. (Sorry, apparently I got confused while trying to make parallel updates to the original and this mirrorpost; they're not using the same source file due to differences between platform markup engines.)

Reply
[-]Gurkenglas3mo120

a small change in the input can't correspond to an arbitrarily large change in the output

The sign function doesn't have an arbitrarily large change in the output. Do you maybe mean that an infinitesimal change in the input can only produce an infinitesimal change in the output? I don't see how that fails, but maybe just because I don't have a definition for it at hand.

Reply
[-]Alex Gibson3mo30

Specifically for linear maps these are the same thing, but yeah I guess that kinda defeats the purpose of the post.

Reply
[-]CuriouslyNuclear3mo*50

This is a good post. I remember being so confused in a real analysis class when my professor started talking about how important it is that we restrict our attention to continuous linear functions (what on Earth was a discontinuous linear function supposed to be?). This post explains what's going on better than my professor or textbook did.

I agree with one of the other commenters that this part is not technically phrased accurately:

One way to think about continuity is that a function not having any "jumps" implies that it can't have an "infinitely steep" slope

Because eg the derivative of  f(x)=3√x at x=0 is +∞ despite the fact that it's continuous there.

Reply
Moderation Log
More from Zack_M_Davis
View more
Curated and popular this week
11Comments

We know what linear functions are. A function f is linear iff it satisfies additivity f(x+y)=f(x)+f(y) and homogeneity f(ax)=af(x).

We know what continuity is. A function f is continuous iff for all ε there exists a δ such that if |x−x0| < δ, then |f(x)−f(x0)| < ε.

An equivalent way to think about continuity is the sequence criterion: f is continuous iff a sequence (xk) converging to x implies that (f(xk)) converges to f(x). That is to say, if for all ε there exists an N such that if k ≥ N, then |xk−x| < ε, then for all ε, there also exists an M such that if k ≥ M, then |f(xk)−f(x)| < ε.

Sometimes people talk about discontinuous linear functions. You might think: that's crazy. I've seen many linear functions in my time, and they were definitely all continuous. f(x): ℝ → ℝ := ax is continuous for any a ∈ ℝ. T(x⃗): ℝ² → ℝ² := (abcd)→x is continuous no matter what the entries in the matrix are. Stop being crazy!!

Actually, it's not crazy. It's just that all the discontinuous linear functions live in infinite-dimensional spaces.

Take, say, the space C1([a,b]) of continuously differentiable functions from a closed interval [a,b] to ℝ, with the uniform norm. (The uniform norm means that the "size" of a function for the purposes of continuity is the least upper bound of its absolute value.) If you think of a vector in the n-dimensional Rn as a function from {1...n} to ℝ, then you can see why a function from a continuous (not even countable) domain would be infinite-dimensional.

Consider the sequence of functions (fk)=(sinkxk)∞k=1 in C1([a,b]). The sequence converges to the zero function: for any ε, we can take N:=⌈1ε⌉ and then sinkxk≤1⌈1ε⌉≤11ε=ε.

Now consider that the sequence of derivatives is (kcoskxk)∞k=1=(coskx)∞k=1, which doesn't converge. But the function D: $C^1([a,b]) \rightarrow C0([a,b]) that maps a function to its derivative is linear. (We have additivity because the derivative of a sum is the sum of the derivatives, and we have homogeneity because you can "pull out" a constant factor from the derivative.)

By exhibiting a function D and a sequence (fk) for which (fk) converges but (D(fk)) doesn't, we have shown that the derivative mapping D is a discontinuous linear function, because the sequence criterion for continuity is not satisfied. If you know the definitions and can work with the definitions, it's not crazy to believe in such a thing!

The infinite-dimensionality is key to grasping the ultimate sanity of what would initially have appeared crazy. One way to think about continuity is that a small change in the input can't correspond to an arbitrarily large change in the output.

Consider a linear transformation T on a finite-dimensional vector space; for simplicity of illustration, suppose it's diagonalizable with eigenbasis {→uj} and eigenvalues {λj}. Then for input →x=∑jcj→uj, we have T(→x)=∑jcjλj→uj: the eigencoördinates of the input get multiplied by the eigenvalues, so the amount that the transformation "stretches" the input is bounded by maxj|λj|. The linearity buys us the "no arbitrarily large change in the output" property which is continuity.

In infinite dimensions, linearity doesn't buy that. Consider the function T(x1,x2,x3,...)=(x1,2x2,3x3,...) on sequences with finitely many nonzero elements, under the uniform norm. The effect of the transformation on any given dimension is linear and bounded, but there's always another dimension that's getting stretched more. A small change in the input can result in an arbitrarily large change in the output, by making the change sufficiently far in the sequence (where the input is getting stretched more and more).

(Thanks to Jeffrey Liang and Gurkenglas for corrections to the original version of this post.)

Mentioned in
27Critic Contributions Are Logically Irrelevant