`International Journal of Mathematics and Mathematical SciencesVolume 2012 (2012), Article ID 934295, 7 pageshttp://dx.doi.org/10.1155/2012/934295`
Research Article

## Semicontinuity of the Automorphism Groups of Domains with Rough Boundary

Department of Mathematics, Washington University in St. Louis, St. Louis, MO 63130, USA

Received 14 August 2012; Accepted 15 October 2012

Copyright © 2012 Steven G. Krantz. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

Based on some ideas of Greene and Krantz, we study the semicontinuity of automorphism groups of domains in one and several complex variables. We show that semicontinuity fails for domains in , , with Lipschitz boundary, but it holds for domains in with Lipschitz boundary. Using the same ideas, we develop some other concepts related to mappings of Lipschitz domains. These include Bergman curvature, stability properties for the Bergman kernel, and also some ideas about equivariant embeddings.

#### 1. Introduction

A domain in is a connected open set. If is a domain, then we let denote the group (under the binary operation of composition of mappings) of biholomorphic self-maps of . When is a bounded domain, is a real (never a complex) Lie group.

A notable theorem of Greene and Krantz [1] says the following.

Theorem 1.1. Let be a smoothly bounded, strongly pseudoconvex domain with defining function (see [2] for the concept of defining function). There is an so that, if is a defining function for a smoothly bounded, strongly pseudoconvex domain with (some large ) then the automorphism group of is a subgroup of the automorphism group of . Furthermore, there is a diffeomorphism such that the mapping is an injective group homomorphism of into .

In what follows we shall refer to this result as the “semicontinuity theorem.”

It should be noted that, although this theorem was originally proved for strongly pseudoconvex domains in , the very same proof shows that the result is true in for any smoothly bounded domain . In fact the proof, while parallel to the original proof in [1], is considerably simpler in the one-dimensional context.

The original proof of this result, which was rather complicated, used stability results for the Bergman kernel and metric established in [3] and also the idea of Bergman representative coordinates. An alternative approach, using normal families, was developed in [4]. The paper [5] produced a method for deriving a semicontinuity theorem when the domain boundaries are only . The more recent work [6] gives a new and more powerful approach to this matter of reduced boundary smoothness. The paper [7] gives yet another approach to the matter and proves a result for finite type domains.

It is geometrically natural to wonder whether there is a semicontinuity theorem when the boundary has smoothness of degree less than 2. On the one hand, experience in geometric analysis suggests that is a natural cutoff for many positive results (see [8]). On the other hand, Lipschitz boundary is very natural from the point of view of dilation and other geometric operations.

The purpose of this paper is to show that the semicontinuity theorem fails for domains in , , with Lipschitz boundary. But it holds for domains in with Lipschitz boundary. The reason for this difference is connected, at least implicitly, with the failure of the Riemann mapping theorem in several complex variables. We shall explain this point in more detail as the presentation develops.

#### 2. The Several-Complex-Variable Situation

The main result of this section is the following.

Theorem 2.1. Let and consider domains in . There is a sequence of strongly pseudoconvex domains with Lipschitz boundary and another domain with Lipschitz boundary so that in the Lipschitz topology on defining functions and so that(a)for each ,;(b).

See [9] for a consideration of strongly pseudoconvex domains with less than boundary. This result shows that the semicontinuity theorem fails for domains with Lipschitz boundary.

It should be understood that all the domains considered in this paper have finite connectivity. In particular, the complement of the domain only has finitely many components. And each component of the complement has Lipschitz boundary. We do not allow boundary components that are a single point. Each boundary component is the closure of an open set.

We shall use some ideas in [10] in constructing the example enunciated in the theorem. We shall make our construction in . But it is easy to produce analogous examples in any .

Proof of the Theorem. Let be such that (i); (ii); (iii).
We will build our domains by modifying the unit ball in . We will make particular use of these automorphisms of the unit ball, for a complex number of modulus less than 1: See [11].
We define Set Clearly is a domain with smooth boundary. It is a ball with a “bump” attached at the point .
Now define We see that has infinitely many bumps which accumulate at the points and . It is because of those accumulation points that the boundary of is only Lipschitz.
In general we let, for , Set Clearly is a domain with smooth boundary. It is a ball with a “bump” attached at the point .
Now define, for , We see that has infinitely many bumps which accumulate at the points and . It is because of those accumulation points that the boundary of is only Lipschitz.
Finally we let
Now it is clear that in the Lipschitz topology on defining functions. Furthermore, the ideas in [10] show that the automorphism group of consists precisely of the mappings , . So the automorphism group of is canonically isomorphic to . But it is also clear that the automorphism group of consists of the identity alone.
That completes the construction described in the theorem.

#### 3. The One-Variable Situation

The one-variable result is the following.

Theorem 3.1. Consider domains in . Let be a bounded domain with Lipschitz boundary and defining function . If is sufficiently small then, whenever is a bounded domain with Lipschitz boundary and defining function satisfying then the automorphism group of is a subgroup of the automorphism group of . Moreover, there is a diffeomorphism so that the mapping is an injective group homomorphism.

We see here that the situation is in marked contrast to that for several complex variables. Our proof of this result will rely on uniformization for planar domains, a result which has no analogue in several complex variables.

Proof of the Theorem. Fix the domain and let be of distance from in the Lipschitz topology.
It is a standard result of classical function theory that a finitely connected domain in the plane, with no component of the complement equal to a point, is conformally equivalent to the plane with finitely many nontrivial closed discs excised—see [12]. Call this conformal mapping the “normalization” of the domain. What is particularly nice about this result is that the proof is constructive and it is straightforward to see that the normalization of is close to the normalization of just because is close to . Indeed the normalization of will be close to that of in the topology. Just because once it is close in the Lipschitz topology then it is automatically close in a smoother topology (because the boundary consists of finitely many nontrivial circles).
Thus we may apply the one-dimensional version of the semicontintuity theorem for boundary to see that the automorphism group of the normalization of is a subgroup of the automorphism group of . And the diffeomorphism exists as usual. Now we may use the normalizing conformal mapping to transfer this result back to the original domains and .
That completes the proof.

We note that another approach to construct the normalization map is by way of Green’s functions. This method is also quite explicit and constructive. Stability results for elliptic boundary value problems are well known. So this again leads to a proof of the semicontinuity theorem by transference to the normalized domain.

#### 4. Related Results in One Complex Dimension

Key to the work of Greene and Krantz in [3] and [1] is a stability result for the Bergman kernel. In that theorem, the authors consider a base domain and a “nearby” domain . As usual, we define “nearby” in terms of closeness of the defining functions in a suitable topology. But it is useful to note that, in this circumstance, there is a diffeomorphism , which is close to the identity in a suitable topology. With this thought in mind, Greene and Krantz proved the following.

Theorem 4.1. Let be a fixed, smoothly bounded, strongly pseudoconvex domain. Let be a domain which is “-close” to in a topology. Let be the mapping described in the preceding paragraph. If is small enough, then the Bergman kernel for is close to in the topology for some .

This result also holds in one complex dimension, and the proof in that context is actually much easier.

Our remark now is that this theorem is actually true in the Lipschitz topology. We use the argument of the last section. Namely, if is close to in the Lipschitz topology, then the normalization of is close to the normalization of in a smooth topology. This one-dimensional version of Theorem 4.1 applies to the normalized domains. The result follows.

#### 5. Equivariant Embeddings

A lovely result of Maskit [13] is the following.

Theorem 5.1. Let be any planar domain. Then there is a univalent, holomorphic embedding so that the automorphism group of the image domain consists only of linear fractional transformations.

An elegant corollary of Maskit’s result is that if is any automorphism of a planar domain that fixes three points then is the identity mapping. This follows because it is clear that any linear fractional transformation that fixes three points is the identity.

We would like to remark here that the ideas in this paper give a “poor man’s version” of this theorem. For let be any domain with Lipschitz boundary as we have been discussing. So each component of the complement is the closure of a region having Lipschitz boundary. Now the normalizing map sends this domain to a planar domain bounded by finitely many disjoint circles. It is easy to see, using Schwarz reflection and Schwarz’s lemma, that any conformal self-map of such a domain must be linear fractional. So any such map that fixes three points must be the identity.

#### 6. The Bun Wong/Rosay Theorem

A classical result in several complex variables is the following (see [14, 15]).

Theorem 6.1. Let be a bounded domain. Let and assume that is strongly pseudoconvex in a neighborhood of . Suppose that there are a point and automorphisms of such that as . Then is biholomorphic to the unit ball.

In a similar spirit, Krantz [16] proved the following result.

Theorem 6.2. Let be a bounded domain and let have the property that near is a curve. Suppose that there are a point and automorphisms of such that as . Then is conformally equivalent to the unit disc.

In this section we will reexamine Theorem 6.2 in the context of this paper, that is, in relation to finitely connected domains with Lipschitz boundary. As noted, such a domain is conformally equivalent to a domain whose boundary consists of finitely many circles. Now we have the following possibilities.(a)If consists of just one circle, then is the disc, and there is nothing to prove. (b)If consists of two circles, one inside the other, then is (conformally equivalent to) an annulus. Then the automorphism group of such a domain is two copies of the unit circle. In particular, it is compact. So the hypotheses of Theorem 6.2 do not obtain.(c)If consists of two circles, neither of which is inside the other, then the domain is unbounded. The automorphism group of such a domain is compact, and the hypotheses of Theorem 6.2 do not apply.(d)If consists of at least three circles, with all the circles but one lying inside the other one, then it is well known (see [17] or [18]) that the automorphism group of is finite. Then the hypotheses of Theorem 6.2 do not obtain.

Thus, we see by inspection that Theorem 6.2 is true in the context of the domains that we have been discussing in this paper.

#### 7. Curvature of the Bergman Metric

It is a matter of considerable interest to know the curvature properties of the Bergman metric on a planar domain. In particular, negativity of the curvature near the boundary is a useful analytic tool (see [3]). If is a planar domain with Lipschitz boundary, then its normalized domain is bounded by finitely many circles. The asymptotic boundary behavior of the Bergman kernel on such a domain is very well understood—see [19]. In particular, the kernel near a boundary point is asymptotically very much like the kernel for the disc. Thus, a straightforward calculation confirms that the curvature of the Bergman metric near the boundary is negative. Of course this statement pulls back to the original domain in a natural way.

#### 8. Closing Remarks

It is natural to want to consider the results presented here in either the topology or even the topology. At this time the techniques are not available to attack those questions.

In several complex variables, one would also like to prove semicontinuity theorems for broad classes of domains. This will be the subject for future papers.

#### References

1. R. E. Greene and S. G. Krantz, “The automorphism groups of strongly pseudoconvex domains,” Mathematische Annalen, vol. 261, no. 4, pp. 425–446, 1982.
2. S. G. Krantz, Function Theory of Several Complex Variables, American Mathematical Society, Providenc, RI, USA, 2nd edition, 2001.
3. R. E. Greene and S. G. Krantz, “Deformation of complex structures, estimates for the $\overline{\partial }$-equation, and stability of the Bergman kernel,” Advances in Mathematics, vol. 43, no. 1, pp. 1–86, 1982.
4. Y. W. Kim, “Semicontinuity of compact group actions on compact differentiable manifolds,” Archiv der Mathematik, vol. 49, no. 5, pp. 450–455, 1987.
5. R. E. Greene and S. G. Krantz, “Normal families and the semicontinuity of isometry and automorphism groups,” Mathematische Zeitschrift, vol. 190, no. 4, pp. 455–467, 1985.
6. R. E. Greene, K.-T. Kim, S. G. Krantz, and A.-R. Seo, “Semi-continuity of automorphism groups of strongly pseudoconvex domains: the low differentiability case,” The Pacific Journal of Mathematics, In press.
7. S. G. Krantz, “Convergence of automorphisms and semicontinuity of automorphism groups,” Real Analysis Exchange. In press.
8. S. G. Krantz and H. R. Parks, The Geometry of Domains in Space, Birkhäuser, Boston, Mass, USA, 1996.
9. G. M. Henkin and J. Leiterer, “Theory of Functions on Strictly Pseudoconvex Sets with Nonsmooth Boundary, with German and Russian summaries,” Report MATH 1981, Akademie der Wissenschaften der DDR, Institut für Mathematik, Berlin, Germany, 1981.
10. L. Lempert and L. Rubel, “An independence result in several complex variables,” Proceedings of the American Mathematical Society, vol. 113, pp. 1055–1065, 1991.
11. W. Rudin, Function Theory in the Unit Ball of n, Springer, New York, NY, USA, 1980.
12. S. G. Krantz, Cornerstones of Geometric Function Theory: Explorations in Complex Analysis, Birkhäuser, Boston, Mass, USA, 2006.
13. B. Maskit, “The conformal group of a plane domain,” American Journal of Mathematics, vol. 90, pp. 718–722, 1968.
14. J.-P. Rosay, “Sur une characterization de la boule parmi les domains de ${ℂ}^{n}$ par son groupe d’automorphismes,” Annales de l'institut Fourier Grenoble, vol. 29, pp. 91–97, 1979.
15. B. Wong, “Characterization of the unit ball in n by its automorphism group,” Inventiones Mathematicae, vol. 41, no. 3, pp. 253–257, 1977.
16. S. G. Krantz, “Characterizations of smooth domains in $ℂ$ by their biholomorphic self maps,” American Mathematical Monthly, vol. 90, pp. 555–557, 1983.
17. G. Julia, “Leçons sur la représentation conforme des aires multiplement connexes,” Paris, France, 1934.
18. M. Heins, “On the number of 1-1 directly conformal maps which a multiply-connected plane regions of finite connectivity $p\left(>2\right)$ admits onto itself,” Bulletin of the AMS, vol. 52, pp. 454–457, 1946.
19. L. Apfel, Localization properties and boundary behavior of the Bergman kernel [thesis], Washington University in St. Louis, 2003.