Orbital-selective Dirac fermions and extremely flat bands in frustrated kagome-lattice metal CoSn.

Layered kagome-lattice 3d transition metals are emerging as an exciting platform to explore the frustrated lattice geometry and quantum topology. However, the typical kagome electronic bands, characterized by sets of the Dirac-like band capped by a phase-destructive flat band, have not been clearly observed, and their orbital physics are even less well investigated. Here, we present close-to-textbook kagome bands with orbital differentiation physics in CoSn, which can be well described by a minimal tight-binding model with single-orbital hopping in Co kagome lattice. The capping flat bands with bandwidth less than 0.2 eV run through the whole Brillouin zone, especially the bandwidth of the flat band of out-of-plane orbitals is less than 0.02 eV along Γ-M. The energy gap induced by spin-orbit interaction at the Dirac cone of out-of-plane orbitals is much smaller than that of in-plane orbitals, suggesting orbital-selective character of the Dirac fermions.

Introduction

A typical electronic band structure of kagome lattices is characterized by a Dirac-like band capped by a flat band, which can be produced by using the tight-binding method with single-orbital nearest-neighbor hopping. Recently, the linearly dispersive energy bands and dispersionless flat bands have been partially reported in two-dimensional (2D) layered kagome-lattice 3d transition metals Fe3Sn2[1-3], Fe3GeTe2[4,5], Co3Sn2S2[6-10], and FeSn[11,12]. Topologically protected linearly dispersive bands show distinctly different behaviors from the traditional parabolic bands. When such bands are tuned to the Fermi energy (EF), the low-energy quasiparticle excitations would be drastically different from that of the conventional parabolic-band fermions and thus lead to novel transport properties[13-15]. For instance, large intrinsic anomalous Hall effects associated with Dirac/Weyl nodes near EF in antiferromagnetic (AFM)[16] and ferromagnetic (FM)[8-10,17] kagome metals have been reported. When taking the spin-orbit coupling (SOC) into account, a small band gap can open, adding a mass term to the linearly dispersive band, and a massive Dirac fermion thus can be formed[1]. Contrasting with the linear band hosting massless or lightweight quasiparticles, flat band is dispersionless over a finite range of momentum, usually with super-heavy localized electrons, extremely singular density of states (DOS), and correlated states with broken symmetries. Because of the similarity with 2D continuum Landau levels, flat bands can induce novel quantum behaviors, like Mott insulators, magnetism, fractional quantum Hall states, even at high temperatures and superconductivity[18-20], as predicted in twisted bilayer graphene[21,22]. In kagome metals, the extremely light band (Dirac fermions) and extremely heavy band (flat bands) coexist. Unconventional phenomena would happen if either of the two bands is tuned close to EF. Though the local DOS reflected by scanning tunneling spectra indicate the existence of the flat bands which have also been found in rather limited momentum space by angle-resolved photoemission spectroscopy (ARPES) in previous reported kagome materials[2,6,7,10], the extremely capping flat band with a much smaller bandwidth runs through the entire Brillouin zone (BZ) have not been clearly found in realistic kagome lattices.

Moreover, five 3d orbitals dominate the low-lying electronic states in these 3d transition kagome materials, resulting in the presence of multiple orbital physics. Along with the increased filling of the electronic 3d shell, orbital characters of the low-energy bands near EF can be tuned. Crystal field can also affect the orbital energy-levels in kagome lattice. The Dirac-like band and the flat band with certain orbital characters at EF should be associated with novel quantum phases, when the chemical potential were tuned properly. Furthermore, when SOC opens band gaps at the Dirac points, orbitals with different SOC strengths will cause various sizes of the band gaps. If the sizes of the band gaps have obvious distinctions among the orbitals, the Dirac cones with small gaps would be largely responsible for the novel electronic excitations, leading to orbital-selective Dirac fermions. The bands with specified orbital characters have been found in paramagnetic kagome lattice YCr6Ge6 (d4)[23], as well as in helically coupled FM kagome layers of YMn6Sn6 (d5) and antiferromagnetically coupled FM kagome layers of FeSn (d6)[11]. Mainly due to complicated magnetism, correlation effect, interlayer coupling, and even the inappropriate EF, typical kagome bands with orbital differentiation physics near EF are key features that have long been theorized but still remain elusive in real kagome materials.

In this work, we clearly demonstrate the existence of sets of typical kagome bands with their orbital characters near EF in the frustrated kagome-lattice CoSn by means of ARPES, scanning tunneling microscopy/spectroscopy (STM/S), and in combination with theoretical calculations. Because of representation of the group D6h, five 3d orbitals are divided into three groups: in-plane d/d, out-of-plane d/d, and d orbitals, with individual sets of feature for each group. We find that the SOC induced energy gap at the Dirac cone with d/d orbitals characters is much larger than that with d/d orbitals characters, suggesting that the latter can be predominant in the Dirac-like fermionic excitations. While, the flat bands near EF are mainly dominated by d/d and d/d orbitals, respectively. The bandwidth of the former is less than 0.2 eV along Γ−K and <0.1 eV along Γ−M. The latter, with dispersion  <0.12 eV along Γ−K and  <0.02 eV which is limited by energy resolution along Γ−M, features in touch with a quadratic band at the BZ center, which is a key feature to distinguish from the flat band in heavy fermions and Morié lattice. The d orbital sinks downward to higher binding energy and mainly contributes dispersions in a narrow range of momentum space around k ~ π plane, indicating 2D character of the flat bands of CoSn.

Results

The crystal structure and transport property of CoSn

CoSn is isostructural to FeSn, crystalizing in a hexagonal structure with P6/mmm (No. 191) space group, in which Co kagome lattice in single Co3Sn layer is the one closest to the 2D limit, as shown in Fig. 1a. High-quality single crystals were synthesized by the Sn flux method (see Supplementary Note 1). The samples were characterized by X-ray diffraction (XRD) (Supplementary Fig. 1) and the XRD pattern of ground crystals can be well fitted by using the reported structure of CoSn[24]. The c-axial electrical resistivity ρ(T) of CoSn as a function of temperature is shown in Supplementary Fig. 2, from which a clear metallic behavior is observed as the ρ(T) decreases rapidly upon cooling the sample. Further, Supplementary Fig. 3 demonstrates that CoSn is a Pauli paramagnet with very small positive magnetic moment. To directly observe the cleaved surface and kagome lattice, we performed STM experiments on the (001) surfaces of CoSn. The high-resolution STM topograph taken on the cleaved surface (Fig. 1b) shows flat Co3Sn plane decorated with islands of Sn. The atomic-resolved STM topograph taken on Co3Sn surface (Fig. 1c) shows perfect Co kagome lattice. With an ideal 2D kagome lattice and without complicated magnetism, the electronic bands of CoSn would be advantageous for clearly addressing the fundamental questions of kagome physics both theoretically and experimentally.

Fig. 1

Crystal structure, tight-binding calculations and FS.

a Crystal structure of CoSn with space group P6/mmm (No. 191). b High-resolution STM topography with V = 1 V, I = 20 pA. Co3Sn surface (blue) and Sn surface (black) are indicated. c Atomic-resolved STM topography on Co3Sn plane with V = 500 mV, I = 100 pA. d The typical kagome band is produced by using the tight-binding method with single-orbital nearest-neighbor hopping. The black (red) curves are indicated for with (without) the inclusion of SOC. e 3D bulk BZ with marked high-symmetry points and two mirror planes: σ (Γ−K−M) and σ (Γ−A−H−K). plane is a projected 2D BZ. f Intensity plot at E ± 10 meV in 2D BZ. The red lines indicate high-symmetry directions and the first BZ projected on the (001) surface.

Clear visualization of typical kagome bands of CoSn

The typical kagome band, characterized by a Dirac-like band capped by a flat band, is produced by using the tight-binding method with single-orbital nearest-neighbor hopping[6], as shown in Fig. 1d. When taking SOC into account, a small band gap can open at the Dirac point, and the dispersion of the flat band is modified. The bandwidth of the flat band can be further broadened by orbital and interlayer coupling in real materials. To directly detecting the features, we performed polarization- and photon-energy-dependent ARPES measurements on (001) surfaces of CoSn. The corresponding BZ with high-symmetry points and two mirror planes (σh and σv) are shown in Fig. 1e. The experimental setup shows the high-symmetry directions and the normal of the sample surface defined a mirror plane (Supplementary Fig. 4). The π (σ) geometry refers to the electric fields of the incident photons within (normal to) the mirror plane. The even (odd) orbitals with respect to the mirror plane are detected in π (σ) geometry. With selected experimental symmetries, certain orbitals combinations, e.g., d (odd) and d (even) [d (even) and d (odd)], could be enhanced or suppressed individually, thus the Dirac cones and the flat bands features could be more prominent under certain conditions.

Figure 2a–d shows ARPES intensity plots along cut1, which is perpendicular to the line, as marked on the Fermi surface (FS) plot (Fig. 1f). One can clearly see the feature of kagome bands characterized by the Dirac-like dispersion capped by the phase-destructive flat band, in spite of the intensity contrast caused by the matrix element effect under σ and π geometries. At K point, two close Dirac cones at around −0.6 eV below EF are shown in both geometries, as shown in Fig. 2a, b, e, and f. The two close cones can be much clearly seen from the momentum distribution curves (MDCs) in Fig. 2i. The two flat bands at about −0.07 and −0.3 eV below EF are revealed in σ (Fig. 2a, e) and π geometries (Fig. 2b, f), respectively. The former is an extremely flat top of a hole-like band, which contributes a hotspot around the point at EF, as shown in Fig. 1f. The latter entangles with the Dirac-like bands and looks like a break at the center of the K point. At H point, two Dirac cones locate at about −0.42 and −0.68 eV below EF, respectively, as shown in Fig. 2c, g. The two cones can also be determined from the MDCs in Fig. 2j. With the same binding energies as at the K point, the two flat bands at the H point are also revealed in σ (Fig. 2c, g) and π geometries (Fig. 2d, h), respectively, indicating that the flat bands have negligible k dispersions. We applied the projected 2D BZ () in our studies of the flat bands unless further stated, due to the weak k dispersions and the limitation of k resolution in ARPES experiments.

Fig. 2

The typical kagome bands.

a–d Intensity plots at the K and H points along cut1 as indicated in Fig. 1f in σ and π geometries, respectively. Dirac points (DP) and flat bands (FB) are indicated by the white and red arrows, respectively. The flat band top (FB 1) locates about −0.07 eV and the flat bottom (FB 2) locates about −0.3 eV below EF. e–h Corresponding second derivative plots of (a–d). i MDCs around the Dirac cones at the K point in σ geometry show two close Dirac cones at about −0.6 eV below EF, as indicated by the dashed square in (a). The black sticks are guides to the bands. j MDCs around the Dirac cones at the H point in σ geometry show two Dirac cones at about −0.42 and −0.68 eV below EF, respectively, as indicated by the dashed square in (c).

The flat bands of CoSn

The band structures along the and the directions are shown in Fig. 3, and the flat bands are indicated by the red dashed lines in Fig. 3a, b. The red solid lines appended on the second derivative plots are the density functional theory (DFT) calculated bands, renormalized by a factor of  ~1.5 to match the main ARPES dispersive features, indicating intermediate electron correlation effects in CoSn. Along the direction, there are two phase-destructive flat bands with bandwidths of about 0.2 and 0.12 eV, respectively. The flat band top with the binding energy of ~0.07 eV at the point is consistent with the observation along cut1 in Fig. 2. At the point, the electron-like bands contribute the FS around BZ center (Fig. 1f), and the nearly flat band lays at about 0.3 eV below EF. The energy distribution curves (EDCs) (Fig. 3c) clearly exhibit the flat band top (FB 1), the electron-like parabolic band (QB), and the flat band (FB 2). As predicted by tight-binding model on kagome lattice[3,6], the flat band degenerates with the quadratic band bottom at Γ with the exclusion of SOC. The electron-like band extends to the K point and forms Dirac cone above EF (see Fig. 4a). With the inclusion of SOC, the two bands further hybridize and open an energy gap of  ~40 meV, which can be estimated from the EDCs data. We note that the flat band in touch with the quadratic band at BZ center is a key feature to distinguish from the flat band in heavy fermions and Morié lattices, but is critically missing in previous experiments. Along the direction, the two flat bands with dispersion  <0.1 eV and  <0.02 eV, respectively, are much narrower than that along . Figure 3d shows EDCs of Fig. 3b, clearly exhibiting the extremely flat band (FB 2) at the binding energy of  ~0.27 eV. As mentioned above, the clear capping flat band with such a small bandwidth through the entire BZ has not yet been reported. Complementary to ARPES measurements on the flat band of CoSn, we performed STS experiments. Figure 3e displays the scanning tunneling spectra (dI/dV), which reflects the local DOS. Two peaks were observed around −0.07 and −0.3 eV on both Co3Sn and Sn plane. The peak at −0.07 eV corresponds well to the flat band top at the point measured by ARPES. The other peak reflects the flat band at about −0.3 eV below EF.

Fig. 3

The flat bands of CoSn.

a, b Intensity plots and corresponding second derivative plots along the and directions in σ geometry, respectively. Flat bands are indicated by the red dashed lines in (a, b). The red lines on the corresponding second derivative plots are DFT calculated bands renormalized by a factor of 1.5. The bandwidths of the flat bands are marked by the white squares and indicated by the black arrows. c EDCs of (a). d EDCs of (b). The flat bands (FB 1, and FB 2) and the parabolic band (QB) are indicated by the black dashed lines and open circles, respectively. e Scanning tunneling spectra (dI/dV) taken on the Co3Sn surface (red) and the Sn surface (yellow). Setpoint condition: V = 1 V, I =  100 pA.

Fig. 4

The band calculations.

a, b DFT calculated bands along high-symmetry directions without and with SOC, respectively. Orbitals characters are indicated by the different colors. Flat bands (FB), Dirac points (DP), and band gaps induced by SOC at the Dirac points are indicated. c DOS from calculation and experiment. Up panel: Calculated total and orbital-resolved DOS of Co 3d narrowed 1.5 times in energy range. Down panel: Integrated EDCs in experiments. d DFT+DMFT calculation with SOC.

The band calculations

To study the kagome bands with their orbital characters computationally, we performed DFT and dynamical mean-field theory (DMFT) calculations. Results of orbital-projected DFT calculation without and with the inclusion of SOC along high-symmetry directions are shown in Fig. 4a, b, respectively, revealing several sets of orbital-selective kagome bands. Compared with calculated and observed low-energy band structures in other 3d transition AFM or FM kagome metals[2,4,5,8,11,12,16], the calculated bands of CoSn are simpler and more consistent with experimental results, mainly due to absence of complication from magnetism. Compared with calculated bands, an extra electron-like band at the point in ARPES data (the δ band in Fig. 3c, d) should be a shadow of the band above EF, as the calculated band at the Γ (A) point above EF.

On the Γ−K−M plane, the calculated bands clear show two sets of kagome bands originating mainly from in-plane d/d (red) and out-of-plane d/d (green) orbitals, respectively. The two cones are very close and the flat band with d/d orbitals characters is more prominent along the Γ−M lines, which are consistent well with the ARPES measurements. Besides, the electron-like band touching with the flat bands at the Γ point extends to the K point and forms Dirac cone above EF, as discussed in Fig. 3. On the A−H−L plane, the cone with d/d orbitals characters ascends, and the cone with d/d orbitals characters descends to higher binding energy. Under the protection of time-reversal and spatial-inversion symmetry (T ⋅ P symmetry), the two cones at the K point form two nodal lines along k direction when the SOC is neglected (Supplementary Fig. 5). With the inclusion of SOC, the two cones open gaps with energy of  ~96.5 meV (d/d) and  ~8 meV (d/d) in the DFT calculations (Fig. 4b), respectively. The strengths of SOC of in-plane orbitals are much stronger than those of out-of-plane orbitals, indicating the orbital-selective character of the SOC strength. The d (blue) orbital mainly contributes a set of kagome band at a higher binding energy around k ~ π plane, showing a strong three-dimensional character.

We quantitatively compare the features between experiments and DFT calculations with SOC on the Γ−K−M plane, details can be seen in the Supplementary Table 1. The calculated velocity (VD) of the Dirac cones is  ~1.3 times more than that in the experiment, and the relative energy shift between Dirac points and flat bands (EΔ) in calculations is  ~1.6 times of the experimental results. Since the flat band contributes the high DOS, the two positions of the momentum-integrated EDCs of the flat bands correspond well to DFT calculated DOS with renormalization of 1.5 in energy range, as displayed in Fig. 4c. The overall width of the peaks around −0.3 eV can be estimated as  ~0.2 eV. In addition, the calculated bandwidth of in-plane orbitals is almost the same with experimental value. While, the calculated bandwidth of out-of-plane orbitals needs to be renormalized about 1.5 times along Γ−K and 2 times along Γ−M possibly due to the correlation effects induced by interlayer coupling. Compared to the DFT calculation, the DFT+DMFT calculated bands (Fig. 4d and Supplementary Fig. 6) are narrower by a factor of  ~1.5, in good agreement with experiment. The quantitative comparisons the features between DFT+DMFT results and experimental data are even much better (Supplementary Table 1), except that the bands of out-of-plane orbitals are shifted up about 0.1 eV.

Two-orbital tight-binding model

Based on the above experimental and calculational findings, we propose a two-orbital tight-binding model (see Supplementary Note 4) to describe the phase-destructive flat band of d/d orbitals. From the DFT and DMFT calculations along k (Γ−A), we know that d/d bands are 2D-like in the vicinity of EF. Hence, we write down an effective model inside the kagome plane. Based on D6h point group and by including hopping integrals into second nearest neighbors[25], the two-orbital model with d/d orbitals can be obtained. Supplementary Fig. 7b–d shows a flat band along the Γ−M−K line, and the degeneracy at Γ can be lifted by introducing SOC. In contrast to the nearest-neighbor-single-band model in kagome lattice, the dispersion of the phase-destructive flat band is broadened by orbital coupling and different neighbor’s hopping in the two-orbital model.

Discussion

We have unambiguously demonstrated the existence of sets of typical kagome bands with different orbitals characters in CoSn. The flat bands with bandwidth less than 0.2 eV run through the whole BZ, especially the bandwidth of the flat band of d/d orbitals is less than 0.02 eV along Γ−M which have yet been found in pervious reports. The flat band top at EF could induce instabilities such as superconductivity or ferromagnetism even at high temperatures, if the chemical potential were tuned properly. The band gap induced by SOC at the Dirac cone with d/d orbital characters is much smaller than that with d/d orbital characters, suggesting orbital-selective Dirac fermions in low-energy excitations. In addition, experimental observation of the extremely flat band over the whole BZ and in touch with the quadratic band at the BZ center is crucial in the fundamental kagome model. With an ideal 2D kagome lattice and without complication from magnetism, CoSn is a close-to-textbook example of kagome bands with interesting orbital differentiation physics, can be described by the long-sought minimal kagome tight-binding model.

Methods

Sample growth and characterizations

High-quality single crystals of CoSn were synthesized by the Sn flux method. The starting elements of Co (99.99%), Sn (99.99%) were put into an alumina crucible, with a molar ratio of Co:Sn = 3:20. The mixture was sealed in a quartz ampoule under partial argon atmosphere and heated up to 1173 K, then cooled down to 873 K with 2 K/h. The CoSn single crystals were separated from the Sn flux by using centrifuge. The samples were characterized by powder XRD and transport measurements, including temperature dependence of resistivity and magnetic susceptibility, and field dependence of magnetization, as shown in Supplementary Figs. 1–3.

ARPES experiments

ARPES measurements were performed at Dreamline and 03U beamlines of Shanghai Synchrotron Radiation Facility (SSRF). Experimental setup is shown in Supplementary Fig. 4. Samples were cleaved in situ, yielding a flat mirror-like (001) surface. During measurements, the temperature was kept at T = 20 K. The pressure was maintained <5 × 10−11 Torr.

STM/S experiments

STM experiments were carried out with a Unisoku low-temperature STM at the base temperature of 4.3 K. CoSn single crystal samples were cleaved in situ under ultra-high vacuum and transferred immediately into STM head under the vacuum of 2 × 10−10 Torr. STS measurements were done by using standard lock-in technique with 5 mV modulation at the frequency of 914 Hz.

Band calculations

DFT calculation was done in the nonmagnetic phase, whereas DFT+DMFT calculation was done in the paramagnetic phase. For DFT calculations, we used the full-potential linear augmented plane wave method implemented in Wien2K[26] in conjunction with Perdew-Burke-Ernzerhof generalized gradient approximation[27] of the exchange correlation functional. DFT+DMFT was implemented on top of Wien2K and documented in ref. [28]. In the DFT+DMFT calculations, the electronic charge was computed self-consistently on DFT+DMFT density matrix. The quantum impurity problem was solved by the continuous time quantum Monte Carlo method[29,30], at a temperature of 116 K and with a Hubbard U = 5.0 eV and Hund’s rule coupling J = 0.8 eV in the paramagnetic state. The same values as we used for many iron-based compounds[31-33]. The experimental crystal structure (space group P6/mmm, No. 191) of CoSn with lattice constants a = b = 5.275 Å and c = 4.263 Å was used in the calculations.