Chieu Van Nguyen1, Ravi F Saraf. 1. Department of Chemical and Biomolecular Engineering, ‡Nebraska Center for Materials and Nanoscience, University of Nebraska-Lincoln , Lincoln, Nebraska 68588, United States.
Abstract
Apart from texture, the human finger can sense palpation. The detection of an imbedded structure is a fine balance between the relative stiffness of the matrix, the object, and the device. If the device is too soft, its high responsiveness will limit the depth to which the imbedded structure can be detected. The sensation of palpation is an effective procedure for a physician to examine irregularities. In a clinical breast examination (CBE), by pressing over 1 cm(2) area, at a contact pressure in the 70-90 kPa range, the physician feels cancerous lumps that are 8- to 18-fold stiffer than surrounding tissue. Early detection of a lump in the 5-10 mm range leads to an excellent prognosis. We describe a thin-film tactile device that emulates human touch to quantify CBE by imaging the size and shape of 5-10 mm objects at 20 mm depth in a breast model using ∼80 kPa pressure. The linear response of the device allows quantification where the greyscale corresponds to the relative local stiffness. The (background) signal from <2.5-fold stiffer objects at a size below 2 mm is minimal.
Apart from texture, the human finger can sense palpation. The detection of an imbedded structure is a fine balance between the relative stiffness of the matrix, the object, and the device. If the device is too soft, its high responsiveness will limit the depth to which the imbedded structure can be detected. The sensation of palpation is an effective procedure for a physician to examine irregularities. In a clinical breast examination (CBE), by pressing over 1 cm(2) area, at a contact pressure in the 70-90 kPa range, the physician feels cancerous lumps that are 8- to 18-fold stiffer than surrounding tissue. Early detection of a lump in the 5-10 mm range leads to an excellent prognosis. We describe a thin-film tactile device that emulates human touch to quantify CBE by imaging the size and shape of 5-10 mm objects at 20 mm depth in a breast model using ∼80 kPa pressure. The linear response of the device allows quantification where the greyscale corresponds to the relative local stiffness. The (background) signal from <2.5-fold stiffer objects at a size below 2 mm is minimal.
Entities:
Keywords:
breast cancer screening; nanoelectronics; nanoparticle; palpability; tactile sensor
With an estimate of
almost 300 000 new cases diagnosed in
2013, accounting for 29% of all cancers, breast cancer is the most
common type of cancer among women.[1] Similar
to other types of cancers, an abnormal mass (or a lump) develops in
the breast and is either benign (in situ) or cancerous (invasive).
Growing in size with time, it eventually spreads out to neighboring
regions. While there is no cure today, early diagnosis when the lump
is less than 10 mm can improve the survival rate to more than 94%.[1] Using X-ray radiation, mammography images the
lump based on (<50%) density contrast between the lump and surrounding
tissue, which is not an effective approach for young women or women
with dense and vascular breasts.[2] Medical
imaging tools, such as magnetic resonance imaging (MRI) and ultrasound,
are more sensitive than mammography but are too expensive to use as
a screening tool. Palpability is a more effective parameter to detect
malignancy, especially in younger women.[3] The higher the palpability of the lump, the greater the probability
it is malignant irrespective of size.[4] Typically,
the malignant lump is 8- to 18-fold stiffer than surrounding tissue.[5] Clinical breast examination (CBE) is the recommended
complementary tool to mammography as it measures palpability.[6] CBE is an inexpensive, radiation-free procedure
that can be performed in an out-patient setting where a professional
manually feels the patient’s breasts for lumps.[7] However, the result is qualitative with no tangible recordkeeping,[7] and the typical size of lump detected is above
21 mm.[8]The rapid development of
thin-film tactile devices in recent years,
also called “electronic skin,” has been spurred by a
variety of applications, such as robotics, minimally invasive surgery,
haptics, and prosthetics,[9−12] which all have a natural extension to quantitatively
image palpability by touch.[13] The contact
pressure corresponding to the texture and/or shape of the object is
mapped by measuring the local deformation of the tactile-device film
to form a continuous or pixelated image. Typically, the local deformation
is measured by probing the modulation in conductivity of a granular
composite,[14−16] capacitance,[17−19] piezoresistance,[14,15,20,21] or refractive index.[22,23] Sensitivity to touch of less
than 1 Pa has been demonstrated.[24] Resolution
of 20 μm has been achieved for a contact area of 1 cm2.[25] A variety of materials have been utilized
to fabricate the tactile device based on the above principle, such
as nanoparticles (NPs),[25−27] carbon nanotubes,[28] and nanowires.[29−32] To image palpable features in
the breast, a key requirement is the emulation of human touch with
optimum sensitivity in a pressure range of 50–90 kPa over a
contact area in excess of 1 cm2. Higher sensitivity would
saturate the image, preventing visualization of a deeper imbedded
mass. Lower sensitivity would require a significant amount of applied
pressure, leading to discomfort. Recently, several tactile devices
for imaging breast cancer lumps have been reported. SureTouch, a commercial
product, can image a 22-fold stiffer mass with a diameter of 6 mm
and 11 mm at a depth of 17 mm and 27 mm, respectively.[13] Based on piezoresistivity,[33] piezoelectricity,[16] vibration,[34] and IR pressure sensors,[35] masses as small as 10 mm in diameter and up to 20 mm in
depth with a stiffness contrast 5- to 8-fold larger than surrounding
tissue have been detected.[35] However, the
resolution is only in the 2.8 mm range, making the image quality poor
and determining the shape of the lump difficult. The shape, especially
the irregularities, is a critical feature for classification (malignancy)
of breast cancer tumors[36] (see Figure S1 Supporting Information (SI)) and at the skin
level to diagnose other cancers, such as melanoma.[37]Here, we describe a tactile device to quantitatively
image a 5-
to 10-fold stiffer object imbedded as much as 20 mm deep in a softer
matrix. The light emitted is linearly proportional to local stress.
The tactile device is a multilayer composite thin film consisting
of nanoparticles (NPs) and polymers. The film is an analog electro-optical
device where the imbedded stiffness is imaged as continuous variation
in light emission that can be focused directly on a camera. The electro-mechanical
characteristics of the flexible thin film are precisely tuned to obtain
a tactile image of the palpable structure for contact pressure in
the 30 to 90 kPa range, similar to human touch. About 5 mm stiff features
embedded 20 mm deep in an artificial breast model are imaged to demonstrate
the performance of the device. Features softer than 2.5-fold relative
to the surrounding material do not produce a significant background.
The image has sufficient resolution to determine both the size and
shape of the mass.The tactile device was fabricated by the
layer-by-layer spin coating
of two polyelectrolytes, poly(allylamine hydrochloride) (PAH) and
poly(styrenesulfonate) (PSS), and the deposition of 10 nm Au and 3
nm CdS NPs.[38] The overall multilayer structure
was a total of three and two layers of Au and CdS NPs deposited alternatively
and separated by nine layers of PAH and PSS (Figure 1). The device was deposited on a 25 × 25 mm2 ITO glass substrate. The active area of the device was 500 mm2. The ITO served as the bottom electrode. The top electrode
was a smooth aluminum foil. The top surface of the device was protected
with an additional PAH–PSS bilayer. The overall thickness of
the thin film device was ∼150 nm. A Scanning Probe Microscope
(SPM) image of each layer shows that the deposition is well below
the in-plane percolation threshold; i.e., the device is not conductive
along the film direction (Figure 1). Well over
30 devices are fabricated and tested to confirm the principle and
the performance. The samples subjected to load for imaging are robust
and unchanged well over 100 experiments, and stable over 6 months
stored in air in an unsealed container.
Figure 1
Schematic of
touch experiment. A touch pressure applied on the
top through a glass slide compressed the palpable structure on the
tactile device. A constant bias of 18 V was supplied across the top
(Al) and bottom electrodes (ITO). An N-shaped object was imaged via
touch experiment with d = 3 mm, ET/EM = 10. The green bar in
the optical image is 12 mm. The tactile image at 80 KPa load clearly
shows sharp features of <2 mm. The SPM images of Au and CdS NPs
layers are 500 nm × 500 nm; the insets are 100 nm × 100
nm.
To quantitatively study
the performance of the device for imaging
palpability, a composite structure was fabricated with a soft silicone
foam matrix of modulus EM ∼ 178
kPa imbedded with a stiffer filler (of fixed thickness, 3 mm; see
Figure S2 in SI). The filler was a combination
of silicone sponge (ET ∼ 415 kPa)
and two types of silicone rubbers (ET ∼
879 and 1744 kPa). The details of the materials are included in the Methods section. Depending on the filler materials,
the stiffness ratio, ET/EM, ranged from 2.5 to 10. In a typical imaging experiment,
the composite structure was placed above the device, and a constant
load of 80 kPa was applied (Figure 1). The
lateral dimension of the filler, L, and the depth
from the contact, d, were varied (as described later).
On pressing against the tactile device, the pressure distribution
was uneven, corresponding to modulation in the local stiffness relative
to the surrounding matrix. The device was like an electro-optical
“strain gauge” that converts the compressive stress
to electroluminescence intensity (IEL)
from the CdS nanoparticles.[39] Under the
applied bias of 18 V, the potential gradient (drop) across the CdS
NPs layers is greater than its bandgap (∼2.4 eV), large enough
to form an electron–hole pair, resulting in electroluminescence.
The tactile image was obtained by focusing the distribution of emitted IEL on a CCD camera (Roper Cascade II).Schematic of
touch experiment. A touch pressure applied on the
top through a glass slide compressed the palpable structure on the
tactile device. A constant bias of 18 V was supplied across the top
(Al) and bottom electrodes (ITO). An N-shaped object was imaged via
touch experiment with d = 3 mm, ET/EM = 10. The green bar in
the optical image is 12 mm. The tactile image at 80 KPa load clearly
shows sharp features of <2 mm. The SPM images of Au and CdS NPs
layers are 500 nm × 500 nm; the insets are 100 nm × 100
nm.The principle of the device is
similar to compression-sensitive
elastomer used in electronic skin, except the thickness is only ∼150
nm with a reversible stress–strain response of over 40% compression
and linearity up to 60% (Figure 2a). The mechanical
properties of the tactile device are obtained by applying uniform
compressive stress, σ, on the film at a constant bias and measuring
the change in resistance to calculate the strain as ε = (RO0.5 – R0.5)/RO0.5, where RO is the resistance at ε = 0.[38] The σ – ε characteristics
indicate that the device film deforms linearly at a modulus of 55.5
kPa (Figure 2a). The low modulus and high compressibility
of the device are attributed to local (reversible) buckling of the
polymer interpose layer.[38] The low modulus
at 55.5 kPa allows the tunability for tactile imaging at 80 kPa that
is comparable to human touch. The device is highly linear in terms
of both the current and IEL (Figure 2b). The linearity is due to the increase in the
number of percolation channels per unit of a cross-sectional area
as the film is compressed. The electroluminescence conversion is high,
corresponding to low power consumption, ∼0.25 mW/mm2, comparable to other electronic skin sensors (∼0.6 mW/mm2)[39]. As IEL is linearly proportional to the local strain, the greyscale
of the tactile image maps the local stiffness variation.
Figure 2
Mechanical
properties of the thin film tactile device. Strain–stress
relationship was obtained from electromechanical measurements (a).
The modulus of the thin film was computed from the linear region,
as indicated by the black line. Electrical current and EL were measured
as functions of stress (b).
Mechanical
properties of the thin film tactile device. Strain–stress
relationship was obtained from electromechanical measurements (a).
The modulus of the thin film was computed from the linear region,
as indicated by the black line. Electrical current and EL were measured
as functions of stress (b).Two classes of palpable composite structures were fabricated
to
quantitatively image the variation in stiffness and anisotropic shape
of the filler, respectively. For both structures, the filler d = 3.2 mm deep. In the first structure, the cross-section
was circular with ET/EM from 2.5 to 10 (Figure 3a). The
corresponding tactile image clearly shows the gradual decrease in
contrast (i.e., lower EL) as ET/EM decreased from 10 to 2.5 (Figure 3b). A critical aspect of the device is the ability
to quantify the relative palpability. In the image (Figure 3b), the step changes in the palpability as ET/EM changes from
10 to 2.5 are quantified by line scan (Figure 3c). The line is a local average over the digital values for all the
pixels in that segment, and the error bar is the standard deviation.
Although the standard deviations are large, there appears to be a
clear distinction between the three (local) hardness regions. The
relative increases in average EL from 2.5 to 5 and 5 to 10 was ∼2.4
and ∼4.1, respectively, which are reasonably linear. The strong
contrast in the tactile image for ET/EM above 5 meets the breast cancer screening
requirement of imaging a mass of stiffness 10-fold higher than surrounding
tissue.[5] The second composite structure
had two fillers, but the cross-section was noncircular with sharp
corners (Figure 3d). The image clearly shows
the noncircular-shaped “corona” for ET/EM of 5 and the circular-shaped
central core with larger intensity. In a similar analysis to that
for Figure 3c, the linear scan across the image
shows a rise in intensity of ∼6-fold (Figure 3f).
Figure 3
Tactile images of heterogeneous palpable structures. (a) Optical
image of cocentric filler with ET/EM ranging from 10 to 2.5 in the radial direction.
(b and c) Corresponding tactile image and a typical line scan. (d)
Optical image of jagged and circular-shaped filler with ET/EM = 5, 10, respectively.
(e and f) Corresponding tactile image and a typical line scan. The
horizontal purple line in c and f is average IEL. The error bars in c are 0.14 and 0.4; in f, they are are
0.13 and 0.5, respectively. The scale bar is 5 mm. The IEL is in arbitrary units.
Tactile images of heterogeneous palpable structures. (a) Optical
image of cocentric filler with ET/EM ranging from 10 to 2.5 in the radial direction.
(b and c) Corresponding tactile image and a typical line scan. (d)
Optical image of jagged and circular-shaped filler with ET/EM = 5, 10, respectively.
(e and f) Corresponding tactile image and a typical line scan. The
horizontal purple line in c and f is average IEL. The error bars in c are 0.14 and 0.4; in f, they are are
0.13 and 0.5, respectively. The scale bar is 5 mm. The IEL is in arbitrary units.We quantified the effect of d at fixed ET/EM and, conversely,
the effect of ET/EM at fixed d, on the image quality. The fillers
were 3 mm thick (see Figure 1) with an L = 2 mm and 5 mm square cross-section, respectively (Figure 4a,f). The ET/EM = 10 was fixed. For shallow depths, d ≤ 3.2 mm, the contrast was remarkable with sharp
edges and corners (Figure 4). The 2 mm mass
(i.e., filler) was easily detected up to depths of 10 mm. However,
the sharp edges at d = 10 mm were smeared. The circular-like
shape and larger apparent size at a 10 mm depth was because the differential
stress field due to the filler tends to become isotropic. For larger
sizes, the shape appeared to be intact. Importantly, for ET/EM = 10, the required minimum
stiffness ratio to detect cancerous tumors in the breast and palpable
filler of L = 2 mm at d = 10 mm
is clearly visible in the tactile images. The EL intensity in all
tactile images was color-coded with a scale similar to that shown
in Figure 2. The sharp images with defined
corners are consistent with the high resolution of ∼20 μm
measured for the tactile device.[25] The
high resolution is attributed to the anisotropic conduction of the
film where electron tunneling occurs along the thickness but the interparticle
spacing in the lateral direction is sparse for percolation (Figure 1). As a result, in principle, the effective pixel
size (accounting for incommensurability between the layers) is below
100 nm.
Figure 4
Effect of the d on the tactile image. (a and f)
Optical image of filler with square cross-section of side 2 and 5
mm, respectively. The other panels (b to e and g to j) are corresponding
tactile images at d ranging from 1.5 to 10 mm. The
stiffness ratio, ET/EM, is fixed at 10. Scale bar is 5 mm.
Effect of the d on the tactile image. (a and f)
Optical image of filler with square cross-section of side 2 and 5
mm, respectively. The other panels (b to e and g to j) are corresponding
tactile images at d ranging from 1.5 to 10 mm. The
stiffness ratio, ET/EM, is fixed at 10. Scale bar is 5 mm.Next, d = 6.5 mm was fixed, and the effect
of ET/EM was
studied.
The fillers were identical, as in Figure 4.
Tactile images for L = 2 mm filler were detectable
for ET/EM =
10 (Figure 5a). For ET/EM = 5, the shape was not apparent,
while at 2.5, the filler was below the detection limit. It is important
to note that for this particular depth and ET/EM < 5, the 2 mm filler was
undetectable by human fingers. The larger filler (L = 5 mm), however, was clearly visible in the images for all ET/EM values. The
device can clearly image fillers larger than 5 mm even at low stiffness
ratio. This suggests that a small variation in the stiffness (below
2.5) of a size less than 2 mm, which may be due to (normal) heterogeneity
in the breast tissue, will not be visible, indicating a low background
and leading to higher contrast in tactile images for features with
higher relative stiffness.
Figure 5
Study of the effect of ET/EM on the tactile image. (a to
f) Using the same filler
shape as Figure 4. Tactile images at ET/EM ranging from
2.5 to 10 are recorded. The filler is fixed at d =
6.5 mm. Color scale is similar to that of Figure 2. Scale bar is 5 mm.
Study of the effect of ET/EM on the tactile image. (a to
f) Using the same filler
shape as Figure 4. Tactile images at ET/EM ranging from
2.5 to 10 are recorded. The filler is fixed at d =
6.5 mm. Color scale is similar to that of Figure 2. Scale bar is 5 mm.A translucent breast model with visible fillers of relative
stiffness
of ET/EM =
10 from MammaCare Corp. was tested (Figure 6a). The mechanical properties of the breast model are realistic in
terms of overall stiffness and are used to train medical personnel
for CBE. The fillers of different shapes and size are located at depths
ranging from ∼2 to 20 mm (Figure 6b).
The tactile image of each of the fillers (i.e., simulated mass) 20
mm below the surface were correctly detected in the tactile images,
including the anisotropic shape (Figure 6c–f).
Dimensions of 5 mm are clearly apparent (Figure 6d), indicating that the device can potentially be a screening tool
to emulate CBE. Similar to a mass in the breast, the filler in the
breast model is mobile in the surrounding matrix during palpation.
The movement is recorded as distortion of the image as the angle of
palpation is changed (Figures S3 and S4 in SI). It is also of note that small distortion occurs because during
the palpation the filler is mobile, so only a portion of the filler
produces the stress distribution. Unfortunately, the filler under
the papilla could not be imaged properly although it was the largest
(Figure 6g). However, the outline of the image
is visible but not too conclusive. Feeling a mass under the papilla
also remains a challenge for CBE.
Figure 6
Tactile imaging of a breast model. (a
and b) Schematic and optical
image of the breast model, respectively. (c to g) Tactile images of
the various fillers in the model. The wrinkles in the model surface
(b) are visible in the tactile images (for example, c and d).
Tactile imaging of a breast model. (a
and b) Schematic and optical
image of the breast model, respectively. (c to g) Tactile images of
the various fillers in the model. The wrinkles in the model surface
(b) are visible in the tactile images (for example, c and d).
Conclusion
In summary, the device
has four salient features that allow for
optimum sensitivity to obtain palpable images 20 mm deep of a 5 mm
size structure. First, although the film was only ∼150 nm,
it was sensitive to appreciable strain caused by contact pressure
in the 80 kPa range. The local buckling of the polymer film between
the nanoparticle layers resulted in counterintuitive softening of
the film and reversible deformation of up to a 40% compression ratio
(Figure 2b). The second aspect of the device
is the linear response. The optical signal and the rise in electrical
current on compression increased linearly with load (Figure 2a). The linearity was caused by a linear increase
in the percolation path between the top and bottom electrode with
increasing load. The tunneling current did rise due to compression,
but the effect was insignificant compared to the increase in percolation.
The third aspect was easy processing by a simple dip coating and washing
operation that allowed fabrication of the device on a large area flat
or curved surface and substrates that may be rigid or flexible. The
fourth aspect was that the signal from the film was continuous (i.e.,
an analog device) where the contact pressure was directly converted
to EL distribution making the data acquisition convenient and fast.
Using an artificial breast model, the four features resulted in imaging
palpability of clinical relevance to potentially screen for breast
cancer. The smallest mass imaged by devices reported in the literature
was 6 mm in diameter at a depth of up to 17.5 mm, but the stiffness
ratio was ∼22.[13] In a breast model,
a 5 mm long mass was accurately imaged at a depth of 20 mm (3 times
the thickness of the mass itself) and ET/EM was as low as 10. Masses smaller
than 10 mm in length were often difficult to detect even by a trained
professional.[8] Thus, the device will improve
the outcome of CBE by providing a quantitative image. Softer masses
(ET/EM <
2.5) were below the sensitivity level leading to background. Owing
to the linear response of the device, the greyscale quantitatively
mapped the relative palpability.
Methods
The tactile sensor is fabricated by interposing three monolayers
of Au (10 nm) and two monolayers of CdS (3 nm) spaced by dielectric
polymer film (DPF). The DPF is made by spin coating alternate layers
of PAH and PSS at 3000 rpm for 20 s and washing with DI H2O also at 3000 rpm in 20 s after each deposition. Thus, the tactile
sensor has the following tandem structure: ITO–DPF–(Au–DPF–CdS–DPF)2–Au–DPF. The top layer is DPF for protective
purposes. The structure and process is described in more detail in
the literature.[38] The device is deposited
on 25 × 25 mm2 ITO glass (Delta Technologies Limited,
CB-90IN-0105). PAH (15 000 Da) and PSS (70 000 Da) were
purchased from Sigma-Aldrich.The palpable structures are designed
in a matrix of extrasoft cellular
silicone (Rogers Corporation, BF-1000 in 1.5 mm, 3.2 mm, and 6.5 mm
thicknesses). The filler was a closed cell silicone sponge of (Rogers
Corporation) and/or a silicone rubber sheet (McMaster-Carr, 8632K44).
The sponge is 2.5- and 5-fold stiffer than the matrix, and the silicone
rubber is 10-fold stiffer than the matrix. Their mechanical properties
are investigated with a tensile test instrument (TestResources; Model
225LB Actuator and Model 3397-136 Load Cell). The results on mechanical
properties are shown in Figure S2 in the SI.
Authors: Stefan C B Mannsfeld; Benjamin C-K Tee; Randall M Stoltenberg; Christopher V H-H Chen; Soumendra Barman; Beinn V O Muir; Anatoliy N Sokolov; Colin Reese; Zhenan Bao Journal: Nat Mater Date: 2010-09-12 Impact factor: 43.841
Authors: Uwe Güth; Dorothy Jane Huang; Marco Huber; Andreas Schötzau; Daniela Wruk; Wolfgang Holzgreve; Edward Wight; Rosanna Zanetti-Dällenbach Journal: Cancer Detect Prev Date: 2008-09-13
Authors: Aik-Aun Tan; Wai-Mei Phang; Subash C B Gopinath; Onn H Hashim; Lik Voon Kiew; Yeng Chen Journal: Biomed Res Int Date: 2015-06-17 Impact factor: 3.411
Authors: Wai-Mei Phang; Aik-Aun Tan; Subash C B Gopinath; Onn H Hashim; Lik Voon Kiew; Yeng Chen Journal: Int J Med Sci Date: 2016-04-26 Impact factor: 3.738