A Micro-Raman Study of Live, Single Red Blood Cells (RBCs) Treated with AgNO3 Nanoparticles

Aseefhali Bankapur; Surekha Barkur; Santhosh Chidangil; Deepak Mathur

doi:10.1371/journal.pone.0103493

Abstract

Silver nanoparticles (Ag NPs) are known to exhibit broad antimicrobial activity. However, such activity continues to raise concerns in the context of the interaction of such NPs with biomolecules. In a physiological environment NPs interact with individual biological cells either by penetrating through the cell membrane or by adhering to the membrane. We have explored the interaction of Ag NPs with single optically-trapped, live erythrocytes (red blood cells, RBCs) using Raman Tweezers spectroscopy. Our experiments reveal that Ag NPs induce modifications within an RBC that appear to be irreversible. In particular we are able to identify that the heme conformation in an RBC transforms from the usual R-state (oxy-state) to the T-state (deoxy-state). We rationalize our observations by proposing a model for the nanoparticle cytotoxicity pathway when the NP size is larger than the membrane pore size. We propose that the interaction of Ag NPs with the cell surface induces damage brought about by alteration of intracellular pH caused by the blockage of the cell membrane transport.

Citation: Bankapur A, Barkur S, Chidangil S, Mathur D (2014) A Micro-Raman Study of Live, Single Red Blood Cells (RBCs) Treated with AgNO₃ Nanoparticles. PLoS ONE 9(7): e103493. https://doi.org/10.1371/journal.pone.0103493

Editor: Aamir Ahmad, Wayne State University School of Medicine, United States of America

Received: February 22, 2014; Accepted: July 2, 2014; Published: July 24, 2014

Copyright: © 2014 Bankapur et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Funding: The authors thank the Department of Biotechnology, Government of India for financial support for the Raman Tweezers facility under the completed project grant BT/PR6413/MED/14/802/2005. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

The well-established antimicrobial activity of silver nanoparticles (Ag NPs) continues to be of importance in a plethora of industries, such as those concerned with antimicrobial coatings, food storage, water purification, textiles, keyboards, wound dressings, apparel, footwear, paints, appliances, cosmetics, and plastics, and increasingly, also in biomedical devices. One of the most relevant facets of Ag NPs is the broad spectrum of their antimicrobial activities vis-à-vis bacteria, fungi, and viruses [1]. Silver is the most used element in commercially available nanomaterial-containing products and Ag NPs were specifically mentioned in at least 424 product descriptions as of 2014 [2]. This widespread use of Ag NPs continues to raise concerns about how they might interact with biomolecules once they enter the physiological system. The interaction of NPs with biological cells follows various pathways, involving either penetration through the cell membrane followed by a direct attack on cell organelles [3]–[6], or by adhering to the cell membrane and, thereby, affecting the cell organelles indirectly [7], [8]. The former mechanism is possible when the particle size is <100 nm; such NPs can enter cells either actively or passively, depending on the cell type [6]. The latter possibility usually arises when the particle size is >100 nm.

For cells that are in proximity of silver nanoparticles there is a high probability of the NPs adhering to the cell membrane. It has been shown that the charge on the silver ion is crucial for its antimicrobial activity; the mechanism is based upon electrostatic attraction between the negatively-charged cell membrane of a micro-organism and the positive charge of the Ag⁺ comprising the Ag NPs [1]. Thiol-containing proteins in the cell membrane are likely to be one of the effective Ag⁺ ion binding sites [9]. The cysteine residues of NADH dehydrogenases that are present in NADH ubiquinonereductase complexes (Complex I) of E.coli may also be possible sites for Ag⁺ ion binding [10], [11]. One of the identified mechanisms by which Ag NPs act as antimicrobials is by binding to these sites.

The membrane of a red blood cell (RBC) contains proteins and glycoproteins embedded in a fluid lipid bilayer that exhibits viscoelastic behavior. Sialic acid rich glycoproteins of the RBC membrane are responsible for a negatively charged surface which creates a repulsive electric zeta potential between cells [12]. This electronegativity helps in preventing the interaction between RBCs and the other blood cells, and especially between each other [13]. The zeta potential is the electrostatic potential that exists at the shear plane of a particle; it is related to both surface charge and the particle's local environment. On the other hand, the electropositivity of Ag NPs makes them electrostatically attractive to RBC membranes. In general, the negatively charged cell membrane is known to show a tendency to adsorb positively charged or neutral nanoparticles [14]. The process of nanoparticles adsorption on cell membrane involves van der Waals forces, electrostatic charges, steric interactions and/or surface charges. The process of nanoparticle uptake by cells could be considered to comprise two steps: (i) the binding of nanoparticles to the cell surface and, (ii) the internalization of nanoparticles by specific endocytosis pathways [14]. RBCs are not expected to take up nanoparticles by endocytosis but their entry can be effected through the RBC membrane's ion transport channels. The possibility of nanoparticle internalization through cell membrane channels followed by their binding is limited and would be expected to be particle size dependent.

The nature of the lipid bilayer associated with the RBC membrane is amphiphilic, like that of other eukaryotic cells: it is partially or totally permeable to gases (CO₂, O₂, N₂) and small molecules (water, urea, ethanol) while being impermeable to charged polar molecules and ions (Na⁺, K⁺, Cl⁻, HCO₃⁻) [15]. Polar molecules and ions are transported via facilitated diffusion, a process of passive transport aided by integral membrane proteins. The Cl⁻/HCO₃⁻ exchange is carried out by the Anion Exchanger 1 (AE1) or Band 3 protein complex, the Na⁺/K⁺ exchange is carried out by sodium-potassium adenosine triphosphatase (NKA-Na⁺/K⁺-ATPase), an antiporter enzyme and Na⁺/H⁺ exchange is carried out by highly regulated (glyco) phosphoproteins known generically as Na⁺/H⁺ exchangers (NHEs) [15]. Figure 1 is a schematic representation of these channels on an RBC membrane. Improper functioning of these transport pathways may lead to changes in the chemical and mechanical properties of the cell membrane and even to pH imbalances, increase in ROS levels, or to conformational changes of hemoglobin (Hb) in the RBC cytoplasm. Ejection of intracellular H⁺ in exchange for external Na⁺ is the most effective means of eliminating excess acid from actively metabolizing cells [16]. This essential function is carried out by a family of antiporters, known generically as Na⁺/H⁺ exchangers (NHEs) [17]. Decrease in the intracellular pH (increase in acidity of intracellular environment) of RBCs will lead to the decrease in hemoglobin's oxygen binding affinity, as explained by the well-known Bohr Effect.

Download:

Figure 1. Schematic representation of the membrane channels in a red blood cell.

The NPs are shown to be blocking the exchange channels in this cartoon representation.

https://doi.org/10.1371/journal.pone.0103493.g001

In this study we have investigated the possible effects of the adsorption/ adhesion of Ag nanoparticles (of average diameter 100 nm) on RBC membranes by monitoring Raman spectra with the emphasis on conformational changes in hemoglobin that occur on Ag NP treatment. These type of studies are important from the perspective of revealing both beneficial and adverse effects of nanoparticles in their interactions with living cells, especially in the context of a rapidly expanding nano-bio-technology market. A recent review has cogently listed several aspects of nanotechnological industrialization, exposure, and toxicity of Ag NPs [18]. Apart from their bactericidal activity, Ag nanoparticles exhibit toxicity towards mammalian cells. There are, however, ongoing debates on whether such toxicity is due to the nanoparticles themselves or to the silver ions (Ag⁺) they release [19], [20]. Our study focuses on intra-erythrocytic events that occur upon their exposure to silver nanoparticles whose dimensions are larger than the typical pore size in a human RBC membrane. The mechanism of nanoparticle cytotoxicity we discuss in the context of our findings with human erythrocytes may also be applicable to any other non-phagocytic cell.

Materials and Methods

Intravenous blood was drawn from healthy, informed volunteers through venipuncture in an EDTA coated vacutainer after obtaining written, informed consent. Ethical approval for the project on “Development of Raman Tweezers for studies on human red blood cells” and, explicitly to draw blood from informed volunteers for this project, was obtained from the University Ethics Committee, Manipal University, on 11 December 2008 (Ref. UEC/35/2008) and renewed on 14th January 2012 (Ref. UEC/Renewal-07/2012). The non-coagulated whole blood was centrifuged at 3000 rpm for 5 minutes to discard the plasma. 100 µl of this blood was diluted in 4 ml of complete RPMI 1640 (RPMI+10% BSA) medium. The RBC suspension was treated with 1 µl, 5 µl and 10 µl of AgNO₃ nanoparticles. The AgNO₃ nanoparticles used in this study were commercially procured (Sigma-Aldrich, India) with specified average particle size of ∼100 nm. The control RBC suspension and NP-treated suspension (maintained in different culture wells) were incubated at 37°C with 5% CO₂ for 45 hours. Both the incubated samples were further diluted with phosphate buffered solution (PBS) for Raman Tweezers spectroscopy study. The Raman spectroscopy was performed 20 hours and 45 hours after incubation.

Micro-Raman spectroscopy of incubated control and Ag NP-treated RBCs was performed using a home-built, single-beam Raman Tweezers set-up. Our set-up uses a tightly-focused 785 nm wavelength laser beam (from a Starbright Diode Laser) to simultaneously trap and excite live RBCs suspended in a biological medium. The tight focusing of our laser beam is achieved using a high numerical aperture (1.3 NA), 100X oil immersion microscope objective of a Nikon Eclipse Ti-U microscope with supportive optics. The scattered Raman signals are directed towards a Horiba JobinYvon Spectrometer equipped with a 1200 gr/mm holographic grating. A Symphony CCD detector is utilized to collect the Raman spectra of trapped cells. The complete system design, specifications, and performance have been discussed elsewhere [21], [22].

The Raman shifts recorded in the present series of experiments were in the 450–1800 cm⁻¹ range. Typical resolution was 5.7 cm⁻¹ and the accuracy with which spectral lines were identified was ±3 cm⁻¹ (0.2 nm).

Results and Discussion

Figure 2 and Figure 3 show typical (average) Raman spectra from Control and Ag NP treated RBCs recorded after 20 hours and 45 hours of incubation, respectively. We carried out frequency assignments of the recorded spectra based on the notation system used by Abe et al. [23] and Hu et al. [24], with some additional assignments from Parker [25]. Detailed Raman frequency assignments of a typical Raman spectrum from erythrocytes recorded by our set-up have been listed elsewhere recently [21]. Raman tweezers spectroscopy performed after 20 hours of incubation showed no significant spectral alterations between control RBCs and Ag NP-treated RBCs. On the other hand, Raman tweezers spectroscopy performed after an incubation period of 45 hours did show significant changes in the Raman spectra of 5 µl and 10 µl Ag NP treated RBCs compared to those of control RBCs, whereas 1 µl treated RBC spectra showed no difference.

Download:

Figure 2. The average spectra of control and Ag NP treated RBCs 20-incubation: (A) Control, (B) with 5 µl Ag NPs, and (C) with 10 µl Ag NPs.

https://doi.org/10.1371/journal.pone.0103493.g002

Download:

Figure 3. The average spectra of control and Ag NP treated RBCs 45-incubation.

(A) Control, (B) 1 µl Ag NPs, (C) 5 µl Ag NPs, and (D) 10 µl Ag NPs.

https://doi.org/10.1371/journal.pone.0103493.g003

In Figure 2, the Control spectrum is an average of 5 spectra, each measured from 5 control RBCs; the 1 µl Ag NP spectrum is an average of 4 spectra from four Ag NP (1 µl) treated RBCs; the 5 µl Ag NP spectrum is an average of 10 spectra from 10 Ag NP (5 µl) treated RBCs; and the 10 µl Ag NP spectrum is an average of 5 spectra from 5 Ag NP (10 µl) treated RBCs. In Figure 3, the Control and 1 µl Ag NP spectra are an average of 15 spectra, each measured from 15 control RBCs and 15 Ag NP (1 µl) treated RBCs, whereas the 5 µl Ag NP spectrum is an average of 5 spectra from 5 Ag NP (5 µl) treated RBCs; the 10 µl Ag NP spectrum is an average of 8 spectra from 8 Ag NP (10 µl) treated RBCs.

The major changes that we observe between the average spectra of control and Ag NP (5 µl and 10 µl) treated RBCs are in the vibrations related to Fe-O₂ stretching [ν(Fe-O₂)] at 565 cm⁻¹, pyrrole half-ring stretching [ν(pyr half-ring)_sym] at 1370 cm⁻¹, pyrrole deformation mode [δ(pyr deform)_sym] at 675 cm⁻¹, venyl deformation mode [δ( = C_bH₂)₄] at 1028 cm⁻¹, the asymmetric stretching mode [ν(C_αC_m)_asym] at 1635 cm⁻¹, the skeletal stretching modes [ν(C_βC_β)] at 1520 cm⁻¹, 1545 cm⁻¹ and 1603 cm⁻¹ and finally, the methine C-H deformations [δ(C_mH)] at 1211 cm⁻¹ and 1224 cm⁻¹.

We observe that the intensity of the Raman peak at 1211 cm⁻¹ increases whereas that at 1224 cm⁻¹ decreases in the spectra of 5 µl and 10 µl Ag NP treated RBCs compared to those in control RBC spectra. Both the peaks concurrently originate from the methine ( = C_mH−) C-H deformation (ν₁₃) in hemes and are sensitive to the deformation angle of the methine group. Figure 4B shows the overlaid plot of the average spectra from control and Ag NP treated RBCs in the methine C-H deformation region. A conformational change of hemoglobin brings methine C-H vibrations close to the protein subunits and this influences a change in the deformation angle of C-H vibrations [26]. As a result the C-H vibrational frequency in that heme molecule shifts from 1224 cm⁻¹ to 1211 cm⁻¹. In the Raman spectra of an RBC, this is reflected by a decrease in intensity of the 1224 cm⁻¹ peak and concurrent increase in that of the 1211 cm⁻¹ peak. Wood et al. [26] have suggested that such frequency shifts represent conformational changes in heme that occur during its transition from the deoxygenated state to the oxygenated state. Hence, inside the nanoparticle treated RBCs most of the Hb molecules are permanently modified to the T-state whereas inside control RBCs more of the Hb molecules exist in the R-state. It is evident from our observations that the nanoparticles are blocking the membrane transport channels and thereby, reducing the oxygen binding affinity of hemoglobin through increase in H⁺ concentration. In the T state of hemoglobin the C-terminal histidine (His HC3) of the β-subunits participate in the formation of ion pairs with Asp FG1 [27] and the proximity to Asp FG1 gives His HC3 a higher pKa than normal, so it is protonated. In other words, the lower pH (higher H⁺) stabilizes the T-state of hemoglobin. Ion pairs that stabilize the T state of deoxy-hemoglobin must break to form the R state, which is not expected to happen at lower intracellular pH. There are many reports on nanomaterials-cell interaction studies where nanoparticles act as membrane channel blockers [28], [29]. Bhabra et al. [30] reported that cobalt–chromium nanoparticles induced DNA damage in human fibroblast cells without physically crossing the cell membrane. These studies support our hypothesis on the indirect effect of Ag NPs on hemoglobin stability.

Download:

Figure 4. Interpolated plot of control and Ag NP treated RBCs 45-incubation in the A) Fe-O₂ stretching region, B) methine C-H deformation region, C) pyrrole half ring symmetric stretching region, and D) skeletal mode region.

https://doi.org/10.1371/journal.pone.0103493.g004

Significant changes have been observed in the well-known spin-state marker region (1500–1650 cm⁻¹) of heme. The increase in intensity of other T-state marker peaks located at 1520 cm⁻¹, 1545 cm⁻¹, and 1603 cm⁻¹, corresponding to the C_βC_β skeletal stretching modes in the spectra of 5 µl and 10 µl Ag NP treated RBCs, indicates the presence of more deoxy hemes in these samples [26], [31]. Furthermore, the decrease in intensity of the R-state marker peak at 1635 cm⁻¹, corresponding to ν(C_αC_m)_asym in the spectra of 5 µl and 10 µl Ag NP treated RBCs, is an indication of the formation of deoxy hemoglobin, as suggested earlier [26], [31]. Figure 4D shows the overlaid plots of average spectra from control and Ag NP treated RBCs in the spin-state marker region.

It is also clear from Fig. 4D that the 1520 cm⁻¹ and 1545 cm⁻¹ peaks show a frequency downshift of ∼3 cm⁻¹ while the peak at 1603 cm⁻¹ shows a frequency upshift of ∼4 cm⁻¹ in the spectra of NP-treated RBCs. This decrease/increase in frequency of skeletal C-C stretching may be influenced by the pull of pyrrole –N terminal by Fe.

Another noteworthy feature of our study is the dramatic decrease in intensity of the well-established marker peak for heme bound O₂, the Fe-O₂ stretching mode (565 cm⁻¹) in 5 µl and 10 µl Ag NP-treated RBCs spectra. This confirms our view that Ag NP induced distortions in the RBC membrane have permanently transformed most of the hemoglobin molecules in it into the deoxy state [22]. Figure 4A shows the overlaid plots of the average spectra from control and Ag NP-treated RBCs in the low frequency region. As expected, the Fe-O₂ peak is also prominent in the average spectra of Control and Ag-treated RBCs recorded after 20 hours of incubation (see Fig. 2), indicating that the Ag NPs have not affected the hemoglobin in this time frame.

On the other hand, the Raman peaks from heme, located at 675 cm⁻¹ - which correspond to pyrrole deformation - and at 1370 cm⁻¹ - which correspond to pyrrole half-ring symmetric bending - show intensity enhancement in the spectra of 5 µl and 10 µl Ag NP-treated RBCs. Figure 4C shows the overlaid plot of the average spectra from control and Ag NP treated RBCs in the pyrrole half-ring symmetric bending region. The increase in intensity of these peaks can be attributed to the increased exposure of contributing bonds to the excitation photons. In the T (deoxy) state of hemoglobin, the Fe-ion is pulled out of the heme plane toward the histidine residue to which it is attached and, as a result, the heme is exposed out of the protein subunits. Hence in the T state, the pyrrole skeleton is more exposed to the photons compared to that in the R state.

The 785 nm excited Raman spectra of RBCs are also rich in the vibrations that originate from protein subunits of hemoglobin. The relative intensities of the peaks at 999 cm⁻¹, 1449 cm⁻¹ and 1650 cm⁻¹, attributed to phenylalanine, CH₂/CH₃ deformation in amino acid side chains and amide I, respectively, show some difference between spectra of control and Ag NP-treated RBCs.

The enhancement in the intensity of specific vibrations in deoxyhemoglobin with 785 nm excitation is a matter of concern. Eaton et al. [32] reported both experimental and theoretical analyses of optical spectra of heme moieties in oxygenated and deoxygenated hemoglobin and observed that deoxyhemoglobin exhibits a weak charge transfer band III around 760 nm whereas oxyhemoglobin displays a broad band centered at 925 nm. The extinction coefficients of oxyhemoglobin and deoxyhemoglobin have a isosbestic point at 805 nm and this is the basis for near-infrared spectroscopy (NIRS) applications in monitoring the changes in oxygenated and deoxygenated hemoglobin concentration in organs like the brain [33]–[36]. The work reported by Wood et al. [26] supported the intensity enhancements observed in oxyhemoglobin and deoxyhemoglobin excited at 785 nm by considering the effects of vibronic coupling of charge transfer band III and band IV with Soret band through a low-frequency vibrational mode of B_1g symmetry. The enhancement phenomena through the coupling of band III assigned to transition by Eaton et al. [32] and the Soret band was rationalized by Franzen et al. [37]. A thorough analysis of mode specific resonance enhancements in functional hemoglobin of a live RBC has to be performed to understand the underlying mechanism for the drastic change in vibrational peak intensities of oxy- and deoxy-hemoglobin. The data gathered from such studies will help one to deduce the related conformational changes that occur during oxygenation and deoxygenation of hemoglobin in functional erythrocytes and related disorders.

We carried out principal component analysis (PCA) to statistically differentiate the micro-Raman spectra of control and Ag NP treated cells 20 hours and 45 hours post-incubation. PCA was performed separately on a total of 24 spectra recorded 20 hours post-incubation and on 43 spectra recorded 45 hours post-incubation. Figures 5, 6 show our PCA results for 20 hours post-incubation and 45 hours post-incubation, respectively. It is clear from Fig. 5 that there is no clear discrimination between the Raman spectra of control and Ag NP treated RBCs: in both the left and right panels the data is seen to be spread out and interspersed. This is also evident from Fig. 2, where the average spectra do not show any changes. On the other hand Fig. 6 (45 hours post-incubation) shows a clear difference between two classes: control and 1 µl as one class and 5 µl and 10 µl as another class. In this case we note that the first factor itself defines the data well, with more than 62% variance among the spectra. The left panel in Fig. 6 shows a plot of sample number versus scores of factor 1. It is clear from the plot that most of the control and 1 µl Ag NP treated spectra have positive scores and all the spectra of cells treated with 5 µl Ag NP and 10 µl Ag NP have negative scores. The right panel of Fig. 6 shows the plot between scores of first factor and the scores of second factor. This plot clearly shows that most of the control and 1 µl Ag NP treated samples lie in the first and fourth quadrants while almost all 5 µl Ag NP and 10 µl Ag NP samples lie in the second and third quadrants. These results constitute clear supporting evidence for the peak intensity variations that we presented in Figs. 3, 4.

Download:

Figure 5. PCA results for Raman spectra of control and Ag NP treated RBCs after 20 hours of incubation.

The left panel shows sample number versus scores for PCA factor 1 and the right panel depicts scores of factor 1 versus scores of factor 2.

https://doi.org/10.1371/journal.pone.0103493.g005

Download:

Figure 6. PCA results for Raman spectra of control and Ag NP treated RBCs after 45 hours of incubation.

The left panel shows sample number versus scores for PCA factor 1 and the right panel depicts scores of factor 1 versus scores of factor 2.

https://doi.org/10.1371/journal.pone.0103493.g006

The PC 1 (F1) loadings plots presented in Fig. 7 enable some insight into the spectral changes that characterize indirect effect of Ag NPs on the conformation and dynamics of hemoglobin in functional erythrocytes. The right panel of Fig. 7 (after 45 hours of incubation) shows a clear discrimination between the Raman peaks associated with the oxygenated state of hemoglobin (565 cm⁻¹, 1223 cm⁻¹ and 1635 cm⁻¹) in control RBCs and the deoxygenated state (672 cm⁻¹, 1211 cm⁻¹, 1370 cm⁻¹, 1515 cm⁻¹, 1540 cm⁻¹ and 1608 cm⁻¹) of hemoglobin in Ag NP (5 µl and 10 µl) treated RBCs. On the other hand, the left panel of Fig. 7 (after 20 hours of incubation) indicates no visible difference among two groups of the spectra except for small cell-to-cell variations. The PC1 loadings plot for 45 hours post incubation also shows the splitting of the band corresponding to the B_1g mode at 753 cm⁻¹ into two peaks: at 749 cm⁻¹ for pyrrole deformation (ν₁₆) and at 756 cm⁻¹ for pyrrole breathing (ν₁₅).

Download:

Figure 7. Plot of PC1 (F1) loadings for control and Ag NP-treated RBC spectra after 20 hour (left) and 45 hours (right) of incubation.

https://doi.org/10.1371/journal.pone.0103493.g007

We also recorded the Raman spectra of RBC at different trapping/excitation powers (at 785 nm) to check the power dependent variations in the spectrum. All the 6 spectra shown in Fig. 8 were recorded from 6 different RBCs that were trapped and Raman excited at different laser powers. In all our studies, the present experiments as well as those reported earlier [21], [22], [38]–[40], the powers levels mentioned by us are those at the sample, after microscope objective (100X), measured using an integrating sphere. It is clear from Fig. 8 that significant changes in the spectra are only observed at excitation power levels in excess of 15 mW: there are no obvious changes till 12 mW of power, as shown in Fig. 8 (C–F). The Raman spectra at 15 mW and 20 mW of power show a series of changes in the spectral features: a total of 4 new peaks appear at 662 cm⁻¹, 1249 cm⁻¹, 1389 cm⁻¹ and 1577 cm⁻¹ while peaks at 973 cm⁻¹ and 1370 cm⁻¹, which were already present in the low power spectra, show dramatic increase in intensity. The peaks at 662 cm⁻¹, 973 cm⁻¹, 1249 cm⁻¹, 1370 cm⁻¹, and 1389 cm⁻¹ are identified as heme aggregation markers [41]. Apart from these changes, the venyl mode (ν₁₀) at 1636 cm⁻¹ and the amide I band at 1771 cm⁻¹ both show the expected power-dependent decrease in intensity. The amide I band is almost missing in the Raman spectra at 15 mW and 20 mW excitation powers, suggesting photo-induced dissociation of polypeptide bonds in proteins. The better resolution spectra recorded in the present experiments establish that, even at high power, the intensity of the 1211 cm⁻¹ peak is less than that of the 1224 cm⁻¹ peak, and that the appearance of the 1249 cm⁻¹ peak does not mask the 1224 cm⁻¹ peak.

Download:

Figure 8. Power dependent Raman spectra of single, live RBCs.

The incident power levels were A) 20 mW, B) 15 mW, C) 12 mW, D) 10 mW, E) 5 mW, and F) 4 mW.

https://doi.org/10.1371/journal.pone.0103493.g008

The 662 cm⁻¹ peak appears as a shoulder to the 674 cm⁻¹ peak corresponding to pyrrole deformation. At 20 mW, a peak at 668 cm⁻¹ also accompanies the 662 cm⁻¹ peak. The pyrrole deformation (ν₁₆) peak appears at 747 cm⁻¹ as a shoulder to the 753 cm⁻¹ peak and the 1577 cm⁻¹ peak appears as a shoulder peak to the already present 1583 cm⁻¹ peak of ν₃₇ mode.

Ahlawat et al. [42] studied the 1064 nm laser beam induced changes in the RBC spectra and observed increase in the intensity of 1547 cm⁻¹ and 1212 cm⁻¹ along with a concomitant decrease in intensity of peaks at 1224 cm⁻¹ and 1620 cm⁻¹ which are reversible up to the trapping power of 20 mW at 1064 nm. As we know that the photo-induced cell damage is wavelength dependent and decreases as we move towards the infrared region, the damage threshold is more in the case of the 1064 nm laser beam.

On the basis of our power-dependent measurements it is possible to be certain that the spectral changes observed in the Ag NP-treated RBCs, including the intensity flipping of the peaks at 1211 cm⁻¹ and 1224 cm⁻¹, are not photo-induced. The power levels that are used to record the Raman spectra of control and Ag NP-treated cells are well below the threshold for occurrence of photo-dissociation and/or heme aggregation. Hence, the spectral changes presented by us in Figs. 3, 4 are entirely ascribable to Ag NP-induced changes in the heme conformations.

Summary

The information collected by us using Raman tweezers spectroscopy on single, live erythrocytes exposed to the influence of silver nanoparticles (of diameter >100 nm) has revealed that Ag NPs induce irreversible modifications in the heme's conformation through a transformation from the R-state (oxy state) to the T-state (deoxy state). We rationalize our observations by proposing a model for the nanoparticle cytotoxicity pathway when NP's size is larger than the membrane pore size. Specifically, we propose that the Ag NPs interact with the cell surface in such manner that induces damage to the heme molecule in the RBC due to the alteration of intracellular pH caused by the blockage of cell membrane transport.

Author Contributions

Conceived and designed the experiments: AB SC DM. Performed the experiments: AB SB. Analyzed the data: AB SB SC DM. Contributed reagents/materials/analysis tools: AB SB SC DM. Wrote the paper: AB SB SC DM.

References

1. Lara HH, Garza-Treviño EN, Ixtepan-Turrent L, Singh DK (2011) Silver nanoparticles are broad-spectrum bactericidal and virucidal compounds. J. Nanobiotechnol 9: 30.
- View Article
- Google Scholar
2. Project on Emerging Nanotechnologies (2014). Consumer Products Inventory.
3. Ahamed M, Karns M, Goodson M, Rowe J, Hussain SM, et al. (2008) DNA damage response to different surface chemistry of silver nanoparticles in mammalian cells. Toxicol. Appl. Pharmacol 233: 404–410.
- View Article
- Google Scholar
4. Unfried K, Albrecht C, Klotz L-O, Von Mikecz A, Grether-Beck S, et al. (2007) Cellular responses to nanoparticles: Target structures and mechanisms. Nanotoxicol 1: 52–71.
- View Article
- Google Scholar
5. Wang T, Bai J, Jiang X, Nienhaus GU (2012) Cellular Uptake of Nanoparticles by Membrane Penetration: A Study Combining Confocal Microscopy with FTIR Spectroelectrochemistry. ACS Nano 6: 1251–1259.
- View Article
- Google Scholar
6. Simko M, Fiedeler U, Gazso A, Nentwich M (2011) The impact of nanoparticles on cellular functions. NanoTrust-Dossier. epub.oeaw.ac.at/ita/nanotrust-dossiers: Austrian Academy of Sciences, Austria.
7. Brazhe NA, Abdali S, Brazhe AR, Luneva OG, Bryzgalova NY, et al. (2009) New insight into erythrocyte through in vivo surface-enhanced Raman spectroscopy. Biophys. J 97: 3206–3214.
- View Article
- Google Scholar
8. Liu W, Wu Y, Wang C, Li HC, Wang T, et al. (2010) Impact of silver nanoparticles on human cells: effect of particle size. Nanotoxicol 4: 319–330.
- View Article
- Google Scholar
9. AshaRani P, Low Kah Mun G, Hande MP, Valiyaveettil S (2008) Cytotoxicity and genotoxicity of silver nanoparticles in human cells. ACS Nano 3: 279–290.
- View Article
- Google Scholar
10. Bragg P, Rainnie D (1974) The effect of silver ions on the respiratory chain of Escherichia coli. Canadian J. Microbiol 20: 883–889.
- View Article
- Google Scholar
11. Friedrich T (1998) The NADH:ubiquinone oxidoreductase (complex I) from Escherichia coli. Biochim. Biophys. Acta - Bioenergetics 1364: 134–146.
- View Article
- Google Scholar
12. Eylar EH, Madoff MA, Brody O, Oncley J (1962) The contribution of sialic acid to the surface charge of the erythrocyte. J. Biol. Chem 237: 1992–2000.
- View Article
- Google Scholar
13. Jan K-M, Chien S (1973) Role of surface electric charge in red blood cell interactions. J. Gen. Physiol 61: 638–654.
- View Article
- Google Scholar
14. Zhang Y, Yang M, Portney NG, Cui D, Budak G, et al. (2008) Zeta potential: a surface electrical characteristic to probe the interaction of nanoparticles with normal and cancer human breast epithelial cells. Biomed. Microdevices 10: 321–328.
- View Article
- Google Scholar
15. Lehninger AL, Nelson DL, Cox MM (2005) Principles of Biochemistry: W. H. Freeman, New York.
16. Orlowski J, Grinstein S (1997) Na+/H+ exchangers of mammalian cells. J. Biol. Chem 272: 22373–22376.
- View Article
- Google Scholar
17. Mahnensmith RL, Aronson PS (1985) The plasma membrane sodium-hydrogen exchanger and its role in physiological and pathophysiological processes. Circulation Res 56: 773–788.
- View Article
- Google Scholar
18. Reidy B, Haase A, Luch A, Dawson K, Lynch I (2013) Mechanisms of Silver Nanoparticle Release, Transformation and Toxicity: A Critical Review of Current Knowledge and Recommendations for Future Studies and Applications. Materials 6: 2295–2350.
- View Article
- Google Scholar
19. Matzke M, Jurkschat K, Backhaus T (2013) Toxicity of differently sized and coated silver nanoparticles to the bacterium Pseudomonas putida. PeerJ PrePrints 1: e26v21.
- View Article
- Google Scholar
20. Newton KM, Puppala HL, Kitchens CL, Colvin VL, Klaine SJ (2013) Silver nanoparticle toxicity to Daphnia magna is a function of dissolved silver concentration. Environ. Toxicol. Chem 32: 2356–2364.
- View Article
- Google Scholar
21. Bankapur A, Zachariah E, Chidangil S, Valiathan M, Mathur D (2010) Raman tweezers spectroscopy of live, single red and white blood cells. PLoS ONE 5: e10427.
- View Article
- Google Scholar
22. Zachariah E, Bankapur A, Santhosh C, Valiathan M, Mathur D (2010) Probing oxidative stress in single erythrocytes with Raman Tweezers. J. Photochem. Photobiol. B: Biology 100: 113–116.
- View Article
- Google Scholar
23. Abe M, Kitagawa T, Kyogoku Y (1978) Resonance Raman spectra of octaethylporphyrinato-Ni(II) and meso-deuterated and 15N substituted derivatives. II. A normal coordinate analysis. J. Chem. Phys 69: 4526–4534.
- View Article
- Google Scholar
24. Hu S, Smith KM, Spiro TG (1996) Assignment of protoheme resonance Raman spectrum by heme labeling in myoglobin. J Am Chem Soc 118: 12638–12646.
- View Article
- Google Scholar
25. Parker FS (1983) Applications of infrared, Raman, and resonance Raman spectroscopy in biochemistry: Springer, Berlin.
26. Wood BR, Caspers P, Puppels GJ, Pandiancherri S, McNaughton D (2007) Resonance Raman spectroscopy of red blood cells using near-infrared laser excitation. Anal. Bioanal. Chem 387: 1691–1703.
- View Article
- Google Scholar
27. Shih T-b, Jones R, Bonaventura J, Bonaventura C, Schneider R (1984) Involvement of His HC3 (146) beta in the Bohr effect of human hemoglobin. Studies of native and N-ethylmaleimide-treated hemoglobin A and hemoglobin Cowtown (beta 146 His replaced by Leu). J. Biol. Chem 259: 967–974.
- View Article
- Google Scholar
28. Park KH, Chhowalla M, Iqbal Z, Sesti F (2003) Single-walled carbon nanotubes are a new class of ion channel blockers. J. Biol. Chem 278: 50212–50216.
- View Article
- Google Scholar
29. Chin C, Kim IK, Lim DY, Kim KS, Lee HA, et al. (2009) Gold nanoparticle-choline complexes can block nicotinic acetylcholine receptors. Int. J. Nanomed 5: 315–321.
- View Article
- Google Scholar
30. Bhabra G, Sood A, Fisher B, Cartwright L, Saunders M, et al. (2009) Nanoparticles can cause DNA damage across a cellular barrier. Nature Nano 4: 876–883.
- View Article
- Google Scholar
31. Wood BR, Tait B, McNaughton D (2001) Micro-Raman characterisation of the R to T state transition of haemoglobin within a single living erythrocyte. Biochim. Biophys. Acta -Molecular Cell Research 1539: 58–70.
- View Article
- Google Scholar
32. Eaton WA, Hanson LK, Stephens PJ, Sutherland JC, Dunn JBR (1978) Optical spectra of oxy- and deoxyhemoglobin. J. Am. Chem. Soc 100: 4991–5003.
- View Article
- Google Scholar
33. Villringer A, Planck J, Hock C, Schleinkofer L, Dirnagl U (1993) Near infrared spectroscopy (NIRS): a new tool to study hemodynamic changes during activation of brain function in human adults. Neurosc. Lett 154: 101–104.
- View Article
- Google Scholar
34. Murkin J, Arango M (2009) Near-infrared spectroscopy as an index of brain and tissue oxygenation. British J. Anaesthesia 103: i3–i13.
- View Article
- Google Scholar
35. Hoshi Y, Tamura M (1993) Dynamic multichannel near-infrared optical imaging of human brain activity. J. Appl. Physiol 75: 1842–1842.
- View Article
- Google Scholar
36. Boas DA, Elwell CE, Ferrari M, Taga G (2014) Twenty years of functional near-infrared spectroscopy: introduction for the special issue. NeuroImage 85: 1–5.
- View Article
- Google Scholar
37. Franzen S, Wallace-Williams SE, Shreve AP (2002) Heme Charge-Transfer Band III Is Vibronically Coupled to the Soret Band. J. Am. Chem. Soc 124: 7146–7155.
- View Article
- Google Scholar
38. Bankapur A, Krishnamurthy RS, Zachariah E, Santhosh C, Chougule B, et al. (2012) Micro-Raman spectroscopy of silver nanoparticle induced stress on optically-trapped stem cells. PloS ONE 7: e35075.
- View Article
- Google Scholar
39. George SD, Ladiwala U, Thomas J, Bankapur A, Chidangil S, et al. (2014) Deposition and alignment of cells on laser-patterned quartz. Appl. Surf. Sc 305: 375–381.
- View Article
- Google Scholar
40. R. Sagar Krishnamurthy EZ, Aseefhali Bankapur, Chidangil Santhosh, Basavaraj Chougule, Bhavishna Praveen, Manna Valiathan, Mathur D (2011) Probing Zinc-Oxide Nano-Particle Induced Stress on Stem Cells Using Raman Tweezers. Biomedical Engineering: Narosa Publishing Pvt Ltd. Delhi, India. pp. 317–321.
41. Wood BR, Hammer L, Davis L, McNaughton D (2005) Raman microspectroscopy and imaging provides insights into heme aggregation and denaturation within human erythrocytes. J. Biomed. Opt 10: 014005–01400513.
- View Article
- Google Scholar
42. Ahlawat S, Kumar N, Dasgupta R, Verma RS, Uppal A, et al. (2013) Raman spectroscopic investigations on optical trap induced deoxygenation of red blood cells. Appl. Phys. Lett 103: 183704.
- View Article
- Google Scholar

[ref1] 1. Lara HH, Garza-Treviño EN, Ixtepan-Turrent L, Singh DK (2011) Silver nanoparticles are broad-spectrum bactericidal and virucidal compounds. J. Nanobiotechnol 9: 30.
View Article
Google Scholar

[2] View Article

[3] Google Scholar

[ref2] 2. Project on Emerging Nanotechnologies (2014). Consumer Products Inventory.

[ref3] 3. Ahamed M, Karns M, Goodson M, Rowe J, Hussain SM, et al. (2008) DNA damage response to different surface chemistry of silver nanoparticles in mammalian cells. Toxicol. Appl. Pharmacol 233: 404–410.
View Article
Google Scholar

[6] View Article

[7] Google Scholar

[ref4] 4. Unfried K, Albrecht C, Klotz L-O, Von Mikecz A, Grether-Beck S, et al. (2007) Cellular responses to nanoparticles: Target structures and mechanisms. Nanotoxicol 1: 52–71.
View Article
Google Scholar

[9] View Article

[10] Google Scholar

[ref5] 5. Wang T, Bai J, Jiang X, Nienhaus GU (2012) Cellular Uptake of Nanoparticles by Membrane Penetration: A Study Combining Confocal Microscopy with FTIR Spectroelectrochemistry. ACS Nano 6: 1251–1259.
View Article
Google Scholar

[12] View Article

[13] Google Scholar

[ref6] 6. Simko M, Fiedeler U, Gazso A, Nentwich M (2011) The impact of nanoparticles on cellular functions. NanoTrust-Dossier. epub.oeaw.ac.at/ita/nanotrust-dossiers: Austrian Academy of Sciences, Austria.

[ref7] 7. Brazhe NA, Abdali S, Brazhe AR, Luneva OG, Bryzgalova NY, et al. (2009) New insight into erythrocyte through in vivo surface-enhanced Raman spectroscopy. Biophys. J 97: 3206–3214.
View Article
Google Scholar

[16] View Article

[17] Google Scholar

[ref8] 8. Liu W, Wu Y, Wang C, Li HC, Wang T, et al. (2010) Impact of silver nanoparticles on human cells: effect of particle size. Nanotoxicol 4: 319–330.
View Article
Google Scholar

[19] View Article

[20] Google Scholar

[ref9] 9. AshaRani P, Low Kah Mun G, Hande MP, Valiyaveettil S (2008) Cytotoxicity and genotoxicity of silver nanoparticles in human cells. ACS Nano 3: 279–290.
View Article
Google Scholar

[22] View Article

[23] Google Scholar

[ref10] 10. Bragg P, Rainnie D (1974) The effect of silver ions on the respiratory chain of Escherichia coli. Canadian J. Microbiol 20: 883–889.
View Article
Google Scholar

[25] View Article

[26] Google Scholar

[ref11] 11. Friedrich T (1998) The NADH:ubiquinone oxidoreductase (complex I) from Escherichia coli. Biochim. Biophys. Acta - Bioenergetics 1364: 134–146.
View Article
Google Scholar

[28] View Article

[29] Google Scholar

[ref12] 12. Eylar EH, Madoff MA, Brody O, Oncley J (1962) The contribution of sialic acid to the surface charge of the erythrocyte. J. Biol. Chem 237: 1992–2000.
View Article
Google Scholar

[31] View Article

[32] Google Scholar

[ref13] 13. Jan K-M, Chien S (1973) Role of surface electric charge in red blood cell interactions. J. Gen. Physiol 61: 638–654.
View Article
Google Scholar

[34] View Article

[35] Google Scholar

[ref14] 14. Zhang Y, Yang M, Portney NG, Cui D, Budak G, et al. (2008) Zeta potential: a surface electrical characteristic to probe the interaction of nanoparticles with normal and cancer human breast epithelial cells. Biomed. Microdevices 10: 321–328.
View Article
Google Scholar

[37] View Article

[38] Google Scholar

[ref15] 15. Lehninger AL, Nelson DL, Cox MM (2005) Principles of Biochemistry: W. H. Freeman, New York.

[ref16] 16. Orlowski J, Grinstein S (1997) Na+/H+ exchangers of mammalian cells. J. Biol. Chem 272: 22373–22376.
View Article
Google Scholar

[41] View Article

[42] Google Scholar

[ref17] 17. Mahnensmith RL, Aronson PS (1985) The plasma membrane sodium-hydrogen exchanger and its role in physiological and pathophysiological processes. Circulation Res 56: 773–788.
View Article
Google Scholar

[44] View Article

[45] Google Scholar

[ref18] 18. Reidy B, Haase A, Luch A, Dawson K, Lynch I (2013) Mechanisms of Silver Nanoparticle Release, Transformation and Toxicity: A Critical Review of Current Knowledge and Recommendations for Future Studies and Applications. Materials 6: 2295–2350.
View Article
Google Scholar

[47] View Article

[48] Google Scholar

[ref19] 19. Matzke M, Jurkschat K, Backhaus T (2013) Toxicity of differently sized and coated silver nanoparticles to the bacterium Pseudomonas putida. PeerJ PrePrints 1: e26v21.
View Article
Google Scholar

[50] View Article

[51] Google Scholar

[ref20] 20. Newton KM, Puppala HL, Kitchens CL, Colvin VL, Klaine SJ (2013) Silver nanoparticle toxicity to Daphnia magna is a function of dissolved silver concentration. Environ. Toxicol. Chem 32: 2356–2364.
View Article
Google Scholar

[53] View Article

[54] Google Scholar

[ref21] 21. Bankapur A, Zachariah E, Chidangil S, Valiathan M, Mathur D (2010) Raman tweezers spectroscopy of live, single red and white blood cells. PLoS ONE 5: e10427.
View Article
Google Scholar

[56] View Article

[57] Google Scholar

[ref22] 22. Zachariah E, Bankapur A, Santhosh C, Valiathan M, Mathur D (2010) Probing oxidative stress in single erythrocytes with Raman Tweezers. J. Photochem. Photobiol. B: Biology 100: 113–116.
View Article
Google Scholar

[59] View Article

[60] Google Scholar

[ref23] 23. Abe M, Kitagawa T, Kyogoku Y (1978) Resonance Raman spectra of octaethylporphyrinato-Ni(II) and meso-deuterated and 15N substituted derivatives. II. A normal coordinate analysis. J. Chem. Phys 69: 4526–4534.
View Article
Google Scholar

[62] View Article

[63] Google Scholar

[ref24] 24. Hu S, Smith KM, Spiro TG (1996) Assignment of protoheme resonance Raman spectrum by heme labeling in myoglobin. J Am Chem Soc 118: 12638–12646.
View Article
Google Scholar

[65] View Article

[66] Google Scholar

[ref25] 25. Parker FS (1983) Applications of infrared, Raman, and resonance Raman spectroscopy in biochemistry: Springer, Berlin.

[ref26] 26. Wood BR, Caspers P, Puppels GJ, Pandiancherri S, McNaughton D (2007) Resonance Raman spectroscopy of red blood cells using near-infrared laser excitation. Anal. Bioanal. Chem 387: 1691–1703.
View Article
Google Scholar

[69] View Article

[70] Google Scholar

[ref27] 27. Shih T-b, Jones R, Bonaventura J, Bonaventura C, Schneider R (1984) Involvement of His HC3 (146) beta in the Bohr effect of human hemoglobin. Studies of native and N-ethylmaleimide-treated hemoglobin A and hemoglobin Cowtown (beta 146 His replaced by Leu). J. Biol. Chem 259: 967–974.
View Article
Google Scholar

[72] View Article

[73] Google Scholar

[ref28] 28. Park KH, Chhowalla M, Iqbal Z, Sesti F (2003) Single-walled carbon nanotubes are a new class of ion channel blockers. J. Biol. Chem 278: 50212–50216.
View Article
Google Scholar

[75] View Article

[76] Google Scholar

[ref29] 29. Chin C, Kim IK, Lim DY, Kim KS, Lee HA, et al. (2009) Gold nanoparticle-choline complexes can block nicotinic acetylcholine receptors. Int. J. Nanomed 5: 315–321.
View Article
Google Scholar

[78] View Article

[79] Google Scholar

[ref30] 30. Bhabra G, Sood A, Fisher B, Cartwright L, Saunders M, et al. (2009) Nanoparticles can cause DNA damage across a cellular barrier. Nature Nano 4: 876–883.
View Article
Google Scholar

[81] View Article

[82] Google Scholar

[ref31] 31. Wood BR, Tait B, McNaughton D (2001) Micro-Raman characterisation of the R to T state transition of haemoglobin within a single living erythrocyte. Biochim. Biophys. Acta -Molecular Cell Research 1539: 58–70.
View Article
Google Scholar

[84] View Article

[85] Google Scholar

[ref32] 32. Eaton WA, Hanson LK, Stephens PJ, Sutherland JC, Dunn JBR (1978) Optical spectra of oxy- and deoxyhemoglobin. J. Am. Chem. Soc 100: 4991–5003.
View Article
Google Scholar

[87] View Article

[88] Google Scholar

[ref33] 33. Villringer A, Planck J, Hock C, Schleinkofer L, Dirnagl U (1993) Near infrared spectroscopy (NIRS): a new tool to study hemodynamic changes during activation of brain function in human adults. Neurosc. Lett 154: 101–104.
View Article
Google Scholar

[90] View Article

[91] Google Scholar

[ref34] 34. Murkin J, Arango M (2009) Near-infrared spectroscopy as an index of brain and tissue oxygenation. British J. Anaesthesia 103: i3–i13.
View Article
Google Scholar

[93] View Article

[94] Google Scholar

[ref35] 35. Hoshi Y, Tamura M (1993) Dynamic multichannel near-infrared optical imaging of human brain activity. J. Appl. Physiol 75: 1842–1842.
View Article
Google Scholar

[96] View Article

[97] Google Scholar

[ref36] 36. Boas DA, Elwell CE, Ferrari M, Taga G (2014) Twenty years of functional near-infrared spectroscopy: introduction for the special issue. NeuroImage 85: 1–5.
View Article
Google Scholar

[99] View Article

[100] Google Scholar

[ref37] 37. Franzen S, Wallace-Williams SE, Shreve AP (2002) Heme Charge-Transfer Band III Is Vibronically Coupled to the Soret Band. J. Am. Chem. Soc 124: 7146–7155.
View Article
Google Scholar

[102] View Article

[103] Google Scholar

[ref38] 38. Bankapur A, Krishnamurthy RS, Zachariah E, Santhosh C, Chougule B, et al. (2012) Micro-Raman spectroscopy of silver nanoparticle induced stress on optically-trapped stem cells. PloS ONE 7: e35075.
View Article
Google Scholar

[105] View Article

[106] Google Scholar

[ref39] 39. George SD, Ladiwala U, Thomas J, Bankapur A, Chidangil S, et al. (2014) Deposition and alignment of cells on laser-patterned quartz. Appl. Surf. Sc 305: 375–381.
View Article
Google Scholar

[108] View Article

[109] Google Scholar

[ref40] 40. R. Sagar Krishnamurthy EZ, Aseefhali Bankapur, Chidangil Santhosh, Basavaraj Chougule, Bhavishna Praveen, Manna Valiathan, Mathur D (2011) Probing Zinc-Oxide Nano-Particle Induced Stress on Stem Cells Using Raman Tweezers. Biomedical Engineering: Narosa Publishing Pvt Ltd. Delhi, India. pp. 317–321.

[ref41] 41. Wood BR, Hammer L, Davis L, McNaughton D (2005) Raman microspectroscopy and imaging provides insights into heme aggregation and denaturation within human erythrocytes. J. Biomed. Opt 10: 014005–01400513.
View Article
Google Scholar

[112] View Article

[113] Google Scholar

[ref42] 42. Ahlawat S, Kumar N, Dasgupta R, Verma RS, Uppal A, et al. (2013) Raman spectroscopic investigations on optical trap induced deoxygenation of red blood cells. Appl. Phys. Lett 103: 183704.
View Article
Google Scholar

[115] View Article

[116] Google Scholar