Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Food consumption and food exchange of caged honey bees using a radioactive labelled sugar solution

Abstract

We measured the distribution of sugar solution within groups of caged honey bees (Apis mellifera) under standard in vitro laboratory conditions using 14C polyethylene glycol as a radioactive marker to analyze ingestion by individual bees after group feeding. We studied the impact of different experimental setups by varying the number of bees, age of bees, origin of bees, duration of experiment, the amount of available diet, and the influence of the neurotoxic pesticide imidacloprid in the diet on the feeding and food sharing behavior (trophallaxis). Sugar solution was non-uniformly distributed in bees in 36 out of 135 cages. As a measure of the extent to which the sugar diet was equally distributed between caged bees, we calculated the (inner 80%) intake ratio by dividing the intake of the 90th percentile bee by the intake of the 10th percentile bee. This intake ratio ranged from 1.3 to 94.8 in 133 individual cages, further supporting a non-uniform distribution of food among caged bees. We can expect a cage with 10 or 30 bees containing one bee that ingests, on average, the 8.8-fold of the bee in the same cage ingesting the smallest quantity of food. Inner 80% intake ratios were lower in experiments with a permanent or chronic offering of labelled sugar solution compared to temporary or acute feedings. After pooling the data of replicates to achieve a higher statistical power we compared different experimental setups. We found that uniform food distribution is best approached with 10 newly emerged bees per cage, which originate from a brood comb from a single colony. We also investigated the trophallaxis between caged honey bees which originally consumed the diet and newly added bees. Color marked bees were starved and added to the cages in a ratio of 10:5 or 20:20 after the initial set of bees consumed all the labelled sugar solution. The distribution of the labelled sugar solution by trophallaxis within 48 hours to added bees was 25% (10:5) or 45% (20:20) of the initial sugar solution. Imidacloprid at its median lethal dose (LD50) in the sugar solution reduced this post-feeding food transmission to 27% (20:20). Our results show that differences in food intake exist within caged bees that may lead to differential exposure that can influence the interpretation of toxicity tests.

Introduction

Exposure to insecticidal pesticides is among other stress factors like parasitic mites, pathogens, poor hive management, loss of foraging habitat, and/or poor nutrition thought to be associated with declines in honey bee health or outright losses of honey bee colonies [18]. Effects of pesticides on honey bees are studied in vivo at the colony level in field or semi-field studies, and are studied in vitro using small groups of bees or individual bees under laboratory conditions [9, 10]. For oral toxicity testing, individual bees may be exposed to liquid diets by a single feeding method [11] or a number of caged bees is fed simultaneously by the group feeding method [10] which is the most commonly used method for experiments with pesticides and pathogens. The latter test assumes uniform distribution of food among caged honey bees and that trophallaxis plays an important role in distributing food and hence the test substance.

Trophallaxis (exchange of liquids between colony members) is a common and important interaction in social insects [12, 13]. The flow of nutrients among bees can be observed by the addition of a radioactive tracer to the food [1416]. For example, six forager bees transferred 32P labelled sugar water to 62% of the foragers and 20% of the total worker population of a honey bee colony within 4 hours [17]. The age of bees involved in active and passive trophallaxis is of interest considering the age-related division of labor of honey bees. Free [18] observed in hive experiments that bees of all ages feed nest mates of all ages. He found a preference of bees feeding similar ages except for newly emerged bees and one day old bees, which received rather than provided food. Honey bees of one age class are found in same nest areas, increasing their probability for trophallactic interactions [13]. In contrast to colony experiments, Moritz and Hallmen [19] found in cage experiments that one day old bees and bees between 15 and 20 days old were most active donors; whereas, bees between 5 and 8 days old showed low trophallactic activity. Pershad [20] showed in cage experiments that 4 day old bees fed other bees more often than 8 day old bees. Reasons for the discrepancy in these results might be, besides the age of the recipients, caused by genetic relatedness to the donors and the filling of their honey stomachs [13], the group size [20] and disturbance in behavior caused by different experimental designs [13,10].

Besides data from behavioral observations, little is known about the efficiency of food distribution of caged honey bees. For example, infection with Nosema spp. has been found to be unequally distributed among honey bees after group feeding of a spore containing sugar solution [21]. Experiments with caged bees hence imply the risk that some bees consume more of a sugar solution diet with dissolved test substances or pathogen in it than others which could have implications on toxicity assessment in laboratory studies [22]. Standard methods and regulations for group feeding have so far not been evaluated for uniform food distribution [9, 23]. In this study, we therefore tested if honey bees distribute a sugar solution diet uniformly among caged individuals. In a series of experiments, we investigated the food consumption, trophallaxis, and the distribution of sugar solution among caged honey bees. We temporarily or permanently offered a sugar solution labelled with 14C polyethylene glycol (PEG) to a group of bees. In addition, we examined if the neonicotinoid pesticide imidacloprid (in acute and chronic testing conditions) has an impact on trophallaxis among caged honey bees, which could further affect exposure during in vitro toxicity studies. Moreover we measured the extent of trophallactic distribution of food solution in cages, by adding marked bees to cages after the original bees consumed all labelled sugar solution.

Material and methods

Experiments were carried out from July to September 2014 using A. mellifera carnica from colonies of the institute of zoology. Since A. mellifera is not a protected species, no specific permission was required to perform the study. Experimental cages were modified 200 mL plastic cups [24]. Due to possible radioactive contaminations during the experiments, all cages were used once and then discarded. For different research questions, we used 10 to 40 bees per cage. Before each experiment, bees were starved up to two hours as specified in the OECD guidelines for the testing of chemicals No. 213 [23]. During starvation period dead bees were replaced before applying different experimental feeding regimes (temporary, permanent, acute or chronic) and caging conditions.

Feeding regimes

For “temporary feeding” bees received a defined amount of 14C PEG sugar solution once at the start of the experiment, which was then followed by unlabelled food for maintenance. Under “permanent feeding” regimes, bees had ad libitum access to 14C PEG labelled sugar solution throughout the whole experiment. For “acute feeding” bees received 100 μL of a labelled sugar solution containing imidacloprid once at initial feeding followed by unlabelled food without imidacloprid for maintenance. During “chronic feeding” bees had ad libitum access to a labelled sugar solution with imidacloprid.

Radioactive labelling

We used 14C labelled polyethylene glycol (14C PEG, stock solution: 1.85 MBq/mL diluted to 18.5 Bq/μL, Perkin Elmer) as a marker to detect food ingested by caged honey bees. 14C PEG was used since the compound is not absorbed by the intestinal tract nor is it metabolized [25, 26]. The radioactive marker was added to a 50% sucrose solution, a standard in vitro diet [10, 9]. We adjusted the activity of 14C PEG in the sugar solution diet depending on feeding regime and number of bees per cage. The activity for temporary and acute feeding regimes was 37.0 to 111.0 Bq per 100 μL sugar solution and for permanent and chronic feeding regimes we used 7.4 to 74.0 Bq per 100 μL sugar solution, according to the number of bees in the cage and duration of the experiment (S1 Table).

Imidacloprid doses and concentrations

For the acute feeding regime, we used 4.5 ng/bee (LD50) analytical grade imidacloprid (Sigma Aldrich®) and 1760 μg/L (LC50) for chronic feeding [22]. For sublethal effects of imidacloprid on food sharing behavior we used 0.09 ng/bee (1/50 LD50) and 35.2 μg/L (1/50 LC50), respectively.

Post-feeding food circulation

An initial set of bees (10 or 20 bees per cage) received temporary or acute feedings. After ten initial bees completely consumed the labelled sucrose solution we added five bees (marked on the thorax) and offered unlabelled sucrose solution in experiment TA12. In experiment TA13, 20 bees were added after 20 bees finished feeding on labelled sugar solution. In experiment AA4 the initial sucrose solution contained imidacloprid at 90 ng/100 μL (the LD50 dosage for 20 bees) in addition to the radioactive marker.

Experiment procedure

Newly emerged worker bees (0–24 hours old) were collected randomly for 28 experiments. Therefore, combs containing sealed brood were removed from bee hives and stored in an incubator at 34.5°C [10]. To test the influence of genetic origin, newly emerged honey bees were taken either from a comb from a single colony or mixed from four different colonies with unrelated queens (experiments T7, T8, Table 1). For three experiments adult bees of mixed age were taken directly from comb surface of the opened hive as described in the OECD guidelines for the testing of chemicals No. 213 [23]. Again, bees originated from a single colony (T9, T10, Table 1) or were taken from 4 different colonies with unrelated queens and mixed (T11).

thumbnail
Table 1. Experimental outlines.

Different experimental setups for temporary1 (T), acute2 (A), permanent3 (P), chronic4 (C) feeding regimes and post-feeding food circulation experiments (TA and AA) with varying number of bees per cage. Amount of 14C labelled sugar solution diet (μL), experiment duration (hours), age of bees (hours), genetic origin and number of replicates are shown.

https://doi.org/10.1371/journal.pone.0174684.t001

Each experiment started when labelled sugar solution diet was offered to the caged bees. Due to different research questions, the duration of the experiments varied. The majority of the experiments lasted 48 hours, but we stopped three experiments immediately after the initial feeding solution was consumed (Table 1, T1, A1, and T14). Two experiments under permanent feeding regime lasted 72 hours (Table 1, P4, P5). Bee mortality was recorded as soon as the initial sugar solution was entirely consumed and at 24, 48 and 72 hours respectively. Dead bees were removed and stored in the freezer at -20°C for further analyses.

Sample preparation

Each bee was homogenized individually in 1 mL of 80% ethanol by sonification (Branson Sonifier® Cell Distruptor B15) according to Crailsheim [27]. Bee samples were extracted for 20 minutes at 60°C (Koltermann) and centrifuged at 15.000 rpm (10.000 g) for 5 minutes (BHG Hermle Z 230 M). Radioactivity was quantified in a 500 μL aliquot of the supernatant using liquid scintillation counter (Packard Tri-Carb 1900 CA). All samples were cooled for 12 hours in the dark after adding 10 mL scintillation cocktail (Carl Roth; Rotiszint® eco plus) prior to analyses in the liquid scintillation counter. The obtained decays per minute (dpm) were multiplied by factor 2.217 to correct for the weight of the total sample. This factor was determined as follows: mean weight of honey bee (91.6 mg, N = 20) plus mean weight of 1 mL ethanol (840.8 mg, N = 20) results in 932.4 mg containing 100% of the radioactivity. Consequently, the aliquot of 500 μL ethanol contained 45.1% radioactivity of the original sample volume.

Additional wash and swipe samples from all used cages and feeder tube surfaces were taken to determine 14C activity of spilled sugar solution from possible feeder movement by bees. The wash and swipe samples were additional information to calculate the 14C recovery. Due to ad libitum feedings in permanent and chronic feeding regimes, the remaining sugar solution was added to 10 mL scintillation cocktail cooled for 12 hours and analyzed in the fluid scintillation counter.

Data analysis

In a first step, we created standard curves to convert weight corrected dpm data (hereafter referred to as raw (dpm)) into μL of labelled food and then corrected for recovery for each experiment (S1 File). Raw (dpm), uncorrected (μL) and corrected data (μL) were significantly correlated (Spearman-Correlation test, p ≤ 0.01, S2 Table). Therefore we used the data corrected for recovery for all further analysis.

We tested the intake of sugar solution of bees per cage on assumption of normality with the Shapiro Wilk test [28]. Two-sample Kolmogorov-Smirnov tests were used to test for uniform distribution of intake of sugar solution and to compare intake distributions of bees from different experimental setups. For a uniform distribution we assumed that n bees in a cage consumed 1/n parts of sugar solution each. The two-sample Kolmogorov-Smirnov statistics quantifies the greatest deviation (D) of two distributions and assigns a critical value (CV). For example, CVs, as used in our experiment are: 0.30, 0.17, 0.12 and 0.10 for N = 10, 30, 60 and 90 bees per testing group [29]. If the observed D is greater than or equal to the CV, then the two distributions are considered significantly different at p < 0.05. For an increase of statistical power we pooled data of all replicates within one experimental setup.

We calculated the full range intake (ingested diet) ratio by dividing the maximum intake by the minimum intake per bee in one cage (intake ratio min-max). We further trimmed the data to the inner 80% to rule out extreme fluctuations by dividing 90th percentile intake by the 10th percentile intake (inner 80% intake ratio).

We used the Kruskal-Wallis test for comparison between donor bees and added bees in post feeding sugar solution circulation experiments (TA12, TA13 and AA4, Table 1). As we found no significant differences in the intake of sugar solution within replicates (Kruskal-Wallis test, p > 0.05), we pooled data of donor bees and added bees of the two to five different replicates from one experimental setup. For comparison of food intake of bees that died prior to the end of the experiment versus bees surviving the experiments, data from all replicates of an experiment were pooled due to small numbers of dead bees. The intake of sugar solution between donor bees and added bees and between bees which died during experiments versus surviving bees per cage was analyzed using Mann-Whitney U-test. Statistical analyses using Kruskal-Wallis test, Mann-Whitney U-test and Spearman-Correlation test were performed with the statistic software SPSS® (version 20). The two-sample Kolmogorov-Smirnov test was carried out manually in Microsoft® Excel 2010.

Results

Recovery and correction of results

The mean recovery of 14C PEG (found in all bees, swipe and wash samples) for different experimental setups is shown in Table 2. On average 77.6% of the applied 14C was recovered in our experiments.

thumbnail
Table 2. Recovery of 14C PEG for the different applied feeding regimes.

Mean recovery of 14C labelled sugar solution diet and number of replicates for experimental setups with 10 or 30 bees for temporary1 (T) and permanent2 (P) feeding regimes without imidacloprid and for acute3 (A) and chronic4 (C) feeding regimes with imidacloprid.

https://doi.org/10.1371/journal.pone.0174684.t002

Uniform and normal distribution

In 99 (73.3%) of 135 individual cages there was a uniform distribution of food among caged bees while there was a non-uniform distribution in 36 (26.7%) (Table 3, TA12, TA13 and AA4 are excluded from this analysis, because of added bees). In cages with 30 bees in only 4 (25.0%) out of 16 cages food was shared uniformly compared to 79.8% in cages with 10 bees. All pooled replicates per experiment showed that there is a significant deviation from the uniform distribution (Kolmogorov-Smirnov test, p < 0.05). In one experiment (T7) with newly emerged bees originating from one colony, the value of the deviation from the theoretical uniform distribution was equal to the critical value (Kolmogorov-Smirnov test, p = 0.05). The distribution of food followed a normal distribution in 27 (20%) of cages.

thumbnail
Table 3. Abundance of cages with a uniform and normal distribution of a labelled sugar solution diet for all replicates for temporary1 (T) and permanent2 (P) feeding regimes without imidacloprid and for acute3 (A) and chronic4 (C) feeding regimes with imidacloprid.

Mean and range (min-max) for full range intake ratio and inner 80% intake ratio are shown for each experiment.

https://doi.org/10.1371/journal.pone.0174684.t003

Intake ratio

The individual intake per caged bee is shown for six replicates of experiment T1 in Fig 1. The mean full range intake ratio per experiment (as determined by the maximum divided by the minimum intake) ranged from 3.1 (T7, Table 3) to 116.5 (T14), the inner 80% intake ratio from 2.0 (C1) to 30.4 (T9). The intake ratio trimmed to the inner 80% is naturally lower than the untrimmed ratio, except in experiment P3 in which we excluded one cage because of an invalid division by zero. Note that mean intake ratios per experimental setup are reported, although the minimum and maximum range is also presented, to illustrate that in single cages full range intake ratios of up to 310.1 have been detected (see T8, Table 3). The lowest inner 80% intake ratio found in a cage was 1.3 (one replicate of T7), whereas the highest was 94.8 (T9, Table 3). Temporary feedings resulted in statistically higher intake ratios than permanent feedings, the same applies for acute feedings compared to chronic feedings (Fig 2, Mann-Whitney U-test, p <0.05). There was no effect of imidacloprid detected on trimmed intake ratio for temporary versus acute feeding or permanent versus chronic experiments (Fig 2, Mann-Whitney U-test, p > 0.05). Inner 80% intake ratios of cages with ten or 30 bees did not differ (Table 3, Mann-Whitney U-test, p > 0.05).

thumbnail
Fig 1. Individual intake per caged bee for six replicates (A-F) from experiment T1.

Intake immediately after bees finished temporary feeding on 100 μl of 14C-labelled sugar diet. Full range intake ratio is the highest quantity of diet ingested by a bee divided by the lowest quantity of diet ingested by a bee. Inner 80% intake ratio likewise is second highest quantity ingested divided by second lowest quantity ingested. The inner 80% intake ratios in this experiment for replicates A-F are: 2.1, 2.6, 1.9, 5.2, 10.3 and 3.9, respectively. † indicates bees that died during the feeding phase.

https://doi.org/10.1371/journal.pone.0174684.g001

thumbnail
Fig 2. Inner 80% intake ratios of caged honey bees from temporary, permanent, acute and chronic feeding regimes.

A. Inner 80% intake ratios (ratio of second highest quantity ingested to that of the second lowest quantity ingested) for pooled data from all replicates of temporary1 and permanent3 feeding of 14C-labelled sugar solution. B. Inner 80% intake ratios for pooled data from all replicates of acute2 and chronic4 feeding of 14C-labelled sugar solution spiked with imidacloprid. # indicates differences at p < 0.05, Mann-Whitney U-test. ° indicates outliers (values between 1.5 and 3 times the interquartile range) and * indicates far outliers (more than 3 times the interquartile range).

1 temporary: test bees initially provided with defined amount (25μL/100μL) of 14C labelled diet, followed by unlabelled diet ad libitum for maintenance

2 acute: test bees initially provided with defined amount (25μL/100μL) of 14C labelled diet containing LD50 or 1/50 LD50 imidacloprid, followed by unlabelled diet ad libitum for maintenance

3 permanent: test bees provided with 14C labelled diet ad libitum

4 chronic: test bees provided with 14C labelled diet containing LD50 or 1/50 LD50 imidacloprid ad libitum

https://doi.org/10.1371/journal.pone.0174684.g002

Comparison of food distributions

We compared the distribution of 14C-labelled sugar solution of pooled experimental setups to identify effects of caging conditions on food distribution. All comparisons are shown in Fig 3, where the theoretical uniform distribution (every bee has ingested the same amount of food) can be seen as a diagonal stair function (blue line). The measured food distributions of two complementary experimental setups are shown as black and grey line, respectively. All functions eventually peak at the complete cumulative intake of all bees of an experiment (value of one). Experimental setups deviate from the uniform distribution pattern because bees with low numbers lag behind in consumption, whereas the bees with higher numbers have disproportionately ingested more. The closer the food distribution lines of experimental setups are to the diagonal stair function, the closer it is to a uniform distribution, which could be tested statistically.

thumbnail
Fig 3. Comparison of cumulative intake of sugar diet between different experimental setups for temporary1 (T) and permanent2 (P) feeding regimes without imidacloprid and for acute3 (A) and chronic4 (C) feeding regimes with imidacloprid.

Pooled data from replicates of the two different experimental setups are shown (grey and black) referring to an assumed theoretical uniform distribution (light blue). Left column shows all experimental setups with N = 30 bees per cage, right column shows all experimental setups with N = 10 bees per cage. # indicates statistically different distributions of food between experimental setups. All experimental setups were statistically different from theoretical uniform distribution. (Kolmogorov-Smirnov test p < 0.05).

1 temporary: test bees initially provided with defined amount (25μL/100μL) of 14C labelled diet, followed by unlabelled diet ad libitum for maintenance

2 acute: test bees initially provided with defined amount (25μL/100μL) of 14C labelled diet containing LD50 or 1/50 LD50 imidacloprid, followed by unlabelled diet ad libitum for maintenance

3 permanent: test bees provided with 14C labelled diet ad libitum

4 chronic: test bees provided with 14C labelled diet containing LD50 or 1/50 LD50 imidacloprid ad libitum

https://doi.org/10.1371/journal.pone.0174684.g003

Group composition.

Newly emerged bees from a single colony significantly better distributed sugar solution than bees of undefined mixed ages taken from a single colony (Fig 3B, Kolmogorov-Smirnov test, p < 0.05). Both experimental setups did not reach theoretical uniform distribution (Kolmogorov-Smirnov test, p < 0.05) though. Bees originating from one colony did not share sugar solution better than a mixture of bees from four different colonies regardless of age (Fig 3L, Kolmogorov-Smirnov test, p > 0.05). Neither experimental setup reached theoretical uniform distributions (Kolmogorov-Smirnov test, p < 0.05).

Caging condition.

In 48 hours ten caged bees did not share their sugar diet more uniformly than immediately after temporary feeding, which lasted between three and seven hours (Fig 3C, Kolmogorov-Smirnov test, p > 0.05). In contrast, thirty bees in a cage distributed labelled sugar diet more uniformly after 48 hours compared to the distribution immediately after temporary feeding (Fig 3A, Kolmogorov-Smirnov test, p < 0.05). Caged bees did not better share a permanent fed labelled sugar diet during 72 hours compared to the distribution after 48 hours (Fig 3D, Kolmogorov-Smirnov test, p > 0.05). Experimental setups did not reach theoretical uniform distribution (Kolmogorov-Smirnov test, p < 0.05).

Temporary and permanent feeding of ten caged bees did not differ statistically in food distribution after 48 hours (Fig 3F, Kolmogorov-Smirnov test, p > 0.05). Neither feeding regimes reached theoretical uniform distribution (Kolmogorov-Smirnov test, p <0.05). In contrast, 30 bees per cage better distributed sugar solution under permanent feeding conditions compared to temporary feeding (Fig 3E, Kolmogorov-Smirnov test, p < 0.05). Temporary and permanent feeding regimes however, did not reach theoretical uniform distribution (Kolmogorov-Smirnov test, p < 0.05).

Feeding volume.

Ten caged bees did not better distribute a labelled sugar solution when offered temporary 100 μL or 25 μL (Fig 3P, Kolmogorov-Smirnov test, p > 0.05). Both experimental setups did not reach theoretical uniform distribution after 48 hours (Kolmogorov-Smirnov test, p < 0.05).

Effect of imidacloprid.

Similar to what was observed in temporary and permanent feeding of sugar solution, there was no statistical difference in food distribution of ten caged bees in acute versus chronic feeding of sugar solution spiked with imidacloprid (Fig 3G, Kolmogorov-Smirnov test, p > 0.05). Again, both feeding regimes differed from theoretical uniform distribution (Kolmogorov-Smirnov test, p > 0.05). In contrast, 30 bees per cage distributed sugar solution better under chronic feeding conditions than in acute feeding after 48 hours (Fig 3I, Kolmogorov-Smirnov test, p < 0.05). However, neither acute nor chronic feeding regimes reached theoretical uniform distribution (Kolmogorov-Smirnov test, p < 0.05).

Immediately after initial feeding, temporary feeding resulted in a more uniformly distributed sugar solution than acute feeding containing LD50 imidacloprid in cages with 10 bees (Fig 3H, Kolmogorov-Smirnov test, p < 0.05). This effect cannot be found after 48 hours, regardless of whether cages contained 10 or 30 bees (Fig 3J and 3M, Kolmogorov-Smirnov test, p > 0.05). Again, theoretical equal distributions were not reached (Kolmogorov-Smirnov test, p < 0.05).

There was no statistically significant effect detected from exposure to imidacloprid on food distribution in permanent versus chronic feedings with LC50 imidacloprid in cages with 10 or 30 bees (Fig 3K and 3Q, Kolmogorov-Smirnov test, p > 0.05). Theoretical uniform distributions were not reached in either case (Kolmogorov-Smirnov test, p < 0.05). Likewise, there were no statistically significant differences in food distribution after 48 hours in temporary versus acute or permanent versus chronic feedings in experiments with the applied 1/50 LD50 or 1/50 LC50 of imidacloprid (Fig 3N and 3O, Kolmogorov-Smirnov test, p > 0.05). No distribution reached the theoretical uniform distribution (Kolmogorov-Smirnov test, p < 0.05).

Mortality rate and radioactive label in dead and surviving bees

Mortality occurred in all feeding regimes except for experiments T3, T4, P2, T14 and P6 (Table 4). In acute and chronic toxicity tests, where 50% of the bees were expected to die, only the acute experiment A2 approached the 50% lethality level with 55% of the bees dead. In all the other toxicity tests, involving 50% lethality level or 1/50 of it, the mortality level was less than 26%. There were no significant differences in the sugar solution intake between bees which died during the study and those that survived in the acute experiments A2 and A5 and in the chronic experiments C1 and C3 (Table 4, Mann-Whitney U-test, p > 0.05). In all the other experiments, bees which died before the end of the study had ingested significantly less sugar solution diet than surviving bees in experiments with and without imidacloprid (Table 4, Mann-Whitney U-test, p < 0.05).

thumbnail
Table 4. Mortality rate and cumulative intake in dead and surviving bees in different experimental setups for temporary1 (T), acute2 (A), permanent3 (P) and chronic4 (C) feeding regimes.

Imidacloprid, duration of experiments, bee mortality, median food intake of dead and surviving bees and the respective p-value for the comparison of median intake of dead and surviving bees (Mann-Whitney U-test) for all experiments are shown. For number of replicates see Table 1.

https://doi.org/10.1371/journal.pone.0174684.t004

Post-feeding circulation

In the experiment TA12, 10 feeding bees plus 5 bees added afterwards, 25.0% of the initial fed sugar solution was detected in the added bees after 48 hours; in TA13 (20 + 20 bees) 45.1% was detected in the added bees (Table 5). In the experiment AA4 imidacloprid reduced the distribution of the initial fed sugar solution to the 20 added bees to 27.1% (mean of two replicates, Table 5). In all three experiments there was significantly less labelled sugar solution in added bees than in donor bees (Fig 4, Mann-Whitney U-test, p < 0.05).

thumbnail
Table 5. Food circulation among initially fed bees and added bees.

Remaining and transmitted 14C-labelled sugar solution for individual cages and pooled per replicate for temporary (TA12 and TA13) and acute (AA4) feeding regimes with and without imidacloprid.

https://doi.org/10.1371/journal.pone.0174684.t005

thumbnail
Fig 4. Sugar solution intake of caged bees (donor bees) fed with 14C-labelled sugar solution and bees added to cages after initial feeding phase (added bees) with and without imidacloprid.

A: Intake of donor bees feeding on 100μL temporary 14C-labelled sugar solution and subsequent added bees at a ratio of 10:5 (pooled data from 5 replicates). B: Intake of donor bees feeding on 100μL temporary 14C-labelled sugar solution and subsequent added bees at a ratio of 20:20 (pooled data from 2 replicates). C: Intake of donor bees feeding on 100μL acute 14C-labelled sugar solution (LD50, 90ng/100μL) and subsequent added bees at a ratio of 20:20 (pooled data from 2 replicates). # indicates differences at p < 0.05, Mann-Whitney U-test. ° indicates outliers (values between 1.5 and 3 times the interquartile range) and *indicates far outliers (more than 3 times the interquartile range).

https://doi.org/10.1371/journal.pone.0174684.g004

Discussion

We evaluated the suitability of honey bee group feeding to assess toxicity and toward a better understanding of group feeding under in vitro conditions. We used a stable radioactive marker (14C-labelled PEG) to trace food sharing among caged honey bees since polyethylene glycol accumulates in the body and therefore reflects the cumulative consumption of a caged bee [25, 26]. Toxicological studies are based on the assumption that caged honey bees all consume the same share of an offered food; however high variability in toxicity thresholds generated in laboratory-based studies and discrepancies between field-realistic levels suggest that exposure may not be adequately assessed [22]. These findings can be explained by either different sensitivities to test substances or simply by an unequal consumption [30, 31]. For the first time we quantified two characteristics of food distribution in caged honey bees. First, we established an intake ratio, which describes the gap between the bee ingesting the highest amount of food and the bee ingesting the lowest quantity of food in the cage. Second we tested the distribution of food in caged bees for a uniform distribution and compared different experimental setups.

Our results demonstrate that a uniform distribution (i.e. every bee in a cage consumes the same share of a fed sugar solution, for example 10 μL per bee when 100 μl food solution is offered) applied in 73% of 135 individually examined cages. The food sharing followed a normal distribution only in 20% of cases (Table 3). Analysis of pooled data indicated that the distribution of sugar solution never reached an uniform distribution in all experimental setups, a fact which is more apparent when comparing the individual intake of each bee. The individual intake of bees from six cages mimicking a setup similar to acute toxicity testing, but not containing a toxic substance is illustrated in Fig 1. The full range intake ratio, including all bees from a cage, is greatly affected by a single bee in the cage ingesting either very little or very much. We therefore trimmed this value to a more robust inner 80% intake ratio. We found a mean inner 80% intake ratio of 8.8 calculated from 133 cages that allowed this calculation, which means that on average one bee per cage is consuming 8.8-times more of an offered food solution than another bee in the same cage (Table 3). This already indicates that a uniform distribution of sugar solution among caged honey bees cannot be assumed (Table 3). In the 133 investigated single cages, the trimmed intake ratio ranged between 1.3 (which points to an almost perfect uniform distribution) to 94.8, which indicates a highly skewed distribution. In some cages, the full range intake ratio suggests an even more than 300-fold gap between the bee with the lowest and highest quantity of diet ingested. These imbalances in food distribution might partly explain that groups of bees fed diets with Nosema spores exhibited an uneven dispersal of infections among workers [21]. The intake ratios of different replicates as shown in Table 3 are summarized in Fig 2 to illustrate differences between temporary and permanent feeding conditions. While the intake ratio was not affected by imidacloprid, the intake ratio was higher in cages with temporary or acute feeding conditions compared to cages with chronic or permanent feedings, respectively. In temporary and acute feeding regimes probably few bees feed directly on the initially applied sugar solution. Other bees may receive some labelled food by trophallaxis and feed on the unlabelled food for maintenance provided after initial feeding phase. The longer exposure period in permanent or chronic feeding regimes hence led generally to lower differences in ingestion of the offered food. Intake ratios were not affected by the number of bees, ten or 30, in the cage (Table 3).

For cage experiments it is recommended to use worker bees from as many and diverse colonies as possible since bees of various ecotypes, populations, strains, or even single colonies of the same subspecies can differ in physiological, behavioral and biochemical traits [9, 10]. In our study, there was no difference in food distribution using mixed age bees from only one colony or a mixture of bees from four colonies (Fig 3L), which is remarkable because worker bees can discriminate between related and unrelated nest mates and are more prone to feed related bees [3234]. We detected a significant improvement in food distribution for cages with newly emerged bees compared to cages with mixed age bees (Fig 3B). Based on our study results, we recommend newly emerged bees from the same colony to improve the food distribution in cages used for acute toxicity studies.

In our experiments, we explored the use of 10 or 30 bees per single cage [23, 35, 36] and found more often a uniform distribution of sugar solution in cages with 10 bees (Table 3). This might be due to the fact that each bee has an increased chance to feed directly on an offered sugar solution in smaller groups than in groups of 30 bees or more. In cages with 10 bees neither the amount of applied sugar solution nor the time given bees for trophallactic exchange (immediately after consummation, 48 hours or even longer) significantly improved the food distribution (Fig 3C, 3D and 3P). In contrast, in cages with 30 bees the food distribution was significantly affected by time and feeding regime. Our results suggest that food in larger groups with 30 bees per cage is more likely distributed via trophallactic contacts rather than directly ingesting test solution from the feeder (Fig 3A). Sugar solution is also more evenly distributed in permanent or chronic feeding than in temporary or acute feeding regimes (Fig 3E and 3I). This better distribution with time or pending on feeding regime was not apparent in experiments with 10 bees per cage (Fig 3C, 3F and 3G). Even bees feeding permanently on sugar solution differ in their individual intake, probably because of variable needs due to different activity in the cage.

We exposed caged bees to an oral LD50 of 4.9 ng imidacloprid per bee [22] to test for an influence that a pesticide itself could have on food sharing behavior. In some cases we observed signs of intoxication including loss of coordination and hyperactivity [31, 37]. These behavioral effects may have prevented caged bees from further feeding on the sugar solution, which significantly affected the dispersal of sugar solution immediately after consumption in cages with 10 bees (Fig 3H). Although imidacloprid does not bind permanently to the nicotinic acetylcholine receptor, effects may appear immediately after acute feeding and lead to visible signs of intoxication which may include impacts on feeding behavior [22, 30, 3840]. Immediately after initial feeding phase, food was less evenly distributed in bees receiving imidacloprid compared to bees that received a pesticide free sugar solution. After 48 hours, the distribution pattern in bees treated with imidacloprid was not different to that from pesticide free controls anymore, both still not reaching uniform distributions. One possible explanation for this non-uniform distribution is that after caged bees consumed the acute sugar solution containing imidacloprid, they received untreated sugar solution ad libitum for maintenance, which may have diluted the pesticide-containing sugar solution in the honey stomach. Therefore, acute toxicity tests may only detect a small portion of adverse effects of a pesticide in honey bees due to short exposure duration of one to three days [41]. The pesticide may not have a lethal effect on the honey bee immediately after the initial feeding phase of the experiment, but mortality may occur later during the trial [42].

We found dead bees in all feeding regimes except for three temporary and two permanent experiments. In acute and chronic feeding regimes with LD50 and LC50 of imidacloprid, respectively, one acute experiment reached the expected bee mortality (Table 4, A2). For all other tests with imidacloprid, mortality was less than 26%. This is in some cases due to the short duration of experiments (bees in A1 for example were also exposed to LD50, but only for the time bees needed to consume the acute feeding) in other cases only a fiftieth of LD50 or LC50 was applied (A3 or C4).

In all experiments without pesticide (see temporary and permanent experiments in Table 4) bees that died in the course of the experiment consumed significantly less food than surviving bees, indicating that they either died early in the experiment or because of starvation. The results for experiments including the pesticide imidacloprid in LD50, LC50 or a fiftieth of it are not so clear. In none of the experiments had bees which died early ingested significantly more imidacloprid-spiked sugar solution than the surviving bees. In two acute (A2, A5) and two chronic (C1, C3) feeding scenarios dead bees ingested the same amount of food than surviving bees (Table 4). The experimental design of these experiments can be compared to classic toxicity tests, they lasted 48 hours and bees received LD50 or LC50, respectively. One possibility is that dead bees in these experiments died after consuming large quantities in a short period during the experiment, compared to surviving bees consuming the same quantity over a longer duration of time, i.e., 48 hours. Another possibility is that dead bees were more sensitive to imidacloprid than surviving bees [22, 43]. The isolation of grouped honey bees in cages has also been associated with an increased sensitivity to pesticides [44]. An alternative explanation is that bees simply die from other reason than pesticide. For example in one trial, 25% of bees were dead already after initial acute feeding and these bees had consumed significantly less sugar solution than surviving bees (Table 4). This is an example, for how toxicity testing might be misinterpreted, because one would generally assume that these bees died from the effects of pesticide. More detailed research using our labelling technique to study individual variability of sensitivity to a pesticide is recommended.

Post-feeding distribution (“circulation”) of food solution via trophallaxis is thought to play a major role in sharing toxic compounds both in the colony as well as in cages [9, 20]. In experiments where we added marked bees, these did never directly consume the labelled sugar solution served temporary, but after 48 hours contained a significant amount of the radioactive marker, similar to other experiments [13, 16, 17]. Nevertheless, we found more labelled food in donor bees than in the added bees. After 48 hours, about 25% of the temporary applied food in cages with ten original and five added bees can be found in the five added bees, whereas it is 45% in cages with a 20:20 ratio. The actual food distributions are slightly below to what one would expect from the ratio of bees and added bees. In experiments with imidacloprid at close to the LD50 the trophallactic distribution on the other hand was reduced almost by half (Table 5). Added bees maybe preferred consuming unlabelled sugar solution over being fed a pesticide solution by trophallactic contacts. Imidacloprid might have negatively influenced the trophallaxis among caged honey bees similar to what was observed in a study with the organophosphate pesticide coumaphos in which treated caged donor bees provided recipients with a food solution through a metal screen [45]. In the study with coumaphos mortality resulted from insufficient food transmission via impaired trophallactic contacts; this effect increased with coumaphos dose.

The effectiveness of trophallactic contacts is influenced by the physiological situation (e.g., extent to which the honey stomach is filled), the experimental setup, or even the receptiveness of other bees to trophallaxis [13]. While Korst and Velthuis [46] also consider the smell of the available diet to influence trophallactic contacts in honey bees, Kessler et al. [40] observed that bees cannot “taste” a pesticide and even suggested that honey bees preferred sugar solutions spiked with imidacloprid. These results contradict the findings of Desmedt et al. [47] who showed that caged bees preferred the pure untreated sucrose solution over a noxious solution as long as the bees were offered a food alternative. The absence of such an alternative diet led again to consumption of the noxious food solutions.

Although we confirmed that substantial amounts of an applied sugar solution circulate between caged bees via trophallaxis, our results indicate that caged honey bees do not share food equally. Our findings support the opinion of Blacquiére et al. [48] about extrapolating laboratory findings to field studies. Toxicity exposure models often assume a uniform exposure to pesticides. With respect to the complex environment in which honey bees forage and the social interactions within a honey bee colony, Sponsler and Johnson [49] point to a more sophisticated modelling of differential exposure and susceptibility of different members of a honey bee colony. The uneven distribution of food in cages reflects a different exposure, although it might not be comparable to the situation in a honey bee colony. In acute toxicity studies lasting only few days as suggested by some standardized test methods [23, 35, 36] uneven food distribution, as demonstrated in our study may be problematic. We could not identify any group or caging condition that drastically improved food sharing of caged honey bees, and found that even the testing compound itself could affect food distribution. The use of newly emerged and closely related honey bees appears to result in a more even distribution of food in cage experiments. Better food distribution can be expected during chronic conditions compared to acute feedings, especially when higher numbers of bees are used [9]. Another option for improving the food distribution might be to expose honey bees to a pesticide up to ten days as discussed by Decourtye & Devillers [41] or to feed honey bees individually [11, 21, 49]. Our results suggest further research is needed on the reliability of laboratory experiments toward ensuring a more uniform distribution of food among caged honey bees. Besides cage experiments, more natural settings for tests should be developed.

Supporting information

S1 File. Conversion of dpm to consumed volume.

This includes text and one reference about 1. the standard curve, created for each experiment to convert the measured dpm into consumed μL of the applied sugar solution diet, 2. correction of the data with recovery factors, 3. correction of results for temporary and acute experiments and 4. correction of results for permanent and chronic experiments.

https://doi.org/10.1371/journal.pone.0174684.s001

(DOCX)

S1 Table. Composition of applied feeding solutions diets for temporary1, acute2, permanent3 and chronic4 feeding regimes.

Feeding regime, experiment, the amount of applied sugar solution diet (μL), PEG (μL) and imidacloprid (μL) dose are shown. PEG (Perkin Elmer): 18.5 Bq/μL, Imidacloprid: LD50: 4.5 ng/bee, LC50:1760 μg/L, 1/50 LD50: 0.09 ng/bee, 1/50 LC50: 35.2 μg/L.

https://doi.org/10.1371/journal.pone.0174684.s002

(DOCX)

S2 Table. Correlations (Spearman rs) between raw data (dpm), uncorrected intake (μL) and corrected intake (μL) in temporary1, acute2, permanent3 and chronic4 experiments.

Spearman’s rho (ρ) = correlation coefficient. * p≤0.01.

https://doi.org/10.1371/journal.pone.0174684.s003

(DOCX)

Acknowledgments

We thank three anonymous reviewers for their careful reading of our manuscript and their insightful comments and suggestions. Special thanks to Tjeerd Blacquière for stimulating this research question and Anton Safer for statistical advice.

Author Contributions

  1. Conceptualization: RB AL.
  2. Formal analysis: RB AL VK.
  3. Funding acquisition: KC RB.
  4. Investigation: VK AL.
  5. Methodology: AL RB.
  6. Project administration: RB.
  7. Supervision: KC.
  8. Writing – original draft: VK AL RB.
  9. Writing – review & editing: RB AL.

References

  1. 1. Goulson D, Lye GC, Darvill B. Decline and conservation of bumble bees. Annu Rev Entomol. 2008; 53: 191–208. pmid:17803456
  2. 2. Potts SG, Roberts P, Dean R, Marris G, Brown MA, Jones R, et al. Declines of managed honey bees and beekeepers in Europe. J Apic Res. 2010; 49 (1): 15–22.
  3. 3. Brodschneider R, Crailsheim K. Nutrition and health in honey bees. Apidologie. 2010; 41 (3): 278–294.
  4. 4. Nazzi F, Brown SP, Annoscia D, Del Piccolo F, Di Prisco G, Varricchio P, et al. Synergistic parasite-pathogen interactions mediated by host immunity can drive the collapse of honeybee colonies. PLoS Pathog. 2012; 8 (6): e1002735. pmid:22719246
  5. 5. Francis RM, Nielsen SL, Kryger P. Varroa-virus interaction in collapsing honey bee colonies. PLoS ONE. 2013; 8 (3): e57540. pmid:23526946
  6. 6. Simon-Delso N, San Martin G, Bruneau E, Minsart LA, Mouret C, Hautier L. Honeybee Colony Disorder in Crop Areas: The Role of Pesticides and Viruses. PLoS ONE. 2014; 9(7): e103073. pmid:25048715
  7. 7. Doublet V, Labarussias M, Miranda JR, Moritz RFA, Paxton RJ. Bees under stress: sublethal doses of a neonicotinoid pesticide and pathogens interact to elevate honey bee mortality across the life cycle. Environ Microbiol. 2015; 17 (4): 969–983. pmid:25611325
  8. 8. Goulson D, Nicholls E, Botías C, Rotheray EL. Bee declines driven by combined stress from parasites, pesticides, and lack of flowers. Science. 2015; 347: 6229.
  9. 9. Medrzycki P, Giffard H, Aupinel P, Belzunces LP, Chauzat MP, Claßen C, et al. Standard methods for toxicology research in Apis mellifera. J Apic Res. 2013; 52 (4): 1–60.
  10. 10. Williams GR, Alaux C, Costa C, Csáki T, Doublet V, Eisenhardt D, et al. Standard methods for maintaining adult Apis mellifera in cages under in vitro laboratory conditions. J Apic Res. 2013; 52 (1): 1–36.
  11. 11. Rinderer TE. Honey bees: individual feeding of large numbers of adult workers. J Econ Entomol. 1976; 69 (4): 489–491.
  12. 12. Farina WM, Núñez JA. Trophallaxis in the honeybee, Apis mellifera (L.) as related to the profitability of food sources. Anim Behav. 1991; 42 (3): 389–394.
  13. 13. Crailsheim K. Trophallactic interactions in the adult honeybee (Apis mellifera L.). Apidologie. 1998; 29 (1–2): 97–112.
  14. 14. Sudd JH. An introduction to the behaviour of ants. London: Arnold; 1967.
  15. 15. Abbott A. Nutrient dynamics of ants. In: Brain MV, editor. Production ecology of ants and termites. London: Cambridge University Press; 1978. pp. 233–244.
  16. 16. Crailsheim K. Interadult feeding of jelly in honeybee (Apis mellifera L.) colonies. J Comp Physiol B. 1991; 161: 55–60.
  17. 17. Nixon HL, Ribbands CR. Food transmission within the honeybee community. Proc R Soc London B Biol Sci. 1952; 140 (898): 43–50.
  18. 18. Free JB. The transmission of food between worker honeybees. Br J Anim Beh. 1957; 5 (2): 41–47.
  19. 19. Moritz RFA, Hallmen M. Trophallaxis of worker honeybees (Apis mellifera L.) of different ages. Insectes Soc. 1986; 33 (1): 26–31.
  20. 20. Pershad S. Analyse de differents facteurs conditionnant les echanges alimentaires dans une colonie d'abeilles Apis mellifica L. au moyen du radio-isotope P32. Annales de l'Abeille. 1967; 10 (3) 139–197.
  21. 21. Furgala B, Maunder MJ. A simple method of feeding Nosema apis inoculum to individual honeybees. Bee World. 1961; 42 (10): 249–252.
  22. 22. Cresswell JE. A meta-analysis of experiments testing the effects of a neonicotinoid insecticide (imidacloprid) on honey bees. Ecotoxicology. 2011; 20 (1): 149–157. pmid:21080222
  23. 23. OECD Test No. 213. Honeybees, Acute Oral Toxicity Test. OECD Guidelines for the Testing of Chemicals. Paris: OECD Publishing. 1998; https://doi.org/10.1787/9789264070165-en
  24. 24. Evans JD, Chen YP, Di Prisco G, Pettis JS, Williams V. Bee cups: single-use cages for honey bee experiments. J Apic Res. 2009; 48 (4): 300–302.
  25. 25. Crailsheim K. Distribution of haemolymph in the honeybee (Apis mellifica) in relation to season, age and temperature. J Insect Physiol. 1985; 31 (9): 707–713.
  26. 26. Crailsheim K. Regulation of food passage in the intestine of the honeybee (Apis mellifera L.). J Insect Physiol. 34 (2): 85–90.
  27. 27. Crailsheim K. Protein synthesis in the honeybee (Apis mellifera L.) and trophallactic distribution of jelly among imagos in laboratory experiments. Zool Jahrb Abt allg Zool Physiol Tiere. 1990; 94: 303–312.
  28. 28. Shapiro S, Wilk M. An Analysis of Variance Test for Normality (Complete Samples). Biometrika. 1965; 52(3/4), 591–611.
  29. 29. Sachs L. Angewandte Statistik. Anwendung statistischer Methoden. Berlin, Heidelberg: Springer Verlag; 2002.
  30. 30. Cresswell JE, Desneux N, vanEngelsdorp D. Dietary traces of neonicotinoid pesticides as a cause of population declines in honey bees: an evaluation by Hill´s epidemiological criteria. Pest Manag Sci. 2012; 68 (6): 819–827. pmid:22488890
  31. 31. Suchail S, Guez D, Belzunces LP. Characteristics of imidacloprid toxicity in two Apis mellifera subspecies. Environ Toxicol Chem. 2000; 19 (7): 1901–1905.
  32. 32. Moritz RFA, Hillesheim E. Trophallaxis and genetic variance of kin recognition in honeybees (Apis mellifera L). Anim Behav. 1990; 40 (4): 641–647.
  33. 33. Moritz RFA, Heisler T. Super and half-sister discrimination by honey bee workers (Apis mellifera L.) in a trophallactic bioassay. Insectes Soc. 1992; 39 (4): 365–372.
  34. 34. Meixner MD, Moritz RFA. Clique formation of super-sister honeybee workers (Apis mellifera) in experimental groups. Insectes Soc. 2004; 51(1): 43–47.
  35. 35. OEPP/EPPO. EPPO Standards PP 3/10 (3): Environmental risk assessment for plant protection products. Chapter 10: honeybees. Bulletin OEPP/EPPO Bulletin. 2010; 40: 323–331.
  36. 36. CEB Method N°230. Method for the evaluation of side effects of plant protection products on honey bees (Apis mellifera L.). Association Française de Protection des Plantes. 2011; 43pp.
  37. 37. Hurst V, Stevenson PC Wright GA. Toxins induce ‘malaise’ behaviour in the honeybee (Apis mellifera). J Comp Physiol A. 2014; 200: 881.
  38. 38. Nauen R, Ebbinghaus-Kintscher U, Schmuck R. Toxicity and nicotinic acetylcholine receptor interaction of imidacloprid and its metabolites in Apis mellifera (Hymenoptera: Apidae). Pest Manag Sci. 2001; 57 (7): 577–586. pmid:11464788
  39. 39. Suchail S, Debrauwer L, Belzunces LP. Metabolism of imidacloprid in Apis mellifera. Pest Manag Sci. 2004; 60 (3): 291–296. pmid:15025241
  40. 40. Kessler SC, Tiedeken EJ, Simcock KL, Derveau S, Mitchell J, Softley S, et al. Bees prefer foods containing neonicotinoid pesticides. Nature. 2015; 521: 74–76. pmid:25901684
  41. 41. Decourtye A, Devillers J. Ecotoxicity of neonicotinoid insecticides to bees. In: Thany SH, editor. Insect nicotinic acetylcholine receptors. New York: Springer; 2010. pp. 85–95. https://doi.org/10.1007/978-1-4419-6445-8_8
  42. 42. Rondeau G, Sánchez-Bayo F, Tennekes HA, Decourtye A, Ramírez-Romero R, Desneux N. Delayed and time-cumulative toxicity of imidacloprid in bees, ants and termites. Sci Rep. 2014; 4.
  43. 43. Laurino D, Manino A, Patetta A, Porporato M. Toxicity of neonicotinoid insecticides on different honey bee genotypes. Bull Insectology. 2013; 66 (1): 119–126.
  44. 44. Fairbrother A, Purdy J, Anderson T, Fell R. Risks of neonicotinoid insecticides to honeybees. Environ Toxicol Chem. 2014; 33 (4): 719–731. pmid:24692231
  45. 45. Bevk D, Kralj J, Čokl A. Coumaphos affects food transfer between workers of honeybee Apis mellifera. Apidologie. 2012; 43 (4): 465–470.
  46. 46. Korst PJAM, Velthuis HHW. The nature of trophallaxis in honeybees. Insectes Soc. 1982; 29 (2): 209–221.
  47. 47. Desmedt L, Hotier L, Giurfa M, Velarde R, de Brito Sanchez MG. Absence of food alternatives promotes risk-prone feeding of unpalatable substances in honey bees. Sci Rep. 2016; 6: 31809. pmid:27534586
  48. 48. Blacquiére T, Smagghe G, Van Gestel CAM, Mommaerts V. Neonicotinoids in bees: a review on concentrations, side-effects and risk assessment. Ecotoxicology. 2012; 21 (4): 973–992. pmid:22350105
  49. 49. Sponsler DB, Johnson RM. Mechanistic modeling of pesticide exposure: The missing keystone of honey bee toxicology. Environ Toxicol Chem. 2016;