Update on CC2500 deterioration

25.03.2013 15:32

Last November I was writing about an issue with 2.4 GHz transceivers that were deployed on street lights as part of Jožef Stefan Institute's testbed for radio communications. Some radios based on Texas Instruments CC2500 integrated circuit seemed to degrade after they were mounted out doors. In the most extreme case, there was almost an -30 dB drop in receiver sensitivity and maximum transmit power dropped to insignificant levels.

The leading theory at the time was that some component has deteriorated over time due to environmental effects. After some initial testing it appeared that the coaxial cable between the radio PCB and the connector is to blame. However having more boards with this issue in the lab showed that in most cases it's not possible to restore original characteristics only by changing the coaxial cable.

A pile of SNE-ISMTV boards and pigtail cables.

I then fired up the soldering iron and did a brute-force approach: on three bad radio boards I manually replaced components one by one, preforming automated tests of the board after each replacement. While replacing the coaxial cable did have a small effect (0.3 dB in the best case), only replacing the CC2500 integrated circuit itself seemed to restore the correct performance. So the suspicion immediately fell on the transceiver chip itself.

Since I did not exhaustively test all radios for sensitivity and transmit power before deployment, I couldn't be sure whether the radios have been bad from the start or whether they degraded due to environment. The fact that only radios that have been deployed out-doors have had this issue pointed to the second explanation, but since more radios were deployed out-doors than in-doors that could have been a coincidence as well.

As a test, I also brutally heated up one of the newly replaced CC2500 chips with a hot air gun. After such test, the radio board had similar symptoms as the boards that were unmounted from the testbed as defective: the digital part of the IC still functioned correctly, but receiver's sensitivity dropped permanently by 33 dB. Unfortunately I did not record the temperature to see how much heating is actually required.

To test the other theory, I set up a long-running experiment on the testbed that recorded received signal strength between neighboring pairs of newly replaced radios 4 times a day between December 2012 and March 2013. If radios were deteriorating over time, I should be able to see the signal strength drop during these three months.

Here are two typical plots of these measurements over time:

Long term RSSI measurement between nodes 12 and 15.

Long term RSSI measurement between nodes 2 and 25.

As you can see, while there is a lot of variation in the signal strength, there is no obvious downward trend. Variation is probably due to weather and or large things moving around the radios (these are mounted in an industrial zone, so moving trucks and other such things are not an uncommon occurrence).

So, it currently looks like we either mounted already defective radios or they were damaged by a one-time event after deployment (which is hard to imagine). The fact that over-heating damages radios in a similar way may point to an error in manufacturing, although that's not a popular opinion, since these boards were soldered using a lead solder and radio ICs are supposed to support a RoHS process that involves higher temperatures. It's also a theoretical possibility that the radios were damaged during summer (the test above was obviously done over winter months), although again it's very unlikely that sun would overheat the radios.

Posted by Tomaž | Categories: Analog

Comments

What about moisture? Did you tryed baking the boards for quite some time in the oven at an elevated temperature? Moisture causes all sorts of weird stuff to an ic.

Posted by iggy

Termical cycling of finished PCB was probably skipped. There are a lot of experienced Iskra engineers who made military products. Loose and rusty coax connectors known cause. Elkos next.

Posted by MMM

No, I haven't tried baking the boards. Would be interesting to try though if I can find an appropriate oven. Thanks.

Posted by Tomaž

Just curious: is there anything new about the radios? I heard the faculty of chemical engineering owns a controlled oven, a colleague of mine had problems with moisture infested asics. Baked all of them, claims to have had 100% recover rate. Can ask him about details if this is still of interest to you.

Posted by iggy

Iggy, no news so far as other tasks had higher priority.

A few weeks ago I unmounted another batch of nodes from street lights and I yet have to do measurement to see if they degraded as well. Thanks for the offer, I'll contact you if I will pursue this issue further.

Posted by Tomaž

Add a new comment


(No HTML tags allowed. Separate paragraphs with a blank line.)