-
Speed Improvements
01/01/2019 at 15:14 • 1 commentJust a quick note about the recent changes in the GitHub code. I added numba (a JIT parallelizing compiler) support to the code. I see around a 10x improvement in execution speed with the new code, although YMMV.
This improvement probably opens the path for live streaming audio transmission, if that's an interesting thing for anyone. The code does not support this at the moment.
-
Again, with a real antenna
12/05/2018 at 18:11 • 0 commentsI used a return-loss bridge to test the dual-band antenna I had started using for the 27MHz RC experiments, and it was very bad. Luckily I had an old CB antenna around, which is made for 27MHz: it showed a 21dB return loss, so the antenna is quite good. Using this antenna, I get about 3 feet of range with just the serial port and the LC filter network (no amps).
That's it at the right side of the photo. It has a magnetic base which attaches firmly to the steel table as a nice ground plane. If I add the two amplifiers as before, I can control it all the way to the end of the lab - at least 20 feet. I don't know how much further it would actually work, but that's good enough for me :-)
Replicating the Experiment
I also wanted to document exactly what I did to make this work, so anyone who wanted to replicate the experiment wouldn't have to stumble around like I did at first. The first trick was finding the right RC toy. I found the cheapest ones they had - not only to save cash, but because cheap ones are likely to have wide (non-selective) receivers, so the transmit frequency doesn't have to be exact. A good clue about the one I selected was the "27 MHz" sticker on the box.
They make different frequencies so you can race. In the case of this model, there were "27 MHz" and "49 MHz" versions on the shelf. This is much better than if they had "27.145MHz" vs "27.195MHz" or similar frequencies both in the 27MHz RC band - in that case, the receivers would have to respond only to a narrow band of frequencies which you might not hit with harmonics of the allowed serial port baud rates.
Signal Capture
Here are the GQRX settings I used to capture the signal. I used an upconverter I built since I was also looking at the lower harmonics and fundamental, but for 27MHz you could use an RTL-SDR dongle directly.
It's just AM demodulation with the normal filter width and shape. The file gets saved with 48kHz sampling and two channels, but this doesn't matter because the transmitter program resamples to 11025 Hz mono by default.
Signal Replay
To replay the signal, I used code from the GitHub repo - it's the same command used to transmit AM audio signals, except this time the signal is the one we recorded from the RC transmitter. I used this command line to send the RF signal from the serial port:
./serial_sdr_tx.py -p /dev/ttyUSB0 -f 631e3 -l -m pdm recorded_codes.wav
This sends the output to the port on ttyUSB0 at a fundamental frequency of 631kHz using the 'pdm' modulation method. In my early tests, I found the pdm method to work best, but this may vary with a number of factors. I should revisit this at some point. I found the 631kHz frequency by observing the GQRX display while transmitting unmodulated square waves with the other code in the GitHub repo:
./square_wave.py /dev/ttyUSB0 631e3
I saw that this particular frequency had a harmonic very close to 27.145 MHz (666kHz was a close second). Once I had captured some codes, it was easy to verify that 631kHz worked best.
Using just a jumper wire as an antenna, the toy truck has to be very close to the transmitter. Having the antennas touching (even through the insulation) will let you know right away if it's working; then you can experiment with longer ranges.
Up Next
I keep talking about audio output from a serial port; I really need to write it up :-)
I have also made some progress on receiving RF with just a serial port. I was lucky enough to catch Dominic Spill's talk at Supercon about "Ridiculous Radios" - I don't think it's on youtube yet, or I'd post a link. Anyway, he covered some interesting radio receivers using digital circuits. When I get a chance to watch it again, I'll check for clues that might help.
The additional problem I have here is that I can't sample the RX line without a start bit, and that's not guaranteed to happen just from received RF. I've been playing with pumping in start bits from the TX line, while leaving the RX line free to receive signals during the serial frame. We'll see how it turns out...I'm getting to use multi-threaded python, anyway, which is fun in itself.
-
Moar Range!
12/05/2018 at 02:51 • 2 commentsI added a filter, a cascade of two amplifiers and a half-decent antenna, and achieved around a 10-foot range controlling the 27MHz toy truck with a FT232RL serial port as a transmitter. The experiment also proves that it's the 43rd harmonic (and perhaps a few neighbors) that's controlling the truck, and not the fundamental overloading the receiver.
The antenna is on the right. It's really a lousy dual-band 2m/70cm amateur band antenna, but the toy truck doesn't know this. It's probably better than the random length of wire I had been using, and it had the right connector already :-)
You recall from last time that I'm using the 43rd harmonic of a 631kHz signal, because out of the limited range of baud rates the FT232RL can manage, this comes the closest to the 27.145MHz RC frequency. The harmonics are pretty strong, but even a perfect square wave will have the 43rd harmonic down 33dB from the fundamental (20log10(1/43)). In this case, it's more like -37dB. (Note that there's a 10dB attenuator in the signal path for this measurement; the absolute numbers are 10dB higher.)
I wanted to knock down the strong lower frequencies and leave just those near 27MHz. For a filter, I combined a low-pass design with a coupled resonator bandpass, shown here constructed ugly-style on a scrap of copper clad.
The schematic is shown with the nominal component values, although the actual circuit contains a lot of parasitics, and the inductors are probably off a bit from the estimated values. I added a 3-10pF trimmer in series with the 3.3pF coupling cap, and tuned to get a narrow, flat passband. I assumed the FT232RL had around 11-ohms of output impedance, so added a 39-ohm resistor to make the source impedance 50 ohms.
The inductors are all 9 turns of 22 or 24 Ga wire on T37-2 toroids. They calculate out to 324nH, but I suspect from the performance of the circuit that they're closer to 400nH including the parasitics from the long leads and my winding style. The filter response measures out nicely on the spectrum analyzer after tweaking the trimmer and compressing the coil turns a bit:
As you can see, the response is 10dB down at a bandwidth of around 2 MHz. That picks out just a few harmonics around 27MHz, although they are pretty weak at this point:
To boost these few frequencies to usable levels, I added a cascade of two amplifiers, first a PGA-103 followed by a Mini-circuits ZFL-500. I used these two because they were the first I found in the box that gave enough gain together. The PGA-103 isn't spec'd down to 27 MHz (datasheet says 50), but it seems to work fine. I did the right thing and used the lower-noise amp first, even though it has a higher P1dB in this case :-)
Together, they give a nice 37dB boost to the 27MHz signal:
But, this gain does resurrect some of the fundamental and low harmonics, as seen here in a wider span:
The fundamental is still down 10dB from the 27MHz line, so I'm fairly confident that's not controlling the truck. After the whole chain, the 27MHz signal is at around -5dBm, or approximately 140uW. It's a flea's burp, but it does control the truck out to about 10 feet.
Overall, this seems like a lot of work, but I really wanted to see if it was that 43rd harmonic at work or not. I'm confident that this isn't just a case of receiver overload, and that the serial-port SDR is indeed transmitting a usable signal on 27MHz.
Up Next
You know you want to use your serial port as another audio output.
I'm stalling on the receive side, hoping for some serious inspiration :-)
-
Controlling a 27MHz RC Truck
12/04/2018 at 02:51 • 4 commentsI found a 27 MHz RC truck at Walmart for $10 - so now, I've blown my budget for this project. But, at least, I did get the serial port SDR to control it :-) Check out the video here:
It works because the fast edges of the waveform on the TX line create strong harmonics. In this case, I used an FT232RL adapter because the clock is more stable than other bridges, and this creates cleaner harmonics. Here's the adapter with a wire connected as an antenna:
This adapter has a 5/3.3 jumper to set the output signal level. Setting it to 5V gives an extra 3.6dB of output :-)
As shown in the video, the codes are captured as an audio file using GQRX, then modulated and transmitted on the serial port using my python code.
I set the fundamental frequency to 631kHz, because out of the limited baud rates the FT232RL is capable of, this one puts a harmonic closest to 27.145 MHz, the RC truck's transmitter frequency. You can see the harmonics on this spectrum analyzer plot:
That's the 43rd harmonic, and it's actually -47dBm, because there's a 10dB attenuator in-line to protect the analyzer. That signal is pretty weak, so the truck has to be very close to the transmitter.
It's also very possible that the truck is responding to any of the other harmonics (or multiple ones) since it is so close to the transmitter. This could be overloading the receiver, although the remote codes still are received well enough to operate the truck. It controls it from a short distance, at least, so I'm counting that as a success :-)
To figure out exactly what's happening, I'm experimenting with a bandpass filter, which you can see here:
The filter will knock out the fundamental and low harmonics, leaving just those near 27 MHz. So far, the response looks promising:
I'll amplify the filtered signal and see how well it works for controlling the truck. Plenty more details and results in the next log.
-
Fun with Harmonics: VHF from a Serial Port
11/30/2018 at 18:15 • 0 commentsI measured the edge rates on the TTL output of some of these USB-UART bridges to be under 2ns. This generates some strong frequency harmonics, which you can see here in the 67th harmonic of a 1MHz square wave output by an FT232RL driven by the square_wave.py code from the GitHub repo. Yes, that's a 67 MHz signal from a serial port.
You can see three strong spurs surrounding the harmonic - these are themselves harmonics of the strong sub-harmonic spurs created by the modulation technique. The other thing that is apparent is the instability of the signal. You'd normally call this jitter since it's a ostensibly a digital device we're dealing with, but the term phase noise is equally applicable in this case. The problem with harmonics is that they multiply the phase noise just as they multiply the frequency - this signal has 67x the phase noise of the 1MHz fundamental. It's possible to receive AM audio on this carrier, but the receiving width of the demodulator has to be increased to include the larger bandwidth of the "wandering" signal. You can definitely hear it, though!
The other problem with harmonics is that they can be substantially weaker than the fundamental. The output here is a square wave, and for an ideal square wave, the amplitude of the Nth fundamental is proportional to 1/N. So, for this 67th fundamental, the amplitude is 1/67th, or down 36.5 dB. Using one of these harmonics in a meaningful way without creating serious interference on other frequencies would be very difficult. But they might work for a stunt-type hack :-)
I've looked at higher harmonics, and they're "usable" into the upper VHF range. I received an AM transmission at 151 MHz, for instance, but the quality was very poor. I am very interested in spoofing some RF remote device with this system. 433 and 315 MHz are simply out of reach - I tried. The signals are too weak and too unstable. I think the best bet is a toy remote on 27 or maybe 49 MHz. I'll keep an eye out for super-cheap 27 MHz remote-controlled cars; they used to involve super-regenerative receivers which weren't very selective, although I don't know what they use these days.
Other Bridges
The FT232RL shown above is the best one I've tested in terms of frequency stability. Contrast the image above with this one showing the output from a CP2102N again at the same 67th harmonic of a 1 MHz carrier:
The spectrum is amazingly wide - I'm not sure how the chip is generating its frequencies, but looking at the harmonics shows the "stability" is very poor. I wonder if this is an intentional move to reduce the emissions profile of the device. The striated spectrum would indicate some sort of digital spectrum-spreading technique is being used. If so, it works, because the resulting harmonic is not suitable for transmitting audio or data. However, the small amount of jitter present in the fundamental at 1 MHz is low enough to avoid framing errors in serial data transmission, which only needs to be accurate to a few percent. It looks like a clever design from Silicon Labs.
Interestingly, this chip is otherwise pretty useful for transmitting on the fundamental frequency, where the small amount of jitter doesn't affect the communication. If you step up to version 4.19 of the linux kernel, you can drive the part to 3Mbps. In older versions, it was limited to 2Mbps. I suspect it can go even higher, since I was able to re-program the limit to 4Mbps on a CP2102N here using the Silicon Labs software:
I don't know if this works yet, since I have to patch the limit in the kernel driver code and re-compile to test it.
Frequency Agility
Even limited to 3Mbps maximum, the CP2012N is fairly frequency agile. You can read the details in the kernel code, but unlike some older serial ports, the CP2012N isn't limited to the usual baud rates. You can set any rate that obeys 12MHz/k, for an integer k. This allows the following 16 fundamental frequencies in the AM broadcast band:
k
Baud Rate
Fundamental Frequency
8
3000000
1.5 MHz
9
2666666
1.333 MHz
10
2400000
1.2 MHz
11
2181818
1.09 MHz
12
2000000
1 MHz
13
1846154
923 kHz
14
1714286
857 kHz
15
1600000
800 kHz
16
1500000
750 kHz
17
1411765
705 kHz
18
1333333
666 kHz
19
1263158
631 kHz
20
1200000
600 kHz
21
1142857
571 kHz
22
1090909
545 kHz
23
1043478
521 kHz
This list gives a decent set of frequencies to play with, even though the harmonics are not very useful.
I haven't compiled a table for the achievable rates from an FT232RL yet, but they appear to be more limited, even though the harmonics are much better.
Now to find a 27 MHz toy to play with...
-
Multiple Modulation Methods
11/28/2018 at 20:13 • 0 commentsSo far, I've experimented with three methods for modulating audio onto RF output from the serial port. They're all pretty simple, and all cause a ton of spurious emissions up and down the band, but are interesting to play with. The first method uses the five selected bit sequences to create a type of pulse-density modulation:
In a normal pulse-density modulation scheme, like the output of a class-D amplifier or the 1-bit delta-sigma DAC inside your expensive CD player, the high frequencies of the pulses are filtered out and you are left with a faithful representation of the input signal. In this case, the high frequencies of the pulses are used as an RF carrier.
As shown in the figure above, the simplest way to modulate a signal onto the fundamental frequency is to sample the audio waveform and quantize the signal level to one of the five bit patterns previously discussed. High levels in the signal result in a higher density of pulses, while lower levels create fewer pulses. The AM receiver then reconstructs this into a representation of the audio signal.
Here are the bit sequences again:
# 0xff -_--------- # 0xfd -_-_------- # 0xf5 -_-_-_----- # 0xd5 -_-_-_-_--- # 0x55 -_-_-_-_-_- CODES = [0xff, 0xfd, 0xf5, 0xd5, 0x55] LEVELS = [1, 2, 3, 4, 5]
given these, the python code to create the serial data stream is easy - we simply quantize to five levels and choose the appropriate character to output for each sample:
def pdm(data): """Modulate using character-based pulse density modulation.""" chars = [] err = 0 for val in data: err = 2 + 2*val idx = max(0, min(4, int(err))) code = CODES[idx] chars.append(code) return chars
The result is a quantization to 2.32 bits since there are 5 levels [log2(5) ~ 2.32]. A 2.32 bit DAC has around 14 dB SNR, so we shouldn't expect too much from this scheme. You can listen to the result as received on an upconverted RTL-SDR dongle with GQRX here:
As expected, the results aren't very good, but the signal is recognizable. If you zoom out on the receiver, you can see all of the spurious emissions created by this method (see below). Luckily, they are fairly widely separated from the fundamental (at 1MHz in this case), so could be removed with a bandpass filter if one really wanted to use this method.
1-Bit Delta-Sigma Modulation
I mentioned 1-bit DACs above. If you haven't seen them before, you'd think that a 1-bit DAC would be pretty useless, resulting in an abysmal 6dB of SNR. The trick to making a 1-bit DAC work is oversampling plus feedback. As shown in the python code below, you simply need to compare the input value to a threshold - if above, a "1" is output, and if below, a "0" is omitted. After each value is quantized this way, the error is saved and added to the next sample. This method is known as a delta-sigma converter.
In this case, a '1' is transformed into a character of value 0x55, while a "0" results in 0xff. These two characters represent the largest and smallest carrier magnitude, respectively.
def delta_sigma_1bit(data): """Modulate using 1-bit delta-sigma modulation.""" chars = [] err = 0 for val in data: err += 2 + 2*val if err > 4: err -= 4 chars.append(0x55) else: chars.append(0xff) return chars
The way this scheme achieves better than a 6dB SNR is by oversampling. In the case of the experiments here, the audio is upsampled to 200000 samples/second (10 bit frames at 2Mbaud). This represents a 200000/11025 = 18.1x oversampling, which results in a gain of log2(18.1) = 4.18 bits. Adding the 1-bit from the quantizer, this method yields about 5.18 bits or 31.1 dB of SNR. You can listen to the results below, and hear how much better this method sounds.
There is one serious problem with this result, though - it generates noise all across the band which you can see in the image below. I'm still not exactly why this is so, but this noise would be more difficult to filter out than the single spikes of the simpler PDM-like method described above.
Multi-value Delta-Sigma Modulation
It turns out that we can combine elements of the two modulation methods above to create an even better one. In this case, we combine the 5-level quantizer and the feedback from the delta-sigma scheme, as shown in this snippet of python code:
def delta_sigma_multivalue(data): """Modulate using multilevel delta-sigma modulation.""" chars = [] err = 0 for val in data: err += 2 + 2*val idx = max(0, min(4, int(err))) code = CODES[idx] chars.append(code) err -= LEVELS[idx] return chars
With the same 18.1x oversampling factor plus the original 5-level quantizer, this method should result in 2.32+4.18 = 6.5 bits or 39 dB of SNR. As you can hear in the test below, it definitely sounds better:
There is an added bonus to this method as well: the distributed noise between the sub-harmonics is greatly reduced relative to the 1-bit method as shown below. This signal looks easier to clean up with a bandpass filter (it's still not great, but it's likely possible).
In all of the outputs, you can hear a number of clicks and pops. I believe this is due to under-running the serial port. All of these tests were conducted on a relatively busy desktop PC, running the transmitter and the GQRX receiver at the same time (but on different USB busses). If the byte stream is first saved to a file, then sent to the port using the linux 'cat' command, these artifacts disappear.
EDIT 11/3018
I've determined that the CP2012N's clock stability is causing distortion in these signals. Results with the FT232RL are much cleaner, although the differences between the modulation methods are about the same.
-
RF from the TX Line
11/28/2018 at 02:14 • 0 commentsThe idea for this project stems from the fact that certain characters sent across a UART serial line combine with the start and stop bits to produce bursts of a square wave at half the baud rate.
These sequences each emit different power at the fundamental frequency (1/2 of the baud rate). In fact, a sequence of 0x55 characters sent across a UART serial line produces a continuous square wave at this frequency - the stop and start bits of subsequent characters are sent with no intervening space. Shown below was an example at 19.2k, producing a 9600Hz square wave. If we crank the baud rate high enough, we can use this to transmit RF signals. The square waves form TTL-level USB-UART bridges also have strong harmonics with which we can reach higher frequencies.
The five different bit patterns each produce their own level of the fundamental frequency and sub-harmonics. You can see the power differences in this capture from GQRX, using a baud rate of 2000000, for an output fundamental at 1 MHz. Each bit pattern was sent continuously for 1 second, with a short space in between.
As expected, the longer patterns have more power. You might expect the 0x55 pattern to bet detected with an AM receiver with an equivalent of around 5x that of the 0xff pattern (5 cycles vs 1 cycle). This 5x amplitude is 25x the power, or around +14dB. This is exactly what you observe in GQRX for the received signal.
Simulating the output spectra using a continuous Fourier transform for the piecewise-linear signal waveforms also predicts this difference. Here are the bit patterns, along with their respective spectra:
You can see from the annotated power levels that the difference in fundamental power between the 0xff and 0x55 patterns is estimated to be 13.9dB, right where we would intuitively expect it.
For our purposes, we'll ignore the sub-harmonics and concentrate on the fundamental and higher harmonics. Of course, this is just an experiment. If you really wanted to transmit anything with this project, you'd need to clean up the emissions by filtering and make sure you're operating in a band and at a power that you're legally authorized to use.
Unfortunately, there does not appear to be a way to easily send a zero-level signal on the fundamental without losing accurate timing of the samples. You can send a break "character" on the serial line, but this has two problems - first, it is not guaranteed to be an exact multiple of the character time, which makes it very difficult to keep an accurate sampling rate. Also, the break is an out-of-band signal from the software perspective, so you can't have an array of bytes with break "characters" intermixed. This slows streaming of data to the UART. So, we are forced to settle for using 0xff as the "carrier off" pattern, accepting only 14dB of dynamic range in the RF signal (but we can use some tricks to achieve more range in the demodulated audio!).
You can also see from the plots that a lot of sub-harmonics are produced for all patterns except 0x55, which is a continuous square wave. In this case, only odd harmonics are generated. If we zoom out in GQRX, we can observe the same thing experimentally:
You can see how the sub-harmonics really drop off with the 0x55 pattern.
Up Next
How do we use these bit patterns to generate an amplitude modulated radio signal? Or at least a signal that can be received by an AM detector?