Showing posts with label HFT. Show all posts
Showing posts with label HFT. Show all posts

Friday, December 3, 2021

The case of the Clicky Carrier - Likely high-frequency trading (that can sometimes clobber the upper part of 20 meters)

Note:  As of 9 February, 2022, this signal is still there, doing what it was doing when this post was originally written.

As of September, 2024 these carriers - and others at various times of day on different frequencies - are still present.  These signals can be found above the 20 meter band, below the 31 meter shortwave broadcast band, and below the 40 meter band - just to name a few. Their specific frequencies tend to vary a bit, but they are easily identified visually on a waterfall and by listening to them.

* * *

Listening on 20 meters, as I sometimes to, I occasionally noticed a loud "click" that seemed to pervade the upper portion of the band.  Initially dismissing it as static or some sort of nearby electrical discharge, my attention was brought to it again when I also noticed it while listening on the Northern Utah WebSDR - and then, other WebSDRs and KiwiSDRs across the Western U.S.  Setting a wide waterfall, I determined that the source of this occasional noise was not too far above the 20 meter band, occasionally being wide/strong enough to be heard near the top of the 20 meter band itself.

Figure 1:
The carrier in question - with a few "clicks".  In this case,
the signal in question was at 14.390 MHz.
Click on the image for a larger version.

During the mornings in Western North America, this signal is audible in Colorado, Alberta, Utah, Oregon, Idaho, Washington - and occasionally in Southern California.  It is only weakly heard at some of the quieter receive sites on the eastern seaboard and the deep southeast, indicating that its source is likely in the midwest of the U.S. or Canada, putting much of the continent inside the shadow of the first "skip" zone. 

From central Utah, a remote station with a beam indicates that the bearing at which this carrier peaks is somewhere around northeast to east-northeast, but it's hard to tell for certain because of the normal QSB (fading) and the fact that the antenna's beamwidth is, as are almost all HF beams, 10s of degrees wide.  Attempts were made to use the KiwiSDR "ARDF" system, but because it is effectively unmodulated, the results were inconclusive.

What is it?

The frequency of this signal appears to vary, but it has been spotted on 14.378 and 14.390 kHz (other frequencies noted - see the end of this article) - although your mileage may vary.  If you listen to this signal sounds perfectly stable at any given instant - with the occasional loud "click" that results in what looks like a "splat" of noise across the waterfall display (see Figure 1), with it at the epicenter

Comment:   If you go looking for this signal, remember that it will be mostly unmodulated - and that it will be subject to the vagaries of HF propagation. 

When a weird signal appears in/near the amateur bands - particularly 20 meters - the first inclination is to presume that it is an "HFT" transmitter - that is, "High Frequency Trading", a name that refers not to the fact that they are on the HF bands, but that it's a signal that conveys market trades over a medium (the ionosphere) that has less latency/delay than conventional data circuits, taking advantage of this fact to eke margins out of certain types of financial transactions.  Typically, the signals conveying this information appear to be rather conventional digital signals with obvious modulation - but this particular signal does not fit that profile.  Why blame HFT?  Such signals have, in the past, encroached in the 20 meter band and distrupted communications - see the previous blog post "Intruder at the top of the 20 meter amateur band?" - link.

Why might someone transmit a (mostly) unmodulated carrier?  The first thing that comes to mind would be to monitor propagation:  The amplitude and phase of a test carrier could tell something about the path being taken, but an unmodulated signal isn't terribly useful in determining the actual path length as there is nothing about it that would allow correlation between when it was transmitted, and when it was received.

Except, that this signal isn't unmodulated:  It has those very wideband "clicks" could help toward providing a reference to make such a measurement.

What else could it be?  A few random thoughts:

  • Something being tested.  It could be a facility testing some sort of HF link - but if so, why the frequency change from day to day?  The "clicks"?  Perhaps some sort of transmitter/antenna malfunction (e.g. arcing)?
  • Trigger for high-frequency trading (HFT).  Many high-frequency trading type signals are fairly wide (10 kHz or so) - possibly being some sort of OFDM - but any sort of coding imposes serialization delays which can negate some of the minimization of propagation delay being attained via the use of HF as compared to other means of conveying data over long distances.  Likely far-fetched, but perhaps the "clicks" represent some sort of trigger for a transaction, perhaps arranged beforehand by more "conventional" means.  After all, what possible means of conveying a trigger that "something should happen" exists than a wide-bandwidth "click" over HF?  Again, unlikely - but seemingly so did something like HFT in the first place!  Additionally, it would seem that the "other" HFT signals that had been present have mostly disappeared - to be replaced by, what?  I suspect that they haven't just gone away!

A bit of analysis:

A bit of audio of this carrier, complete with "clicks" was recorded via a KiwiSDR.  To do this, the AGC and audio compression were disabled, the receiver set to "I/Q" mode and tuned 1 kHz below the carrier and the bandwidth set to maximum (+/- 6 kHz) and the gain manually set to be 25 dB or so below where the AGC would have been.  Doing this assures that we capture a reference level from the signal itself (the 1 kHz tone from the carrier) at a low enough level to allow for a very much stronger burst of energy (the "click") to be detected without worrying too much about clipping of the receive signal path.

The result of this is the audio file (12 kHz stereo .WAV) that you may download from HERE.

Importing this file into Audacity, we can zoom in on the waveform and at time index 13.340, we can see this:

Figure 2:
Zoomed-in view of the waveform from the off-air recording linked above.
These "clicks" seem to come in pairs, approximately 1 msec apart, and have an apparent
amplitude hundreds of times higher than the carrier itself.
Click on the image for a larger version.

Near the baseline (amplitude zero) we see the 1 kHz tone at a level of approximately 0.03 (full-scale being normalized to 1.0) but we can see the "clicks" represented by large single-sample incidents, one of which is at about 0.83.  Ignoring the fact that the true amplitude and rise-time of this "click" is likely to be higher than indicated owing to band-pass filtering and the limited sample rate, we see that the ratio between the peak of the "click" and the sine wave is a factor of 27.7:1 or, converted to a power relationship, almost 29dB higher than the CW carrier.

This method of measuring the peak power is not likely to be very accurate, but it is, if anything, under-representing the amplitude of the peak power of this signal.  It's interesting to note that these clicks seem to come in pairs, separated by 12-13 samples (approximately 1 millisecond - about the distance that it takes a radio signal 300 km/186 miles) - and this "double pulse" has been observed over several days.  This double pulse might possibly an echo (ionospheric, ground reflection), but it seems to be too consistent.  Perhaps - related to the theoretical possibility of this being some sort of HFT transmission - it may be a means of validation/identification that this pulse is not just some random, ionospheric event.

Listening to it yourself:

Again, if you wish to listen for it, remember that it is an unmodulated CW carrier (except for the "clicks") and that you should turn all noise blanking OFF.  Using an SSB filter, these clicks are so fast that they may be difficult to hear, particularly if the signal is weak.  So far, it has been spotted on 14.378 and 14.390 MHz (try both frequencies) which means that in USB, you should tune 1 kHz lower than this (e.g. 14.377 and 14.389) hear a 1 kHz tone.  Once you have spotted this signal, switching to AM may make hearing the occasional "click" easier. 

Remember that depending on propagation, your location - and your local noise floor - you might not be able to hear this signal at all.  Keep in mind that the HF bands are pretty busy, and there are other signals near these two frequencies with other types of signals (data, RTTY, etc.) - but the one in question seems to be an (almost!) unmodulated carrier.

It's likely that this carrier really isn't several hundred kHz wide, so it may not actually be getting into the top of 20 meters, but the peak-to-average power is so high that it may be audible on software-defined radios:  Because the total signal power across 20 meters may be quite low, the "front end AGC" may increase the RF signal level to the A/D converter and when the "click" from this transmitter occurs, it may cause a brief episode of clipping, disrupting the entire passband.

* * * * *

If anyone has any ideas as to what this might be, I'd be interested in them.  If you have heard this signal and have other observations - particularly if you can obtain a beam heading for this signal, please report them as well in the comments section, below.

Updates:

  • November, 2022:   As a follow-up, it would seem that the nature of this "clicky carrier" has changed very slightly.  It appears as though the bandwidth of the "click" is now better-contained and is only a few 10s of kHz wide rather than around 100 kHz wide.

    It also appears that other frequencies are being use - including 14.372 MHz.   More frequencies may be used routinely, but I don't monitor this signal frequently.

  • December, 2022:  This type of signal was noted on 14.380 MHz - and possibly 14.413 MHz simultaneously, making for a total of at least four frequencies where this type of signal has been observed.
  • July, 2023:  This type of signal was noted at 14.413 and 14.446 MHz - "clicks" and all.  Since the previous update, other frequencies have been noted - singly and simultaneously in the same general area.
  • November, 2023:  These same carriers have been observed elsewhere, specifically below the 40 meter amateur band.  Frequencies where these have been noted during the North American nighttime and evenings include 6.810, 6.832, 6.861 and 6.938 MHz.  Other frequencies where these have been observed include 9.081, 9.107,  9.170 and 9.229 MHz.   There are, no doubt, other frequencies at which these carriers may be found during various times of day and to accommodate always-changing propagation and interference - plus it is likely that frequencies are changed frequently... just because.
  • September, 2024:  These carriers - and others at various times of day on different frequencies - are still present, just as described in the November, 2023 update paragraph, above.
  • Related to the above: A proposal to modify FCC Part 90 was made by a group with an interest in High-Frequency trading via the 2-25 MHz frequency range using ionospheric propagation.  This proposal may be read here:  https://www.fcc.gov/ecfs/document/1042840187330/1

 

This page stolen from ka7oei.blogspot.com.


[End]

Tuesday, December 15, 2020

Intruder at the top of the 20 meter amateur band?

It wasn't my intent to have this next post be about locating a source of a transmitter - but the temptation proved irresistible.

Over the past several days I'd been working on an addition to the Northern Utah WebSDR: A temperature-based frequency control of the local oscillators on some of the receive chains.  The receivers in question are based on the Si570 synthesizer and are prone to temperature-based frequency drift, and since they have internal reference oscillators, there is no way to externally lock them.

For this temperature-based stabilization to work, I have correlated the room temperature with the actual frequency, so I have been frequenting the bands/receivers with the aforementioned issues and making measurements - but I digress:  It was during this activity that I noticed this massive signal at the top of the 20 meter band, occasionally firing up and clobbering ongoing conversations by U.S. amateurs.

Figure 1:
  Waterfall display of the signal around 14.350 MHz.  Nearly invisible, on and in the left edge of this monster carrier, are ongoing QSOs underneath this strong signal.  No audio recording was made of this signal as its acoustic property was unremarkable:  It sounded pretty much like a DRM (Digital Radio Mondiale) signal - that is, white noise with selective fading.
Click on the image for a larger version.

What is it?

Upon seeing this, I had my suspicions based on articles that I'd read earlier - but I fired up the TDOA (Time Direction of Arrival) system on the KiwiSDR network, using five receivers within the zone of reception scattered across the continental U.S.  Multiple sessions of direction-finding over several days yielded similar results to this map:

Figure 2:
  TDOA results of the above transmission.  Note that long-distance HF direction finding has significant uncertainties, so the above location is likely accurate to only a few 10s of km at best.
Click on the image for a larger version.

This clinched it - it was likely shortwave-based high-frequency trading.

Who are they?

As you may (or may not) know, the so-called "High-Frequency" trading utilizes the very small differences in the prices of trading instruments (stocks, etc.) that occur over time.  The idea has nothing to do with "HF" like shortwave radio, but rather it is the notion that if one can buy or sell a tiny fraction of a second before someone else, differences in prices may be exploited.  One of the aspects of this type of trading is that conventional means of data transport (e.g. fiber optics) is too "slow":  Light travels at about 1/3 the speed of that of free space through a glass fiber and this means that compared to a radio wave on a "direct" path, data transmitted via fiber will arrive later - and this does not include delays due to the equipment in that data network.

What this means is that some entities are experimenting with the use of the HF bands for the most direct, point-to-point means of conveying this information possible - and it seems that some of this information is being transmitted on amateur bands, as the above indicates.

Not surprisingly, these entities are very secretive - but others have done a bit of digging in public, FCC databases.

Here are a few links:

As noted in the QRZ thread, the Part 5 experimental license frequency includes the entirety of the 20 meter band, with no requirement for identification.

While many amateurs seem to be surprised about this, I was not:  There are several instances where Part 5 licenses have been issued (I can provide an example via email) - the applicant providing frequency ranges in their application that encroach on any number of other services - and been issued permission to operate there - but there's typically a caveat:  They are not to interfere with existing, licensed services.

It's this last point that's a bit tricky.  Anyone that has operated on HF knows that this is a dicey proposition as it's entirely possible that other users of a particular frequency may not be able to hear - or be heard by - the "offending" station.  As an example, if station "A" and "B" are in QSO - but the offending station can only hear - or be heard by - station "A", it cannot "know" to avoid transmitting while station "B" is transmitting.  It would seem that those who make the rules have overlooked this particular of aspect of HF propagation when it comes to utilizing HF "whitespaces" (e.g. seemingly-unused frequencies.)

"I've been getting QRM'ed - what can I do?"

The complete list frequencies on which these operations are currently unknown - and the fact that they are not assigned specific channels may make such information impossible to know other than by direct observation.  So far, the two frequencies of which I'm aware is that depicted above (around 14.350 MHz) and another around 14.4 MHz - but I have little doubt that there are others:  If you spot similar signals on other frequencies, please comment.

If you note similar interference issues, please contact your amateur radio representative.  In the U.S., you may contact the Volunteer Monitor program at the ARRL (see information here.)  Unfortunately, a quick search did not reveal any specific contact information regarding this program:  If you have such information, please let me know via a comment. 

* * *

Update:

"Luke" noticed this post and tweeted it, emailing me a few links:  Here's a bit of information others have dug up:


This page stolen from ka7oei.blogspot.com.

[End]