โHardware acceleration in trading
For some years, high-frequency trading (HFT) firms have invested in faster software and lower latency networks, but more recently their focus has turned to increasing network bandwidth and hardware processing speeds.
Looking to increase revenue, traditional software is being replaced by hardware implementations of financial algorithms, bringing the algorithms much closer to the source of the exchange data. As a result, financial markets are becoming increasingly competitive and latency-sensitive.
Hardware acceleration explained
HFT has transformed the stock market, and currently equates to around 50% of stock trading volume in the USA. However, it has been extremely controversial in the process. Using complex algorithms, this system of trading scans multiple markets for the smallest of opportunities and executes millions of orders at lightning speed. Traders might only make a small profit on each transaction, but by working fast and at high volume the returns can be considerable.
Speed is of the essence for HFT firms: the options market trades around 40 million contracts every day. This is why Field Programmable Gate Array (FPGA) technology โ a reprogrammable device that allows algorithms to be compiled into hardware running at near processor speeds โ has piqued the interest of the trading markets.
These silicon chips combine the best parts of custom designed ASICs and processor-based systems and accelerate functions otherwise performed by software.
FPGA: impact on the industry
As financial markets are pushed towards hyper-liquidity, trading strategies are being forced to evolve. Decision-making relies less on human intervention and more on algorithms fed by high-speed, automated digital data feeds.
Using FPGA-based systems, trading firms are able to select the data they want to watch. These systems also help ensure trading strategies achieve the right balance of speed, low latency, precision execution, and cross-asset trading.
Benefits of FPGAs
FPGAs bring with them a number of benefits:
They accelerate some processes by an order of a magnitude (or more)
The latency of this hardware means an end to the โjitterโ experienced with software and brings an edge to companies that utilize the technology
They can be reprogrammed spontaneously (either completely or partly), avoiding the need to bring down an entire system simply to change a program
FPGA processing is more deterministic, thus reducing functional risk and simplifying testing
Risks to the industry
Even though the benefits of FPGAs to traders are clear, uptake has been relatively slow. Firms looking to invest need to consider key factors, from regulatory changes to the rising costs of these solutions. Usage is often limited to recognized network applications, pack inspection, and digital feed handling.
Once HFT firms have invested in a FPGA-based solution, the race is on to develop smarter, more efficient, and more profitable algorithms. But FPGA development is much more difficult than software, and lead times to deployment can be lengthy. With ongoing support in short supply, firms risk losing that competitive edge.
Programmable hardware requires a totally new approach and much more planning than software. CPU-familiar software engineers lack the required skills, so the recruitment challenge is finding individuals with the right combination of financial and engineering skills. Because such talent is in short supply, candidates with the right skills can command high salaries and may not want to stick around once a project has gone live.
The business perspective - the hiring picture
Over recent years, hiring for hardware talent within the trading industry has been high in Chicago in particular. A couple of firms have been very aggressive with hiring and scaling (with teams of over 10+ engineers) whilst others have focused on building small, dedicated teams. Whilst a handful of firms are very much on the right track and led by engineers who truly understand the industry, there are still trading firms who are heading down the hardware route with little strategy behind it.
Without a doubt, it is a candidate driven market and there are challenges faced by many firms in a bid to source and attract talent:
Lack of industry knowledge. The majority of hardware engineers in the industry are on their first or second role within a trading firm. It can be difficult to tear them away โ they are compensated very well, their work is still greenfield and exciting, plus they typically have hefty non-competes (unless they are in California, of course).
This means that firms often look for candidates outside the industry. This has its own challenges. The majority of this candidate pool is based in Silicon Valley, where their skills can be applicable to multiple different industries in the start up world. For many of these candidates, relocating to Chicago to work in a trading firm is simply not on their radar or something that they are interested in.
Narrow Focus. Many hardware engineers in technology companies โ and especially those employed by larger companies โ have responsibilities narrowly focusing on hardware development where knowledge in one or more additional fields including software engineering, algorithms, network engineering, or finance is desirable for careers in trading.
The interview process. Many trading firms are still refining their interview process for hardware engineers. We have seen some cases of over 100 candidates being interviewed for one hire.
Recommendations to source talent
Tap into candidate pools in locations such as Seattle, Idaho, Toronto, Phoenix.
Take time to โsellโ and explain the firm/industry early on in the interview process. Some candidates have little knowledge or awareness of what a trading firm does and need to be educated on all the benefits early on.
Be flexible and understand that many professionals will come from consulting or contract backgrounds โ something that is typically frowned upon by trading firms.
Recognize that you need to be flexible and competitive when it comes to compensation.
The professional's perspective โ the future is bright
Although the above paints a somewhat difficult picture from a business perspective, in fact, the outlook is bright for professionals and it is a great time to be a hardware engineer. Whilst 10 years ago, traders were seen as the key to success within an HFT firm, hardware engineers are now an essential. Compensation packages can be upwards of $500,000 total compensation for a seasoned hardware engineer within the trading industry, there are many projects are still in early stages, and professionals are highly sought after by organizations.
Contact Selby Jennings today to learn more about attracting and retaining hardware engineering talent, or explore open sales and trading roles.