Family of FPGAs, power high-speed video and imaging with expanded CoaXPress support. My name is Emily, and before I get started, I'm going to play a quick housekeeping video. Let's move this one here, this one over here. Oh, hey there. Before we jump into today's presentation, I want to share some cool features and functionalities of the webinar console. Guess what? It's completely customizable. Now, you may only see a few windows on your screen. However, if you take a look at the taskbar below, there are various widgets you can launch to add to your screen. Boop. Take notice of the Ask Question widget. We encourage you to ask questions throughout the presentation. While our presenters are busy delivering exciting content to our audience, they are always supported by subject matter experts who sit behind the scenes and help answer questions they cannot address live. Now, grab a coffee, a pen, and a writing pad, and enjoy today's webinar. Now that we've covered those housekeeping items, I would like to remind you to please utilize the engagement tools available for you to use throughout today's session at the menu bar at the bottom of your screen. Now, without further ado, I'm going to introduce our presenter for today's session, Apurva Peri. Apurva, please take it away. Hey everyone. Thank you, Emily. Hello and welcome to the webinar today. Thank you for joining in. I'm Apurva, and I drive industrial product marketing for FPGAs at Microchip. Today the topic for the webinar is high-speed video and imaging with CoaXPress. What's on the agenda today? I'm going to talk a little bit about what CoaXPress and GenICam are, a little bit of details about each of these protocols and what applications they're used in, followed by the PolarFire FPGA implementation for CoaXPress, which will also include a small video clipping of a demonstration, followed by our smart embedded vision portfolio using PolarFire FPGAs, which is tailor-made for edge applications, and I'll tell you why. So let's get started. What is CoaXPress? It is a royalty-free open standard for point-to-point serial communication, and it's a preferred standard for high-performance, high-vision processing type of applications. So it can carry high resolutions and offers low latencies. The current standard for CoaXPress, which is available as part of our solution, is CoaXPress 2.0, which offers up to 12.5 Gbps of data and over 40 meters of cable length. It's not just the standard doesn't support just video data, but also power delivery and camera control and trigger data and so on. It's great for extended reach with low latencies. The image you see on your screen is that of a single-lane setup, single channel of CoaXPress with a single frame grabber on the host side. But this is easily scalable. So you can build a 4-channel frame grabber, which will give you up to 50 Gbps of video data and also scale it to 2 4-channel frame grabbers, so essentially 8 channels, which can potentially give you 100 Gbps of video data transfer. So what typical applications we talked about features and benefits on the previous slide. So intuitively, anything that requires long distance, high data rate, low latency video transmission, CoaXPress becomes a popular choice, one such being a lot of medical inspection, medical devices like endoscopes, intraoral inspection events, surgical microscope protocol, and any generic machine vision protocol like surveillance and security. CoaXPress is easily retrofitted, simplified because a lot of these legacy systems use coaxial cables already. And so that makes retrofitting these much simpler. In our experience, specifically with the PolarFire FPGA CoaXPress solution, we've seen significant success in the medical space and specifically manufacturers that develop endoscope applications. What you see on your screen is one such high-level example. On the camera side, you have an image sensor interface. It could be MIPI-based, it could be SLVS-EC-based, it could be the simple LVDS signals. Whatever it may be, that is processed by a PolarFire FPGA, converted to CoaXPress data with our IP, and that is sent over, again, Microchip's CoaXPress PHY to the host side. Now, the host side, again, can be another PolarFire FPGA, which can do a bunch of more processing after converting this data back to whatever format is required, or an industry-standard frame grabber, which I'll talk a little bit more about in subsequent slides. But the application is fairly simple, but it has extremely stringent, particular, specific requirements, intuitively so, because it is a medical application, one that comes directly in contact with the human body, and no errors can be pardoned. So this whole setup that you see here functions at a temperature way below 45 degrees Celsius. So thermal constraints taken care of. And also, we offer this is the PolarFire 100 device, which comes in 11 by 11 package as well. So it's a very small form factor and offers up to 50% lower power than most of our competitive devices. So that's a popular medical application successful story that we've had. And the second thing is the GenICam standard. So the PolarFire CoaXPress solution offers compatibility with GenICam. It inherently supports this standard. What is GenICam? It's a unified API for camera control. Now, it is agnostic of what transport interface is being used. So it could be CoaXPress, it could be something USB-based, it could be Ethernet-based. But the goal is to standardize camera control and how the host interacts with the camera on the device side. So there is essentially a single XML file which stores both technology-specific and technology-agnostic information like a register information and all the controls that can be controlled in the camera, describing the register space of a device. And this is typically provided by a camera manufacturer. And this information can be shared back and forth and controlled by a host. So our solution supports all of the functions that are specified by the standard itself. Okay. What the PolarFire FPGA CoaXPress solution looks like specifically, a little insight into that. So what you see on your screen is the demonstration setup. The kit to the right includes camera sensors. It's a CoaXPress device port. Also includes a PolarFire 100 FPGA device and Microchip's EqcoLogic CoaXPress PHY, which does equalization as well. Incoming video stream is transmitted over coaxial cable. Then on the host side, we are again using over FMC, another CoaXPress PHY, which receives the incoming data. Then the PolarFire video kit, the kit in green, uses this data to convert it into raw, store it on DDR, and do a bunch of processing. At the bare minimum, this particular demo displays it using an HDMI-compatible display screen. That is a high level. You have incoming data over MIPI, converted to CoaXPress, transmitted over coaxial cable, received by PolarFire FPGA, processing done on it, and then displayed. The demo setup I showed you on the host side was a PolarFire FPGA. But this setup would also work with any industry-standard frame grabber. We have tested specifically for interoperability with all of these off-the-shelf popular devices. If you want more information about interoperability and what it means for each of these devices, you'll find more information in our CoaXPress application note, which will be in your resource section. Okay. A little insight into what the video flow, the pipeline looks like, starting from the image sensor all the way to the PolarFire kit. Initially, there's a single stream of video coming in over MIPI CSI-2. This is 4K video at 30 frames per second, which is converted using the CoaXPress IP, device-side IP that's running on the PolarFire 100 device, which converts MIPI data into CoaXPress data. Then this data is transmitted over coaxial cable. This is specifically done using the Microchip CoaXPress EqcoLogic PHY, which is then received by a host IP on the PolarFire host side, which converts this back to raw video and stores this down on DDR, which, by the way, is onboard the PolarFire video kit. For the purposes of demonstration, we run a bunch of ISP. The color filter array is converted to RGB format. We have contrast, brightness, color balance running as basic ISP. We also display this on an HDMI-compatible display like I talked about earlier. The solution comes with a graphical user interface, which includes two big functions. Firstly, controlling camera settings and interacting with the device side over GenICam. The second is providing for ISP control, which I will talk about a little bit later. The GUI is able to retrieve and display the XML file over GenICam standard. We talked about the video flow, how things work end-to-end. But I want to give you some insight into what is specifically happening on the device side, on the image sensor side, how GenICam is enabled, what does the interaction look like. That's the image on the left, the block diagram that is titled PolarFire FPGA CoaXPress device port. It is running a soft RISC-V CPU, which is called the Mi-V soft CPU, which essentially does three main functions. It's running the GenICam API and the GenICam transport layer. It is also driving the camera sensor. And it's running the drivers and interacting with it directly. It also controls the camera register space. And lastly, it maintains and controls the XML file as specified by the GenICam standard. Now, this soft CPU directly interacts with the CoaXPress device IP, which then takes care of the remaining video flow and functions that we talked about earlier. So that's what this looks like. Now, this is the device side. This doesn't change. It's a fixed function irrespective of what is on the other side. So the host could be a standard industrial frame grabber from any third-party device like the one you see here. That's the example. But it could also be a PolarFire video kit, for instance, which serves as a proof of concept as well as a ready-to-use reference solution that you could use to jump-start your application development. So it works either way. So that's how the device and host interact. And we talked about the graphical user interface, which includes ISP control as well as GenICam functions. This is a snapshot of what is offered. On the left side, you can see you have ISP control for alpha blending. You can enter values in real time and see them change on the screen for contrast, brightness, color balance as well. On the right side, highlighted in green, is the GenICam function. What you're seeing is the XML file, a copy of it. You can manipulate and change some of these values as specified by the standard. You can export this XML file, read to it, write from it sorry, write to it, and so on and so forth. You can also control the video in the sense that you can start and stop the video over this graphical user interface. It's a fully functional, multi-control sort of interface. These are the GenICam commands that we support inherently. If you're using the video kit, you can read and export the XML file, start and stop video like we talked about, and also flip the video both horizontally or vertically, generate a test pattern instead of using a camera stream, can read and write bootstrap registers, and also in real time change the data rate. But of course, these are the supported data rates as specified by the CoaXPress standard. So like I mentioned, we have a short clipping of video. Now, this video will outline the PolarFire device-side CoaXPress card with the image sensor working in tandem with a third-party host that is plugged in over PCIe to a Windows machine. I hope you can see the video. So what you're looking at is a third-party frame grabber that has connected over PCIe to a Windows machine. On the outside, connected over coaxial cable, what you can see is the PolarFire CoaXPress device card with the image sensors plugged in. This is currently not turned on yet. But when it does turn on, we have a laptop stationed right in front of this camera sensor. So that is the video stream you'll be able to see when we turn this on. Okay. There you go. This is over HDMI. We're able to see live stream of video. We have a laptop that's playing a Microchip video. So you can see that. You can also control various aspects of that video and the camera over GenICam in real time. So this is a working video of a single instance. We do have a similar setup working and running for multiple other third-party frame grabbers and the PolarFire video kit. Right. So we talked about CoaXPress. We talked about GenICam. We talked about the solution. But what we are what the goal of the solution and its targeting the application is at the edge. It's become common knowledge that everyone is moving intelligence to the edge, be it aerospace and defense, 5G networks, industrial networks, medical, and you name it. Everyone is moving intelligence to the edge. There has been a recent report that was published that says that 75% of enterprise-generated data will move to the edge by 2025, which is but just a year from now. So that's where the future of applications is headed. We are fully cognizant of it. And we believe at the core of a lot of these edge applications is some sort of vision processing. And vision processing at the edge has a set of unique specific demands. For instance, they have very low power budgets. They are oftentimes battery-powered and remote. Thermal constraints, you cannot afford the additional budget for heatsinks or fans. At the same time, the performance requirement is pretty high. You want high resolutions, improved accuracy for object detection, and so on. You want to be running multiple 4K channels, 8K channels, even integrate at the bare minimum basic AI and ML inferencing just to do basic tasks. And intuitively, of course, safety and security, always a big factor for every type of application, especially at the edge where a lot of devices could possibly, potentially be remote and unmanned. So a security breach on such devices could be catastrophic. And so our smart embedded vision portfolio specifically caters to a lot of these applications with the PolarFire FPGA. And we have a fully comprehensive end-to-end solution. It's a one-stop shop. We have an IP portfolio supporting evaluation hardware, solutions. Of course, this is all bolstered by our PolarFire family of FPGAs. What you're looking at on your screen is our IP portfolio, which spans the entire video pipeline starting from the image sensor. We have interfaces for MIPI, for SLVS-EC, followed by all the key basic image sensing sorry, image processing protocols and methodologies, memory controllers, deep learning inference, again, something we offer in-house, compression algorithms like H.264, MJPEG, and a whole host of popular industry-standard display interfaces and transport interfaces. CoaXPress 2.0, which supports up to 12.5 Gbps, is one such transport interface, which is what we talked about today. Now, some of these we develop in-house. Some are partner-developed. Irrespective, they support our entire IP spanning the entire video pipeline. Like I mentioned, we have application-specific purpose-built hardware to support evaluation of these IP and reference solutions, the first one being the PolarFire video kit, which includes the dual camera sensors with FMC and HDMI. We saw this in our demonstration today, part of it at least. Then we have a kit with the PolarFire SoC video kit, which includes all the features that the PolarFire video kit offers and builds on it by adding Linux, PCIe, and dual Gigabit Etherne t ports. We also additionally include a portfolio of FMCs, which add as expansion cards, which range from USXGMII to SDI. Of course, one such is our CoaXPress FMC card, which includes the device-side card as well as the host-side card. With our PolarFire family of FPGAs, we have truly established power efficiency leadership. This is evident in the unprecedented growth we've seen in our portfolio. In this year alone, we've seen 31% growth, which is way above average industrial growth for similar competing devices. Over 65% of our top customers are at the intelligent edge. We tailor our solutions and a lot of our IP to meet the demands at the edge. There are specific product lines that solve those unique challenges. Lastly, in its fifth year since production, PolarFire has seen 90% year-on-year growth. This is purely bolstered by our power efficiency leadership, exemplified by the fact that PolarFire offers two times the power efficiency as compared to most of our competing devices. That brings me to the end of our webinar today, a quick summary of what we talked about. So CoaXPress 2.0 evidently plays a crucial role in the future of machine vision applications in terms of high performance, low latency, long reach type of applications. With the PolarFire FPGA CoaXPress solution, it is a very comprehensive one. We offer evaluation hardware, IP, and a reference solution, which serves as both a proof of concept and a ready template for you to get started on your application development very quickly. We support GenICam interface inherently, so great for interoperability. You can pick up any third-party frame grabber, and it will work with our PolarFire FPGA. And we've seen tremendous success with a lot of customers, especially in the medical and industrial automation space, that we specifically want, of course, because of PolarFire's exemplary feature set, but also because of our CoaXPress solution. So I do request that you stay tuned. We are working on an upgraded support to include multi-lane support with CoaXPress for higher data rates. So watch our website for more information. And if you have any questions, comments, concerns about what we talked about today, please feel free to write into fpga_marketing@microchip.com, and we'd be more than happy to help you. That brings me to the end of it. If you want any help with the resources, application notes, reference solutions, where to purchase the kit, all of those links will be provided to you under the resource section. So do check them out. They should serve as a handy tool for you to get started quickly. That is all I had for today. Thank you, Emily. Over to you. Yeah. Thank you, Apurva, and thank you to our audience for attending. We do have some questions that I am going to ask Apurva. For starters, what lower speeds are supported by the CoaXPress IP on PolarFire? Okay. So the PolarFire CoaXPress IP supports six speeds starting from 1.25 Gbps all the way to 12.5 Gbps. This is as specified by the standard, and this is a downstream support. We also support for low-speed signaling and upstream speeds of 20 or 40 Mbps, again, as specified by the standard. So it's a comprehensive solution that supports all the speeds as specified. Great. Another one that came in is, what is the resource utilization and cost of the IP? Okay. So there are two parts to the IP. So the host-side IP utilizes about 7,000 LUTs and the device-side about 8,000 LUTs. Now, this IP is license-locked for the Clear RTL. So if you want to purchase that, that would be $5,000 available on Microchip Direct. But the encrypted version is available for free. We also offer a test bench with the IP to test and check both the host and device side. So I recommend you if you want to if you want to go and check that, that'd be a great place to start. Great. Another question is, I am using PolarFire SoC in my current design. Can I use this IP with it? Yes, of course. It's compatible. The IP is developed for the PolarFire FPGA fabric portion, and you can use it both on PolarFire and PolarFire SoC. This will also be mentioned in the IP user guide. So take a look at that, and you should get more information. Finally, a question. What will the multi-channel solution include? Okay. Early days, but we are working on developing potentially a four-channel CoaXPress solution. So that might be able to support up to 50 Gbps. But again, so do watch our smart embedded vision webpage for more information. We will release it as and when it's available. That's all the questions that we had from today's audience. Again, thank you, Apurva, as usual. Thank you to our audience for attending today's session. As a reminder, you can utilize the link that you used to register to watch on-demand at your convenience. Thank you.