Back to this BofA Global Technology Conference. I'm Vivek Arya from BofA's Semiconductor, Semi Cap Equipment research team. I'm really delighted to have the team from Advanced Micro Devices join us this morning, Jean Hu, Chief Financial Officer, and Matt Ramsay, Head of Investor Relations. I'll go through my questions, but please feel free to raise your hand if you would like me to bring up something. Really warm welcome to you, Jean and Matt. Really appreciate you joining us - Yeah. Thank you. - at the conference. I guess exciting times in AI and the semiconductor industry. Maybe Jean, as a start, just walk us through your state of the union, right? The growth has been very strong, right, since the start of the year. What has surprised you? Which are the areas that you think you are seeing the best growth right now, and which are the areas which have been pushed back because of this? Yeah. First, thank you for having us. Thank you all for joining us. I think the biggest change during the last few months is really the rise and inflection of agentic AI. Right. You can see continued momentum from training to inference, from AI adoption experimentation to more adoption at scale. When you look at that, agentic AI, it's not about answering question anymore. It's about orchestration, it's about database access, and a lot of tool execution. All of those require significant CPU performance. What we're seeing is very significant and the incremental demand for our CPU platforms. That has been really exciting. At the same time, we also are seeing economics of AI keep changing, right? With the token generation going up so quickly, all the customers are really focusing on performance, TCO, and they are really trying to figure out how you use different compute to address different application and the workload. We see demand for GPU going up, CPU, and also a lot of other ASIC LPUs. I think from AMD's perspective, you know our Q1 performance. Right. We had a record CPU performance. CPU business grow more than 50%. We guided the Q2 CPU performance is going to go up year-over-year 70%. That has been really exciting. All those things really benefit us because we have been investing in GPU, CPU, adaptive compute to also address literally end-to-end applications from data center to client to gaming. That feels like right now all the engines are really driving the business revenue growth, so very significantly. Got it. I think the growth in CPU has been kind of the biggest positive drivers this year. We are kind of tracking this 2030 or late end of the decade type of addressable opportunity, which I think you were the first to point out would be $60 billion. Arm said, "That doesn't sound that high enough." They took it up to $100, then you took it up to $120, and Jensen said, "Well, could be even more than that," right, up to $200. What do you think is the difference between all these forecasts? This is one of the most frequently asked questions from the investment community. What is the right number? How does one get to it? Is there like a simple unit, and are we just all using different ASPs to get to a different number, and everyone has the same unit growth? You're asking a lot of questions here. I think maybe let's take a step back. You are absolutely right. AMD was the first one. Literally last year, we start to talk about how AI drive the demand of CPUs. Last November when we had our financial analyst day, we actually outlined how we think about this opportunity under the TAM. We basically said, "Okay, we are thinking three segments." One is the traditional general compute, which we are all very familiar with, has been driving the traditional enterprise application across the board. The second category is the head node, which is really the communication with the GPUs. You want speed to make sure you have the communication. We also outlined agentic AI last November, which is still very early, but our team already see the early signs for agentic AI. That has been the fastest-growing market in our view. That's when we said, "Okay, we believe the TAM is going to grow 18% CAGR to $60 billion in 2030." Remember, the general purpose CPU used to be just a single-digit growth. Right. That market expansion, we saw it earlier, but we never estimate it's going to be so fast. The pace and the speed of agentic AI adoption has been tremendous. When you look at the January, February, March, all the enterprise adoption started. You see Anthropic, OpenAI, their revenue has been going up very significantly. The demand for CPU continued to go up across all our customers. That's when we had our earnings call. We actually updated our market forecast to more than $120 billion. It's still very early when you think about agentic AI adoption. What we are seeing is with agentic AI, it's quite complex when you have millions of operations you have to execute. When you have a lot of agent concurrently working on different tasks, you actually need a very high core count CPUs. We don't know what other companies, how they think about the TAM and the SAM. We go through the bottom-up and the top-down approach. We know at this particular point, we feel pretty good about more than $120 billion, but it's evolving so fast, and the more complex you should expect for the agentic AI portion of the market, because you have so many diverse workloads, so complex, the ASP will continue to increase because increasingly you need a very high core count CPUs, high performance CPUs. Matt, I don't know if you have other you can add here. Sure. First off, thank you, Vivek, for hosting us and for you guys all coming. I think there's a couple things, Vivek, that I would maybe add to Jean's comments. One is, I think for this whole audience and us included, we were trying to figure out when was the primary driver of AI CapEx going to go from almost predominantly large model training and start the shift towards inference being a primary driver of CapEx. We're seeing that happen in real time. I think the more powerful thing for our business and maybe the more transformative thing architecturally is during that transition, you're seeing chatbot inference become agentic inference, and what agentic inference does as a workload. You daisy chain or concatenate all these automated agentic flows together, between each inference task, there's a lot of CPU diverse work, so post-processing of data, figuring out what to tell the AI to do next, often based on the result of the prior inference. Where do I get the data from for the next step? Is it in a cloud? Is it in an ERP system, a payment system, a CRM system, wherever? Get all of that data, come back, post-process the data and from that step, and feed it into the next agentic step for the AI. That workload is quite diverse. That's what we're seeing driving the demand for Turin, now in real time. As the order book fills in for the 256 core 2 nm Venice parts, that are going to launch in a couple of months and be the primary workhorse for next year. That's why we're seeing the order book really expand. Got it. Is there a way to segment that market, whatever it happens to be? $120 billion+, in those three segments, Jean, that you described, the kind of the traditional applications, let's call it part of the AI cluster and then agentic kind of standalone CPUs? I think a traditional segment, it's very clear. I think 2025, a different third party would say that's a $25 billion-$30 billion market opportunity. It will continue to grow. As Matt has mentioned, is you actually have an agent doing more work on the traditional database. Right. That traditional general purpose CPU, it's probably steady growth, but not as high. The head node, which is working with the GPUs, you can see that's when people talk about the ratios, is traditionally it's one head node CPU manager, eight GPUs - Nice. - two to, yeah. It's getting more and more. Over time, that ratio is changing. We do think the head node segment CPU will also grow very fast, much faster than the traditional general CPU. The most exciting portion of the market is actually agentic AI. Agentic AI, you actually are seeing agentic AI server rack sit in between the traditional servers and the GPUs. Those racks are handling all those different workload to really make sure all the agentic agent works. That market, we think by the whatever, the $120 billion or $200 billion market opportunity is majority of that large market. Over 50% of - Over 50%. - that market you think is that standalone? Agentic. Yes. Yeah. It's still very early right now, but if you just think about what Matt said, how complex, how dynamic those workload will be, and we do see significant productivity improvement, especially software engineering side. Nice. Those are very complex workload. You really need different core counts. You need really high performance, high core counts. You also need simultaneous multi-thread, all those high performance, you can manage millions of agent potentially. Got it. The final question there is actually two last questions. One is x86 versus Arm. If let's say that agentic opportunity does capture the dominant share of whatever that TAM number happens to be, what advantage, and if I dare ask, what disadvantage does x86 have versus Arm in capturing that? I'll start. Matt can talk about the more technical side is the way AMD has been thinking about it has never been, oh, x86 architecture or Arm architecture. It's more about how we provide the best TCO for customers. For us, the performance is number one. Secondly, what we have been trying to build is the breadth and the depth. For platform portfolio. If you look at our CPU platform, we have gone through five generation at the Turin and the Venice is next generation. We have the breadth from the core count to 8 to 16 core count addressing enterprise applications to the Venice will have 256 core count. For us, we have all different configuration design points to meet all the different compute to give them best TCOs. I don't know technically you can provide them. Yeah. Vivek, I think as Jean talked about, the three different buckets, right? The traditional server workloads for enterprise, I think there is an affinity towards x86 because of the code base. Many of those servers are deployed on-prem, some of them are deployed in third-party cloud. It's basically the same workload depending on where you want to deploy. I think as these agents generate more traffic to all those traditional systems, the x86 ecosystem is well positioned there. You have the head nodes. I think that what you really need in head nodes is really high single-thread performance, really high bandwidth to, I don't know, it's not a technical term, but feed the beast of these really expensive accelerators that are in the box, right? We will do our own head nodes for Helios. I think our large competitor in their NVL racks will basically do their own head nodes. There's a bunch of different XPU programs that are going to be launched by the industry. I think when we have those conversations with customers, it's much more about what is the performance of your CPU such that I get the best utilization out of this really expensive XPU that I'm buying. It's not an Intel or AMD or x86 versus Arm conversation. It's a what's the best server part. When you talk about these agentic racks, it's really about how many concurrent agents can you run per rack or per megawatt of compute. As Jean mentioned, really high thread and core count products. I think our roadmap is differentiated there. Another thing that doesn't get mentioned, but I think is important, is if you think about the dollars of CapEx that are going to come into the server market, the mission-critical nature of these systems, both head node and agentic racks. Some of the RAS features and the security features of the x86 ecosystem, it's not an x86 architecture thing, it's just we and our x86 competitor have been put through the paces by every hyperscaler and most enterprises on all of these security features for a decade. You might imagine, you get into these automated flows where those agents have access to mission-critical data, and you want to really have servers that have robust security features there. We feel we get brought into essentially every RFQ that's in the industry for these servers, and I think we're positioned to win a very high percentage of them. Got it. Now, your x86 competitor has their own fab. They are planning to add a lot more capacity on the server CPU side. I guess this year every CPU is being sold, right? Do you think that there is a scope for share shifts given that your competitor has incremental capacity to devote to this, or you think you will be adequately served by your foundry ecosystem? Yeah. We have been very pleased with our share gain trajectory. I think the last Q1, which is announced, we actually from a value share perspective, we got to like a 46%. Nice. When you think about it, our success is really tied together with TSMC. From day one, we have been using TSMC. We work together with our chiplet design, with the packaging technology to come up with the best performance server platforms. That continue to benefit us going forward. We have been planning for this ramp since last year. If you look at the Q1 performance and the Q2 guidance, when we guide year-over-year 70% increase. A lot of you actually know is right, the way we first started six or nine months ago. It is the early planning, how we work with the TSMC to make sure we get support to continue to drive the ramp of the supply. The demand is tremendous. Supply is still tight. I think for us, for this year, next year, every supply we can get, we can provide to our customers. We're going to continue to do that. It's the planning beyond the 2027 right now. For the longer term, I think we'll continue to work with TSMC and prioritize data center as how we drive the business growth going forward. Got it. Vivek, one little thing that I would add to what Jean mentioned there is when we have conversations with the investor community on this particular topic, I think one thing that I've noticed is supply is tight, right? 3 nm tight. There's a lot of other areas that are tight, and I think we're very well-positioned with the relationships Lisa has personally with the executives in that space to get maybe more than our fair share of the incremental. It is tight. I think what I've noticed is maybe the investor scoping of what Lisa and the team initially asked for in 2026 and 2027 maybe didn't imagine how much growth we had already planned for in supply. Things are tight, but we've already asked for and already been sort of, quote-unquote, "granted" from TSMC, I think we're having the right conversation there, but maybe not at the right starting point from what we were sort of allocated initially. Got it. Final one on the CPU side on price. You mentioned 50%+ growth in Q1 and then 70%+. I think there was a sense that one could sustain this - Yeah. - for the rest of the year. How much of this, Jean, is pricing versus unit growth? Let me just add quickly part B to that. As that agentic, that third segment, becomes a bigger portion, do you think that can command much higher ASPs? When I talk with the Arm camp, they're talking about ASPs in the $3,000, $4,000, $5,000 range, which is well above the ASPs that AMD is able to get. Just unit versus ASP and just the trend of ASP. Yeah. I think as you mentioned, both the more than 50% growth in Q1 and that we guide the Q2 70% year-over-year, more than 70% year-over-year increase, two-third of that actually are unit growth. Majority of our revenue growth actually come from unit expansion versus ASP increase. Your point on the ASP going forward, especially with the agentic AI, is a great point. What we're seeing is we're at the early inning of agentic AI adoption. You can already see with the software engineering part of agentic work, autonomous agentic workflow, you really need a very high performance, high core counts, CPUs. Right. That tend to have a higher ASP. I think a generation over generation, when we go to 2 nm with Venice and the future generation to handle complex workload to provide the performance, you tend to see the CPU price continue to increase. The other thing I would just say is because we have a really large platform, the CPU ASP is really determined by the mix - Right. - by the different configurations for different workload. For enterprise, the per core ASP is very high, but because the core counts are relatively low, so ASP is relatively low, but the gross margin is great. It's very nuanced from our business because how big our platform is and how complex all different design point we're helping our customers. Got it. You spent two thirds of the time on CPU, let's talk about GPU. It's great. GPU now. You are at the start of launch of a major rack-scale system to your portfolio. Maybe give us a status update of how you're feeling. When your competitor launched their first large scale up product, it took a while for the industry to get ready, liquid cooling and all those things to get ready. How do you think about your progress so far? How excited are you about the second half? Yeah, we are on track. We sampled MI450. We expect to be launching in second half or Q3 starting point and the Q4. As you know, we have been preparing for this launch for a long time. We acquired ZT Systems in 2024. The whole reason we're acquiring ZT Systems is to help us to add capabilities in system-level design. We also have worked on the networking side. The whole team has been working to prepare this launch. We know it's very hard. It's very complex, very hard, but from execution perspective, our team has been on track, meticulous prepare for all different aspect launch. Not only technology software side, but more importantly, the supply chain side, how you make sure the design redundancy with all the components, but also supplies even very small components, you have to make sure you have supplies. That has been the whole team's execution track record. We feel pretty good right now. Vivek, I think we're anticipating, as Jean said, we already have sampled and we have a number of customers that have full Helios racks in their own data center running their full production workload now and testing and doing all those things that you would expect us to be doing at this point in time. The customers learned a lot, we learned a lot from some folks that blazed the trail, as you mentioned. We're going to really focus on a concentrated set of ODMs as we launch for the first number of months until we get up to scale, not like a few systems, but billions of dollars of scale. We'll be expanding the ODM ecosystem pretty significantly as we move through next year and get towards the MI500 series and whatnot. We feel good about where we are. The initial work that the customer base is doing in their own labs with sampled systems has gone very well. Now it's about We'll see a pretty significant jump in the fourth quarter of revenue, another fairly significant jump in Q1, and then we'll go from there. It is wood, so touch wood. Everything's going exactly as we'd hoped it goes. When you're doing a thing like this, day to day, there's always something. Our job's to keep the duck calm on the top as we kick on the bottom and get ready to ramp this thing starting in Q3. Got it. When you've been asked, Jean, or Lisa has been asked, you have always mentioned the opportunity for multi-gigawatt scale deployments. I think we have heard about two of them, OpenAI and Meta. You think there is still the scope for us to be pleasantly surprised with more such announcements even for 2027? You think that just given how tight the industry is, that more incremental announcements could be further spaced out than that? Yeah. We talked about we're really pleased with our partnership, very long-term partnership with both OpenAI and Meta. Last year, we established those relationship, and we actually see the forecast from those customers are actually above our original plan for 2027. I think one of the key milestone we're really focusing on this year is to continue to expand and deepening the customer adoption of MI450. We definitely expect there will be other multi-gigawatt customers. We have both, across the board, hyperscale customers, the model companies, and even AI native companies who we have been engaging, working with. I think it's important for us to continue to expand this customer base and with the largest scale deployment. Got it. Makes sense. How do you expect the two customers you have announced to allocate market share? Because they have a number of supplier options. I know you have a somewhat unique engagement with them through the granting of warrants and whatnot, but just if we set that aside, how is your visibility into getting, I think the two gigawatt each from those customers for next year? Vivek, as you know, the lead time for MI450 is quite long. We really have to start to plan and have the orders from customers for next year for the second half launch and the next year. I think the supply chain overall is tight next year. Since we have been preparing to support our customers, we do want to ensure we get the supplies for what they need. Those are two our most important anchor customers. Of course, we also have a warrant, which we're going to be able to share the upside if we get more revenue. Our stock price is higher, they will share upside too. That is absolutely the common interest for both companies who want to drive the adoption of MI450. We feel pretty good with both of them. We think we can get the right supplies to support them. Got it. Do you think having someone like TSMC is almost adding a level of discipline in the ecosystem? It's just harder to double count if everyone has to go to the same source. I know it sounds obvious, but do you see that also? They're quite disciplined. I think they'll continue to be. These are sensitive topics for us to talk about in these forums, but we really, really, really appreciate the support that TSMC giving us as a partner, and the way that they're working with us to bring more capacity online to support not just the Helios and 450 growth, but the significant server TAM expansion that we're seeing and planning for not just for this year, but for all of next year and conversations going into 2028 on wafer capacity to support demand. We really appreciate the work that they're doing on our behalf, and I think they're being, as they've always been, disciplined in the way that they bring capacity online and do their diligence two or three levels deep in the customer base to understand where the organic demand is coming from to support the capacity that they're bringing on. Makes sense. The final one, Jean, is on just memory cost inflation. I guess, when you wake up and see DRAM, I am sure DRAM price is not what you see when you wake up, but when you see that cost inflation every day, is that a good thing because it gives you more pricing power, or is that a bad thing because now you have to absorb that cost and hunt for more supply? What are kind of the pros and cons of that memory cost inflation for you? It's really a great question. First for us, we really want to make sure if there's a longer-term agreement with our suppliers, we can secure the capacity. That is number one thing when you have a larger business at our scale, you have to plan ahead. Secondly, we think more strategically, if there's memory cost increase, we do need to figure out a way to share with our customers to absorb that increase together. I think the most important thing for us is we actually don't want to use the shortage of controlled memory to just increase the price. We want to make sure customer help us to absorb the cost increase, we are more strategic with the long-term relationship. I think from industry perspective, the memory cost increase at this kind of level, we have never seen. The price is really high. I think it does increase the CapEx spending for end customers where they spend the CapEx. I think in the longer term, just like all the industry, you always have a new capacity add up. You also have a new innovation on how you utilize memory more efficiently. It will figure out itself in the longer term. That's what we believe. Got it. Do you have long-term agreements in place for the majority of your memory needs, or do you think that this is a cyclical high, and maybe there will be more normalization of that input cost for you? From planning perspective, because our manufacturing cycle is so long, if we plan for the MI450 ramp this year, we had to start to talk to our suppliers last year or year before. Similar situation is right now, not only with the very tight supply environment, not only we're planning 2027, we're planning 2028. For us to continue to make sure we can support our ambitious plan to grow the company, we have to plan ahead. Yeah. Vivek, in the server market and in the PC market, the vast majority of the DRAM is actually acquired by our OEM and ODM partners and the hyperscalers themselves. That DRAM doesn't run through our P&L, and we work really, really hard with all of the customer base to try to make sure that we're matching the memory supply that they're able to get and the CPU supply or the GPU supply that we're able to provide together to where there's not mis matching of supply in the industry or hoarding of anything. We've been working really hard on that. There's certainly increased input costs to end devices in certain parts of the consumer and gaming market where there have been some anticipated market impacts, and I think we've given you guys our current view of that and the guidance that we've talked about. We're working really hard on behalf of the whole customer base to try to make sure that the memory pricing and the matching of components is relatively seamless in a time like this. Got you. Just final question before we close. When you look across your customer base, Jean, how far is the visibility that they're willing to provide to you now, and when you get that, what are you doing differently in your business operationally to kind of deliver to those? Yeah. I think because the supply chain environment is really tight, customer really plan ahead. We have a very good visibility into 2027 and beyond. I think our customers and ourselves, especially when you think about the data center investment, very large CapEx planning, very long planning cycle, they actually plan way ahead. 2027, we feel really good about both the visibility of demand side and the visibility of supply side. Of course, 2028 and beyond, that's everybody's working on. Okay. On that positive note, thank you so much, Jean. Thank you. I appreciate your time.
Loading workspace