$1/hr/GPU
Let's do some math here:
There are 8000 hours in a year (give or take). Assumption #1: a 3-year payback is needed as the tech goes obsolete pretty quick. That's $24k to play with based on customers with long-term commitments.
Your biz needs at least 50% margin(*) else nobody will invest, so you have $12k to play with now.
Your electric, plant, other utilities is about maybe 30%.
Your actual capital cost (of the RAM + CPU + GPU + network + + +) is about maybe 40% assuming (assumption #4) you are paying some kind of premium for the tech.
You have to pay somebody, perhaps yourself, for hardware and software maintenance and support and that takes up the last 30%. This may seem high but you have to have lots of spares and separate labour pool to run it, so there is an interest cost, capital cost, and labour cost all separate from the capital pool used to buy the gadgets. Source: me and many years of data centre costing experience.
The implication is that a GPU+related CPU is only, based on my assumptions, about 40% of $12k or $4800. Sounds too cheap (**).
I'd like to meet their bankers. I have some ocean-front property in Arizona that needs refinancing....
(*) margin is defined as percent of revenue that exceeds your direct costs, so therefore omits all corporate stuff like CEO, management, finance costs, taxes, 2-inch carpeting, company cars, sales droids, marketing flunkies, senior corporate account executives, vice presidents of government influence, and all that. In the end you might have 20% profit at a corporate level. That also sounds too low.
(**) This is at the margins, where here marginal cost applies provided you are buying thousands of units. (And yes "margin" is a word that has too many overloaded meanings.)