• 0 Posts
  • 27 Comments
Joined 1 year ago
cake
Cake day: June 12th, 2023

help-circle


  • I just want to jump in here as the whole thing about the tonnes of factual errors stuff…

    A lot of the allegations about the accuracy of their data basically came down to arguments about the validity of statistics garnered from testing methodology; and how Labs guy claimed their methods were super good, vs other content creators claiming their methods were better.

    My opinion is that all of these benchmarking content creators who base their content on rigorous “testing” are full of their own hot air.

    None of them are doing sampling and testing in volume enough to be able to point to any given number and say that it is the metric for a given model of hardware. So the value reduces to this particular device performed better or worse than these other devices at this point in time doing a comparable test on our specific hardware, with our specific software installation, using the electricity supply we have at the ambient temperatures we tested at.

    Its marginally useful for a product buying general comparison - in my opinion to only a limited degree; because they just aren’t testing in enough volume to get past the lottery of tolerances this gear is released under. Anyone claiming that its the performance number to expect is just full of it. Benchmarking presents like it has scientific objectivity but there are way too many variables between any given test run that none of these folks isolate before putting their videos up.

    Should LTT have been better at not putting up numbers they could have known were wrong? Sure! Should they have corrected sooner & clearer when they knew they were wrong? Absolutely! Does anybody have a perfect testing methodology that produces reliable metrics - ahhhh, im not so sure. Was it a really bitchy beat up at the time from someone with an axe to grind? In my opinion, hell yes.








  • A great many people really like OSX; its been a long time since i’ve daily driven it but there’s stuff about the way it works that feels more efficient than windows, and easier than linux. That’s not something that appeals to everyone but its obviously worked for a lot of folks.

    So back in the day it was about getting to use OSX (and in other cases apps that were OSX only, or just ran better in OSX) but not having to pay so much for the hardware. That’s a calculation that to me really only made sense for desktops; as for quite a long time Apple’s laptops weren’t actually massively more expensive than a similarly spec’d windows laptop.*

    Overtime i’d argue that linux desktops have caught up to a lot of what made OSX feel good; but they’re not like for like even now. Though take that with a grain of salt as I spend more time in cli/tui nowadays across my macbook, work windows laptop and various linux boxes i’ve got running :)

    *The thing was that the average windows laptop was under-spec compared to a Macbook Pro so the latter always looked way more pricey.








  • LMG is 200 odd people. You could say Nvidia with >10k employees is colossal perhaps, or you could say Cisco with >80k is. 200 people is barely a medium sized enterprise. Christ, the company I work for is nearer 2k people.

    And in any of those cases, the size of the entity doesn’t matter - its a very common journalistic practise to seek comment. I tend to think that because GN chose not to, that it veered away from a purely journalistic exercise because they are essentially a competitor. They still have the right to publish it and make the claims they want but it changes the framing of the video quite a bit for me.

    Bear in mind that I think all benchmarking is over hyped in its reliability and importance so pretty much none of that side of things holds any real credibility with me at all - so i’m mostly judging GN based on they way they’ve presented this issue.

    Finally, Linus didn’t sell the startup’s prototype, LMG did. And unless you’re ignoring the whole trail of fact on that its pretty clear it was a stupid mistake but also how that came to be isn’t some evil genius plan.