Тёмный

$400,000,000 Saved - NO MORE AWS 

ThePrimeTime
Подписаться 590 тыс.
Просмотров 221 тыс.
50% 1

Recorded live on twitch, GET IN
/ theprimeagen
Original: tech.ahrefs.co...
MY MAIN YT CHANNEL: Has well edited engineering videos
/ theprimeagen
Discord
/ discord
Have something for me to read or react to?: / theprimeagenreact

Наука

Опубликовано:

 

28 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 536   
@matthewwright57
@matthewwright57 Год назад
Im the devops manager at a ~5B company. I have a huge 'on prem' colo deployment of systems. I can confirm that AWS or other hyperscalar clouds run me about 10-12x the cost. Now you have to deal with having data center ops and paying those salaries etc. But even with all that its way more expensive.
@user-jb6wg6eg4o
@user-jb6wg6eg4o Год назад
All calculations I have done on cloud costs for customers is around the same. It's 10x ish.
@dexterplameras3249
@dexterplameras3249 Год назад
I've worked for one of the largest Telcos in Australia. It is cheaper to run internally, but the problem is always the internal politics of who controls what. It would literally take months to get certain changes done that would be a sinch with AWS. This is one of the reasons why departments go to the cloud because they are sick of the politics.
@matthewwright57
@matthewwright57 Год назад
@@dexterplameras3249 This is actually super true.
@THEROOT1111
@THEROOT1111 7 месяцев назад
Inflation will not help at all in these calculations, we all know that by now.
@CommanderRiker0
@CommanderRiker0 7 месяцев назад
You are doing something very wrong.
@egor.okhterov
@egor.okhterov Год назад
Develop single code, but ready for both cloud and your DC. Deploy in parallel both in the cloud and on your hardware. When your hardware cannot handle it(or DC burns to the ground), redirect traffic to cloud and it will autoscale. If big traffic becomes a new standard then increase hardware in your DC.
@snooks5607
@snooks5607 Год назад
back when netflix got popular it forced a lot of ISPs around the world to upgrade their stuff as big chunk of their customers started maxing out their series of pipes at the same time. never been their customer but I appreciate the positive growth pressure
@hanifarroisimukhlis5989
@hanifarroisimukhlis5989 Год назад
And now those same ISPs are pushing for charging companies like Netflix for "traffic", nevermind who is actually requesting (customers).
@dputra
@dputra Год назад
I remember my ISP is blocking netflix for this reason lol
@adnan37h
@adnan37h Год назад
I don’t know how they did it but in my country where monthly usage is capped at a few hundred gigabytes (quota), only Netflix does not count into your monthly usage (offered by select ISPs) which basically makes it better than any other service
@kishDoesThings
@kishDoesThings 9 месяцев назад
Just so you know he's a Netfix Engineer
@flufster777
@flufster777 9 месяцев назад
series of TUBES
@xdevs23
@xdevs23 Год назад
One of the things not mentioned here is that there are other resources on AWS that cost money as well. EC2 and EBS is not the only thing. You probably will have some kind of firewall, virtual networks, backups, log ingestion, etc.
@OtakuArtful
@OtakuArtful Год назад
gateways prices are huge too
@xdevs23
@xdevs23 Год назад
​@@OtakuArtful Yup, those WAFs are a major cost point.
@rnts08
@rnts08 10 дней назад
Nat, vpc, cloudwatch, waf it's not even close. Between public cloud and self host, always self host if you have the ability.
@davew2040x
@davew2040x Год назад
I'm not a cloud expert, but I am a little surprised that competition between cloud providers hasn't seemed to reduce costs much over the last five years or more. Probably one aspect of it is that the differences in usage specifics between cloud providers means that once a typical company has started investing in one cloud provider, there's an aspect of lock-in at play that prevents easy transitioning from one to the next.
@coolaj86
@coolaj86 10 месяцев назад
This is due to venture capital. You're not dealing with profitable companies competing with each other. You're dealing with massive, MASSIVE amounts of venture debt from companies that have no road to profitability in other areas of their businesses. And since it's rather expensive to get started, it's very difficult to bootstrap a cloud company. If you don't have the venture capital, you can't afford the servers. If you get the venture capital, you'll never be profitable enough to lower your prices.
@coolaj86
@coolaj86 10 месяцев назад
(I'm working on a cloud platform with some buddies and it will always be both competitive and profitable as long as we never pay ourselves salaries - it would require several *thousand* servers before the cumulative profit-per-server could pay us competitive wages)
@FabioDiGiorgio
@FabioDiGiorgio 7 месяцев назад
I'm a cloud expert instead: VPS are expensive, the key to lower the costs in a cloud environment like AWS is to use their native cloud services, avoiding any service VPS like: EC2, ECS, EKS, etc. this guy was unable to do, posting that just showed his lack of knowledge, TCO can be easily lower than on prem, but you can't improvise, you have to be prepared
@thewhitefalcon8539
@thewhitefalcon8539 7 месяцев назад
Competition reducing prices is economic propaganda
@arekxv
@arekxv Год назад
So what you didn't calculate in is: * Pay for system admin team to manage all of this for 30 months * Pay for developer time for all of the tools and things you will need to develop now that you don't have them ready * No multi-az since you are only renting one space * Equipment breakdowns due to fauilt / overuse etc. * Backup strategies you will need to develop. You ARE planning on backups right? * Since you are renting, I am guessing you are renting the space and the connection so who is doing the infrastructure costs of the building like data center security, building upkeep, upgrades, etc? * If you ever need to go global what will do to keep the response times low? I am not saying AWS is cheap. What I am saying is that you have a LOT more to consider than just rent and electricity.
@louisroche9574
@louisroche9574 Год назад
(disclaimer, I'm a dev at ahrefs) 1. the devops team is more or less the same size when using aws 2. This one is partially problematic sometimes, but for our problems it's more the other way around in general, AWS is lacking some tools. Nevertheless it's indeed can be a real limitation. And here usually the cost isn't so much the salary of the devs but the time required to build a solution. 3. yep that's correct, if you need multi AZ the computation would be different, but the computation for AWS would also be different, as you would need to duplicate the storage to different zones. So the AWS cost would also drastically increase. 4. equipment breakdown is part of the price of the hardware 5. backups are mentioned in the article 6. The people the rent is going to (this question is exactly the same for AWS, who is paying to keep the AWS building in working order?) 7. we are global, but this isn't really a relevant question here, see point 3 So overall there's not much additional costs so long as we don't depend on a product that is only available on AWS.
@meletisflevarakis40
@meletisflevarakis40 Год назад
There is no big difference when comparing team sizes. You still need specialised people managing AWS.
@arivo9062
@arivo9062 Год назад
Still cheaper
@geoffclapp5280
@geoffclapp5280 Год назад
Also If you have any compliance reqs cloud is much easier. And all of the bespoke shit you write is more technical debt. Then five years go by and you have to re train ops people on your bespoke shit. Not fun.
@TheNewton
@TheNewton Год назад
@@louisroche9574 "1. the devops team is more or less the same size when using aws" So the devops team size didn't change taking on more critical responsibilities , but did everyones pay go up to match. Sounds like a big mgmt win.
@DragonRaider5
@DragonRaider5 Год назад
I think one thing we have to keep in mind when looking at these example companies who're doing these migrations is, that they're pretty special cases - be it massive scale web scraping (ahrefs) or video streaming (amazon prime video). __This is not what most of us are doing/serving__. Most devs here, me included, probably do standard web development - maybe with some SSR. But this will not lead to comparable load profiles in respect to user count. Most of Ahrefs capacities most likely go to 24/7 max load scraping, not to serving customer requests.
@potodds_trading
@potodds_trading Год назад
I've been conditioned to think that buying vs renting/leasing is more cost effective over the long term. Think real estate and autos. I remember when AWS cloud was taking off and having this twinge of misgivings about the costs. Plus the fact that you are beholden to the owners of the cloud. I agree with everyone who says there needs to be a balance. The ability to be able to spin up hundred/thousands of servers at a moment's notice is a great convenience but once your infrastructure is more mature, the cost savings are too great for standalone.
@ScarfmonsterWR
@ScarfmonsterWR Год назад
That's always was the supposed argument of all arguments for cloud - "you only pay per hour for what you use, so you can't multiply that cost by whole month". It always seemed silly to me because, yeah, sure, if your server ran for just a couple of hours every day it might make sense. But in reality, most of the time that's not what happens. You need to have some instances that just run all the time, even simply because the demand won't drop below some level. And it's not like you can just nuke all your databases or delete all your data from the cloud every day because it's "not in use". Ahref's case is especially striking, because the cloud cost overhead is so high that even if 90% of their servers were never needed, they still are better off not paying for AWS.
@smallbluemachine
@smallbluemachine Год назад
The Cloud just means someone’s server. MS and AWS now retain the same hardware for up to 7 years now. You are being had!
@MarcelRiegler
@MarcelRiegler Год назад
As someone that is supposedly a software architect, but always ends up having to do Ops on the side, this ignores the biggest cost point in all this: IT and developer time. We're not just talking about making sure the power stays on. We're talking about automatic backups, configured with a few clicks, autoscaling easily, and starting up and tearing down developer instances in seconds. Suddenly, your IT, or worse, your developers have to do all that. If you're already big enough to afford 40 million in servers, chances are you have a big enough IT department already. My personal experience though is that the IT department is where every single CFO tries to save money, and it fucks EVERYONE over.
@callowaysutton
@callowaysutton Год назад
With things like OpenStack, OpenShift, OpenNebula, VMWare, Canonical MAAS, heck even Proxmox that is quite literally not an issue. Almost all platforms have a way of autoscaling, backups, high availability, hardware issue alerts and more features that used to need a lot of specialized knowledge. Now, a single person, or a small three to four person team, could potentially manage the actual hardware of a rack or whole DC location and it would still not even make a dent in the difference between collocated and cloud costs assuming salaries in the low 6 figures. In Proxmox for example, you could take a physical server down for maintenance and have it live migrate to another node with no noticeable affect to the client. All platforms have at least this feature and more; you could even migrate across two different DCs/locations if you really wanted to, which you can't do in AWS, GCP or Azure yet. Canonical MAAS literally manages the hardware for you and with its hooks you could potentially even have it automatically auto order parts that failed tests, safely turn off the server, turn on the iBMC LED (to show remote hands which server is having issues), submit a ticket to the DC with the shipping number and have maintenance effectively automated. The IT landscape today is not the same as 2008 and the large cloud providers are definitely starting to show their age big time
@Victoria-ij3cb
@Victoria-ij3cb Год назад
What do you think of companies where they have people dedicated to managing the infrastructure so it doesn't bleed into developer responsibilities?
@invinciblemode
@invinciblemode Год назад
You need those engineers with AWS or on-prem anyways. So the cost comparison is fair.
@MarcelRiegler
@MarcelRiegler Год назад
@@Victoria-ij3cb I definitely think, if the company is big enough, on-prem is can be nice, but only if your feature set (and therefore requirements) are basically static. Otherwise, what would a single click in AWS to try out (e.g.) K8S turns into MONTHS of waiting, and then getting a faulty, buggy on-prem K8S. Another BIG disadvantage I've observed in pretty much every bigger company is that IT is understaffed, underfunded, overworked and overregulated. Things that would be a single click on the cloud can take months.
@MarcelRiegler
@MarcelRiegler Год назад
@@invinciblemode Not even remotely true, at least in my experience. For example, my personal, very painful experience with on-prem K8S: We didn't have an expert, so someone just had to google shit and hope something useful happened. Obviously, it took forever. Then at least 5 different features that are a click away in the cloud, even for the dumbest developer, were missing. Things like a basic load balancer, an API gateway, a replicated database, or a decent storage solution. And again, you'd need experts for all those things. With a cloud K8S solution, all that just magically happens, and is maintained, automatically. Even if you only use the cloud for as dumb VMs, you're saving a lot on people that need to setup, install, and maintain your racks, and the software (hypervisor, etc.) running on it. I guess I just have PTSD, because EVERY SINGLE IT department I've ever come into contact with has been underfunded and overworked, making them decidedly far worse than the cloud, at least from a developer perspective. Maybe in heaven they have a wonderfully running on-prem cloud.
@dphenix4933
@dphenix4933 Год назад
I never noticed the little light up border on the like button that happened when you had your early video breakdown... It only does it during that outburst too
@ashishpandeyone
@ashishpandeyone Год назад
The prime values that a cloud provider delivers are :- 1. avoid upfront cost of infra and talent ownership. 2. provide flexibility to scale up / down as necessary. 3. allow distributing workloads across multiple regions / zones. 4. reduces complexity by providing an API over infra and services to allow composing your implementations rather than deal with the underlying implementations. In case of on-prem deployments, considering that they're multi-regions, it's usually still a single zone per region. You could have hardware level redundancies but how do you auto-swap? How do you deal with ISP failures, weather, sabotage, etc. The problem is most people don't know what worms does the on-prem can has. If the on-prem infra is the physical filesystem, a cloud provider is the logical filesystem over top of it. Techniques like IaC (Infrastructure as Code) basically allow you to programmatically / declaratively not only spawn infra but also allow you to observe it, scale it up / down and even protect you from major security threats. Does all of this come at a premium? Obviously, DUH! It's not a best effort basis deployment which most on-prem deployments are. There's usually an SLA and a very high one at that. Also, almost no one discusses the talent cost, local regulatory costs, technical debt that accrues and slows everything down gradually? And lastly, what do you do when there's a sudden spike, let's say 300% on Black Friday and then you don't receive such traffic again for the whole year. What do you do? Over provision 5x? What about the unutilised capacity available for the rest of the year? If a company doesn't need most of the features mentioned above and has extremely predictable and mostly static loads, sure, the premium for the cloud provider might not make sense. The most probable reason why Netflix sticks to AWS is for the ability to seriously scale up / down in seconds and for AWS's expertise is maintaining a behemoth such as itself. Finally, scraping the internet is going to be expensive. Should've thought about that before building a business around it. LOL!
@thewhitefalcon8539
@thewhitefalcon8539 7 месяцев назад
EC2 doesn't provide most of those benefits - it's just a server rental. There are plenty of cheaper places to rent servers.
@ashishpandeyone
@ashishpandeyone 7 месяцев назад
@@thewhitefalcon8539 who said it needs to be EC2. Though, I'm sure if a company that serves 10 - 15% of the internet, Netflix, is fine with using EC2s then there's some value proposition that really works well.
@Kai-K
@Kai-K 7 месяцев назад
SLA for EC2 is only 99.9 (3 nines) and 95.0 (1.5 nines) for 10 and 25% discounts respectively (most of AWS is similar, you don't get 5 nines from Amazon) If you can't accomplish 95.0 (18.25 days of downtime per year, more than 24 hours per month), you're doing something truly wacky In regards to staffing, someone from ahrefs stopped by the comments (and other people backed them up here), the staff cost for devops is basically the same either way I don't find the dismissive comment at the end helpful at all. They aren't complaining, they're sharing their information. It seems strange and derisive to punctuate with 'By the way, what did you think was gonna happen, boneheads? LOL' if the information is meant to be conveyed compellingly or convincingly
@ashishpandeyone
@ashishpandeyone 7 месяцев назад
Exactly, their use case is completely different than EC2’s value proposition. I’m not saying that doing yourself isn’t possible, I’m saying if your business isn’t around managing infra, you shouldn’t be mostly doing it yourself unless it makes business sense to do so. Ahrefs business revolves around scraping the internet and greedily too. I’m not privy about their approach to scraping but from what I understand they’re simply putting in compute to get as much content as they can. Considering the rate at which data is being generated and made available online, this is only going to become more expensive or time consuming. This is a scale and optimisation problem and throwing compute at it is not going to make it easier.
@catcatcatcatcatcatcatcatcatca
I think the key advantage of IaaS is not flexibility in capabilities you invest in, but simply the much, much shorter timeframe of investment. You can double your infrastructure today, and cut it down to a quater tomorrow. If you did that with hardware, the decision you made today would mean paying extra 200% capabilities for the next 60 months, on top of the fact you’d be stuck with the original excessive 100% you would have even without todays fuck-up. The fact you couldn’t even do such a choice because the timeframe from decision to actual capability is so much longer. If you buy “off the shelf”, you might have a bare supervisor running in less than a month - provided you only bought few machines, your network configuration didn’t need reworking, your UPS had a vacant spot, the server had memory pre-installed and the storage was delivered before the server or in the same shipment. it’s like buying a car versus renting it. You can think about renting a car for ten years, and conclude that it’s ridiculously expensive. But at the flip side, you can’t buy a car for a weekend - that’s not how buying a car works to begin with.
@callowaysutton
@callowaysutton Год назад
Good luck trying to get over ~10,000 instances in a single region spun up within a small time frame. Even on a corporate account, you need to plead a case for a need for that many instances which goes through a ticketing process that can take days to weeks which is still dependent on if the resources are even available in the region at the time, which in the case they're not your request is simply denied. Then take Netflix who was able to host the entirety of the US eastern client base off a single rack and is able to spin up hundreds of thousands of instances whenever they want at a fixed rate.
@Sergey92zp
@Sergey92zp Год назад
@@callowaysutton About 10k instances, it's actually pretty edge case, probably that number even more than any cloud provider have in a day worldwide. And it's actually hard to find a task for this 10k instances, so yeah they want to know will they be paid for this, and for which task it needed, because it can create a shortage for other clients. About netflix served from single rack, depends on which timeframe you refer, because earlier they used Akamai, and now they use their OpenConnect rack for ISPs. So it's almost never was a single rack. Per each 1gbit they can serve approximately 400 active streams(average 1080p stream ~512KB/s with some fluctuations), if we assume that some pause video + they ok with some small almost unnoticable delays, then it can be approx. 1000 users of decent content provisioning. From requirements of OpenConnect they can connect it max to single 100gbit, So 1 rack can serve max 100k users with ideal conditions of course, and it's only content serve without site logic/analytics/etc.. UPD: even less than 100k, I forgot to include IN traffic, because it's one same NIC for IN/OUT.
@FredoCorleone
@FredoCorleone Год назад
Is it real that Netflix has a single rack for an entire region?
@callowaysutton
@callowaysutton Год назад
@@Sergey92zp Here's the thing though, I could spin up 10,000 instances very easily on any medium sized $100-500k privately hosted cluster and not even be close to reaching the total capacity, so it being an edge case isn't and shouldn't be used as an excuse for an IaaS type of commodity. For reference, spinning up 10,000 of AWS' smallest EC2 instance in US East costs a whopping 100k+/year, and for that you get 10k shared 2 core, 512MB of RAM instances... or about 20,000 vCPUs and 512GB of RAM. Let's break this down further; it's a common industry practice to split each physical CPU thread 32 ways to each vCPU so that gives us 625 actual threads. The newest Epyc servers come in configurations of 512 threads per server (you could even have a 4 way multinode in 2U for a total of 2,048 threads in 2-4U worth of space) and 512GB of RAM is frankly nothing considering these types of servers go into the terabytes of RAM. If we discuss space and networking, a single 42-47U rack with good 100Gbps can be had for ~6000/m now, or ~72k/y, and considering AWS doesn't ever let a single customer go above 100Gbps per zone it's a good frame of reference. If we were to amortize over a 3 year period that gives us a 150k budget to compete with AWS and with that kind of money, you could easily afford multiple tens of terabytes of RAM, thousands of cores and much faster disks. For what you're saying about Netflix, you're just completely off. I'd recommend looking at their many presentations about their infrastructure and how they've saved money by using their own hardware/network.
@cmoullasnet
@cmoullasnet Год назад
To be fair, if your idea of using AWS is just paying for dedicated EC2 instances, you’re doing it wrong. You need to architect your applications intelligently to keep your costs down.
@lhxperimental
@lhxperimental Год назад
And get 100% locked in to AWS?
@cmelgarejo
@cmelgarejo Год назад
Yep, lambdas, kube and etc, but al that depends on the load you have and the codebase. RUST BTW
@cmoullasnet
@cmoullasnet Год назад
@@lhxperimental Not necessarily. There are many AWS and Serverless providers. There’s tons of ways to roll databases. There’s many ways to do compute and single sign on and such. Not everything has to be in AWS and really you can architect your applications to appropriately fit cloud services in some places and monoliths on dedicated hardware for others.
@cmelgarejo
@cmelgarejo Год назад
​@@lhxperimentalthats why you have a exit startegy from the cloud, or use terraform if you're sticking to cloud stuff to move as easily as possible. You actually choose whether you get locked in AWS. AWS is locked in WITH ME >:)
@PanosPitsi
@PanosPitsi Год назад
@@lhxperimentaldon’t use your phone send us letters with a parrot so google doesn’t lock you in with RU-vid. You obviously didn’t touch a server in the past 10 years if you think a company that large can rely on ec2 instances
@Hossimo
@Hossimo Год назад
The reason I use AWS as a startup that has a huge storage commitment and moderate EC2 Usage is that I can scale out and in at will, so for example I'm on a some downtime right now and I scale down the system dramatically lowering my monthly commitment while keeping the Infrastructure. I spent a few years in a COLO and while it definitely was cheaper, when I needed to scale up I had to put out a ton of cash and worry what happens when the scale goes down. I guess the most important thing for any company moving to the "cloud" is to spend some quality time with Excel and figure out your options.
@elkcityhazard
@elkcityhazard Год назад
as someone who came to development from SEO, I love the way your pronounce A-H-Refs.
@kazdaman1
@kazdaman1 Год назад
Sounded like Ahrefs was doing a lift and shift comparison with just infrastructure. It would be interesting to have digged into their architecture to see if a cloud native architecture could have fitted better.
@meletisflevarakis40
@meletisflevarakis40 Год назад
And vendor lock them to AWS for ever? Or spend more than Prime Video which ditched their "cloud native" approach?
@kazdaman1
@kazdaman1 Год назад
@@meletisflevarakis40 I would not read too much in to the Prime Video malarkey, it did make good headlines 😉 For me, main takeaway was it reminded us there are good and bad architectures, and just because it's serverless does not mean it's good. I.e, if you are hammering Event Bridge (as was the case with Prime Video), then you will have a bad (expensive) architecture.
@aaronhamburg4428
@aaronhamburg4428 Год назад
@@kazdaman1 vendor locking is a huge problem that very few seem to even consider nowadays
@kaibe5241
@kaibe5241 Год назад
​@@aaronhamburg4428 IT's a "future aaron" problem. You deal with it as you approach the issue. Until then, don't waste your time - focus on product and business development.
@stevendorries
@stevendorries Год назад
@@aaronhamburg4428it’s like people just lose their memories every five years and all knowledge of previous bad behavior from vendors who abuse lock-in tactics is wiped from the face of the earth
@timlind3129
@timlind3129 Год назад
Been preaching this for years; loving lifting and shifting out of the cloud and saving companies millions.
@gamunu.b
@gamunu.b 7 месяцев назад
exacly the problem, expecting lifting and shifting services as it is and expecting a better result. That's not how cloud works.
@tjpld
@tjpld Год назад
That's like saying that you saved 20 Billion by not buying a Nuclear Powered Aircraft carrier. Not buying something isn't a saving.
@pif5023
@pif5023 Год назад
AWS has been caught selling the shovels
@simonzuluaga2081
@simonzuluaga2081 Год назад
Such a nice and enriching video Prime, I love this video format
@vukkulvar9769
@vukkulvar9769 Год назад
Cloud is good for temporary things. Slight surcharge of traffic during holidays, proof of concept, testing a new product.
@FredoCorleone
@FredoCorleone Год назад
My company is all about the cloud and migrating everything on the cloud for certification sake. The problem is that they don't think about the cost and performance. I've noticed the things we are running are more expensive and slower than before... Hey, if they are fine with this...
@sisandatech
@sisandatech Год назад
Dont know much about the cloud but the host is entertaining
@Lightstrip
@Lightstrip Год назад
Honestly me neither, Primeagen is just fun to watch. Then again you probably won't have any real knowledge about the cloud unless you work at a company that uses them or are just into knowing about cloud infrastructure
@davidlee588
@davidlee588 9 месяцев назад
Key Takeaways: The video discusses the cost of running infrastructure on the cloud versus using on-premise hardware. The company, ​AREFS, compared the costs of their own co-located data center with a similar installation on ​Amazon Web Services (AWS). The analysis showed that running the infrastructure on AWS would cost AREFS significantly more money compared to their own data center. Summary: The video explores the cost implications of running infrastructure on the cloud versus using on-premise hardware. AREFS, a company, compared the costs of their co-located data center with a similar setup on AWS. The analysis revealed that running infrastructure on AWS would cost AREFS significantly more money, even taking into account their revenue. The video highlights the importance of periodically re-evaluating cloud benefits versus actual cost and suggests considering a reverse migration from the cloud for more mature companies. The analysis also takes into account factors such as people skills, financial controls, and capacity planning, among others. Overall, AREFS found that managing their own infrastructure was more cost-effective and allowed them to invest in product improvements and development.
@D4ngeresque
@D4ngeresque 9 месяцев назад
Breaking news: Dell acquired by Amazon
@CyberTechBits
@CyberTechBits 7 месяцев назад
What about all the support costs for all your hardware and how many people it takes to support that hardware??? The people costs would be enormous when you factor in benefits. I don't believe it would be that big of a Delta.
@emnoor
@emnoor Год назад
Please include the article links in video description.
@zerker2000
@zerker2000 Год назад
"netflix also does this" netflix is literally FAANG :P
@efrem.dubrovin
@efrem.dubrovin 8 месяцев назад
Pressed the like button just when it glowed. Feels like I won at a mini-game.
@MrJosch700
@MrJosch700 9 месяцев назад
As a SysOps guy watching here to better communicate with my dev colleagues, I can say the point where migrating away from cloud makes sense is much lower than you think. Granted I'm in Germany so we might have other expenditures for people and other stuff. But I would argue, that one of the first additional talent a start-up, with say 2 devs that founded the company should look for, is a SysOps guy, even if you stay on cloud for a while. Sure I'm biased because I am a SysOps dude, but cloud doesn't make infrastructure trivial tho. Or rather on-prem /colo isn't that complicated for someone who knows their way around servers. Also what you need to consider ist where all you data is stored (especially when you are a Europe based company), are you thinking about backups, where are those backups stored, and so on. With all that cloud easily gets more expensive than on-prem or colo. With cloud it is the same thing as with everything, it has it's use cases but it's not the be all an end all. The tech sector tends to jump on a hype and must use it for anything without considering it's pros and cons
@TuxTechLabs
@TuxTechLabs 7 месяцев назад
😂😂😂😂 all true. I am from VMware working as a SRE in SDDC operation. Managing own data center is the cloud choas and very very very complex and costly.
@mormantu8561
@mormantu8561 Год назад
Big part of the cloud is using it effectively. You have the power of the largest and most feature rich cloud provider of the world and you are using the most simple service they have for almost everything. This is an easy comparison, but it is not the right or fair one.
@goldfishtechnic
@goldfishtechnic 9 месяцев назад
What’s with the glowing like button when he mentioned it?
@neptronix
@neptronix Год назад
It's probably the storage that was killing them... storage is where Amazon's value goes way, way down.
@purpinkn
@purpinkn 11 дней назад
0:35 likes light up siri is watching me
@RealCheesyBread
@RealCheesyBread 7 месяцев назад
They were using the price of reserved ec2 instances to give AWS the best advantage!
@ivanmaglica264
@ivanmaglica264 Год назад
Can somebody explain how come Walmart transferred their workloads literally by trucks to AWS? How does that compute financially?
@kevinb1594
@kevinb1594 Год назад
AWS has a service that will send you physical hardware to upload your stuff and physically place them into data centers
@mllenessmarie
@mllenessmarie Год назад
It's called Snowmobile (yes, it's a true name). Btw. there's also Snowcone and Snowball xD I just love how they name their services. As for financial aspect - no idea, but it's most likely costly af.
@vtsirkinidis
@vtsirkinidis Год назад
may offer an alternative term for "unknown known", you probably meant bias :)
@ltnlabs
@ltnlabs Год назад
Datacenters are just HTML bakeries
@SevereMkII
@SevereMkII Год назад
Netflix spends roughly $1Billion a year on AWS
@Jabberwockybird
@Jabberwockybird 6 месяцев назад
Is that company named after
@shashankbj3804
@shashankbj3804 Год назад
This is renting a house vs buying a house
@DotnetistEnterprise
@DotnetistEnterprise Год назад
I worked for a company that has a lot of clients but always has deficiet because of aws
@somoscode4151
@somoscode4151 Год назад
The cloud was never meant to be cheaper...
@redbenus
@redbenus Год назад
How about the labor cost of people that manage the infra, I mean somebody has to do it :)
@benotisanchez5583
@benotisanchez5583 11 месяцев назад
AWS may quickly become obsolete with services like cloudflare tunnels that makes it easy to just host your web applications on your computer.
@theoboldalex
@theoboldalex Год назад
The name, is the onPremaegen
@pif5023
@pif5023 Год назад
A gigolo of RAM
@PaulSebastianM
@PaulSebastianM Год назад
7:33 IO-PS-hasca! 😂
@jimmymifsud1
@jimmymifsud1 Год назад
Cloud only really works for mid to large businesses, small and enterprise are better off on prem.
@cianmoriarty7345
@cianmoriarty7345 Год назад
I'll pretend to be surprised.
@chillidog8726
@chillidog8726 Год назад
i agree with the conclusions but I'm not sure if this is completely genuine for example is Singapore is AWS especially expensive? can this be replicated across multibile locations ? 1. i think u could get a better AWS deal at least 30% off . 2. he doesn't include engineering cost associated with AWS and Homebrew. 3 it doesn't include replacement hardware given a failure rate. but overall renting DC space seems to be the way to go because u are skipping a lot of the hassle. but save a lot compared to the cloud.
@zm7985
@zm7985 Год назад
Has Prime changed his mic? What happened to the sm7b?
@julstr6303
@julstr6303 9 месяцев назад
Reading gp3 as g p t 3 pcie as p i c e and gb as gigawatt just hurts 😅
@dinoscheidt
@dinoscheidt Год назад
We need about 500 Liters of Beer per Month. We learned, that we maybe shouldn’t buy it at the SevenEleven Corner Store. Analysis 5/5 Stars ⭐️
@c0l0nelp0pc0rn
@c0l0nelp0pc0rn Год назад
I pressed the like button, but I was under duress.
@TariqSajid
@TariqSajid Год назад
What about linode ?
@jasonkristian8457
@jasonkristian8457 Год назад
yes but that not fair Netflix set up via ISP ,
@ShimoriUta77
@ShimoriUta77 9 месяцев назад
15TB NVMe server drivers? Now that's sound like bullshit for me.
@ninocraft1
@ninocraft1 Год назад
iAss
@dailyfactsgpt
@dailyfactsgpt Год назад
just tried to like your video again after i did it 5 seconds earlier
@donkeyy8331
@donkeyy8331 Год назад
I feel like people are too blinded by the cloud gods.
@morethanpixls
@morethanpixls 7 месяцев назад
What about IT salaries?
@k98killer
@k98killer Год назад
Plugs aren't supposed to go in your nose. That's the problem.
@kevinb1594
@kevinb1594 Год назад
I feel like the cost/benefit really depends on the business. I'm a little skeptical of the articles representation but still, the auxiliary costs to a particular business could totally justify the cost of cloud services depending on the business. Thinking about things like the consequences of getting HIPPA compliance wrong could absolutely destroy your business. Not being able to provision more hardware fast enough when your business blows up in popularity... Being stuck with all that hardware and staff when the business takes a hit... Having to setup new hardware in different regions when you go international..
@pencilcheck
@pencilcheck Год назад
ahrefs isn't even hosting, clearly an article to bait and switch. A bad marketing one.
@marcusrehn6915
@marcusrehn6915 Год назад
IaaS is clearly pronounced "YAAS"
@ThePrimeTimeagen
@ThePrimeTimeagen Год назад
Yaas queen
@yapdog
@yapdog Год назад
Dude... you're the a lovechild of Dr. Disrespect and Gilbert Gottfried 😅 Anyway, I've been watching your vids for a li'l bit, and you've become one of my goto channels. So.... *_SUBSCRIBED!_*
@hstivggfghyhgfg8359
@hstivggfghyhgfg8359 2 месяца назад
It's drugs kids
@ttng_
@ttng_ Год назад
im sorry why would a company with $SGD 500m in revenue needs 850 server tho i like the idea of going de-cloud but why that many servers though?
@zwc76
@zwc76 Год назад
Nobody questioned why they have to have 800 servers running 24/7?
@Edregol
@Edregol Год назад
The racks would look nice if it wasn't all Dell servers xD
@omfgbunder2008
@omfgbunder2008 Год назад
Does ahrefs do anything other than run a shitty search engine bot? I block them whenever I see them scraping a website.
@DryBones111
@DryBones111 Год назад
It would be a fairer comparison to take this napkin math to an AWS rep and ask for a quote. If you did your math right, you'd probably get a pretty competitive quote. On the other hand, they might laugh you out of the room when they see you've missed out on all of the security, redundancy and compliance costs.
@ThePrimeTimeagen
@ThePrimeTimeagen Год назад
yeah, this is the bigger worry about self hosting but they do use a "on-prem" provider, which seems like they have the "security."
@MrEo89
@MrEo89 Год назад
Prime over here making things up on the fly. “Unknown knowns” isn’t a thing. You either know you know something, or you don’t know what you don’t what you don’t know. You can’t “unknow” something you know you know. That would be transitioning from an “unknown unknown” to a “known unknown.” Feel me? Not necessarily making things up, but illogical.
@SamSepiol127
@SamSepiol127 10 месяцев назад
Obviously Cloud is more expensive. buuuut, I guess that if you email AWS sayin that you wanna move your gigawatz of RAM, kazillion of iper pentazillion byte to the Cloud...yeah, maybe you can obtain some discount 😂
@F4t4LisS
@F4t4LisS 7 месяцев назад
This hit me in the IaaS
@MrMondoRay
@MrMondoRay Год назад
so you pronounce it I-aaS and NVMe is N-V-M-e lol, jk love the content
@EdwardsMrJ
@EdwardsMrJ Год назад
👍 Since you asked so nicely
@jfolz
@jfolz Год назад
Here's a profitable company, managing their own servers for several years now, telling you that they would pay 11x for worse service in AWS, and would thus no longer be profitable. Chat: But what if a hard drive fails? And what about labor costs?
@sahazel4675
@sahazel4675 Год назад
trust the chat to actually know stuff
@raptyaxa5771
@raptyaxa5771 Год назад
you can outsource just the storage to the cloud (aurora, bigquery etc).
@BrandonSorenson-fb3gg
@BrandonSorenson-fb3gg 9 месяцев назад
@@raptyaxa5771 this is why you use a 5 year ammortization schedule and you sign contracts with Dell and a Storage vendor (NetApp, Pure, etc.). I would never have hardware without service agreements, what happens if you 1) dont have the expertise available or 2) you have a hardware failure. Service contracts are a must if you're running an enterprise size business. Before movign to the cloud we were paying about 300k to account for growth / obsoletion
@Darth_Bateman
@Darth_Bateman 9 месяцев назад
Not to mention being a hostage and not being able to get your data back ever again.
@o1-preview
@o1-preview 9 месяцев назад
@@Darth_Bateman didnt watch the video, but wait, is having your own server a thing again? Not the worse idea, but if your shit goes viral it'll go offline since it doesn't have a cluster to scale to..
@zirgaoec3784
@zirgaoec3784 Год назад
iAss
@oscarljimenez5717
@oscarljimenez5717 Год назад
When you have too much money, you build your own cloud :)
@ThePrimeTimeagen
@ThePrimeTimeagen Год назад
just build your own cloud 5head
@z-aru
@z-aru Год назад
Build your own space company, change from cloud to space 5Head
@benotisanchez5583
@benotisanchez5583 11 месяцев назад
I mean you could also build your own cloud with your computer and cloudflare tunnels.
@evanhowlett9873
@evanhowlett9873 Год назад
IaaS (ah yes... The cloud) DC = data center
@dmsalomon
@dmsalomon Год назад
If you take a 3 year reserved instance plan payed upfront it reduces the cost by 62%. Still massively cheaper with your own hardware, and once your paying for cloud upfront that obviates the entire advantage of cloud which is that you have month to month flexibility.
@JoaoPaletas
@JoaoPaletas Год назад
Cloud makes sense for businesses that require elastic availability, 100% on prem might not make sense then. Say ticketmaster has a consistent load of 50000 users per day, but now Taylor Swift is selling a new tour, it would make sense for them to scale into the cloud for that period to offset the abnormal load. Cloud by default will always be more expensive, but amazing to scale only when needed.
@FabioDiGiorgio
@FabioDiGiorgio 7 месяцев назад
only VPS in a cloud environment by default will always be more expensive, the fact I see only people that can't build a solution without a service VPS like, is the main problem...website of Taylor Swift to sell tickets can run and scale on AWS for few bucks per month, VPS not needed at all
@Mitakbacktrack
@Mitakbacktrack Год назад
The conclusion is: Start in the iAss, when you grow you will know where to put the infrastructure in ;)
@dejangegic
@dejangegic Год назад
you mean IaaS?
@cmelgarejo
@cmelgarejo Год назад
Nah, prety clear, iAss I am what about you guys? 😂
@chudchadanstud
@chudchadanstud Год назад
Instructions not clear. I ended up in prison.
@segen8324
@segen8324 Год назад
In singapore right? right?
@cmelgarejo
@cmelgarejo Год назад
@@chudchadanstud roflmao
@FredoCorleone
@FredoCorleone Год назад
I wonder why in the recent years the tech industry is making dumb choice after dumb choice, it's like engineering has gone completely out of the window.
@ras4884
@ras4884 Год назад
so much abstraction
@aslkdjfzxcv9779
@aslkdjfzxcv9779 Год назад
i love the datacenter being an api.
@KadenCartwright
@KadenCartwright Год назад
If you have a large enough scale for it to be worth it, open stack or canonical MAAS can give you API driven self hosted hardware :)
@colinjohnson5515
@colinjohnson5515 Год назад
⁠​⁠@@KadenCartwrightI’ve only worked for companies with
@vabello
@vabello Год назад
For anything I've ever stood up, it's always been substantially cheaper to do it on our own hardware in a co-lo than putting it in any cloud, especially if we want anywhere near the performance we have today on our own hardware. None of this is a surprise to me.
@solarburster
@solarburster Год назад
With a beginning of russian war against Ukraine, out major banks moved to cloud in EU from on-premise in UA. One of them (monobank) moved to AWS and they also got significant increase of bill for infrastructure. This was mentioned by their CEO Oleg Gorokhovsky. He also was questioning himself why orgs tend to use clouds.
@thewhitefalcon8539
@thewhitefalcon8539 7 месяцев назад
They should try Hetzner
@alxjones
@alxjones 7 месяцев назад
What I love about cloud is that it lets me, an individual, make stuff and deploy it for cheap-to-free without having to worry about maintaining additional hardware. It's kinda the same deal when it comes to installing internal applications at smaller companies (or smaller teams/orgs within companies). When scale comes into play, the waters get muddied. There's a ton of tradeoffs to consider, and how much money you pour into either on-prem or cloud infrastructure is going to determine how big those tradeoffs are and in what direction. Not every company will be better off one way or the other, it's about analyzing your individual situation and picking the option that's best for you.
@MeriaDuck
@MeriaDuck Год назад
So that is even with reserved instances. 1 TB of RAM sounds ridiculous to me anyway. And I am an actual Java developer, so quite used to stuff eating up ram like no other.
@MeriaDuck
@MeriaDuck Год назад
And I've done self hosting in colo in the early 2000s. For some reason management never seemed account for replacing cost every 3/4/5 years and trying to wring lots of 'free' time.
@lucasew
@lucasew Год назад
A lot of ML stuff can use a lot of ram. BTW a lot of RAM is also very useful for storage caching. Idk how necessary it is when you can have a 16x NVMe RAID 10 tho.
@muhwyndham
@muhwyndham Год назад
The amount of vector logic in AI/ML nowadays will make you crazy. Literally Python code jerking off of each other and produce pretty image or cosplaying as a human will cost you more than just 1TB of RAM.
@GartBeck
@GartBeck Год назад
Idk, the difference between the two scenarios is so insane that it could mean that allocating your own hardware will always be cheaper than any approach on AWS
@ruukinen
@ruukinen Год назад
The upfront costs are very high though so like stated it's not feasible until you have enough cashflow that it doesn't hurt the company to make those upfront investments. Pay as you go is pretty much always more expensive in the end but you don't have to have the money now. Like buying a house for example.
@torstengang5521
@torstengang5521 Год назад
This is why aws is Amazon's money printing venture
@lorenzobignardi8605
@lorenzobignardi8605 Год назад
0:38 - 0:43. You better press that like button.
@FabioDiGiorgio
@FabioDiGiorgio 7 месяцев назад
The TCO in AWS could be easily less than on prem, obviously, only if people know how to use a cloud environment, in this case the #1 of cloud providers: AWS. If you use services VPS like or worse Kubernetes, inside a public cloud environment, you are NOT using the cloud, you just made a migration "lift and shift" of your infrastructure, the fastest and the expensive way to migrate, this is not the way a Cloud Architect approach a migration, this is the way as an elder System Administrator think. If he does't want to learn how AWS work and how to optimize the infrastructure cost, is better that he stay far away from any public cloud, instead of complain of something he doesn't know how to use at all is nonsense, I clearly see an unskilled (in cloud environment) guy that complain and cry like a 5yo kid.
@zacbackas
@zacbackas Год назад
it blows my mind that they just brushed over capacity planning and autoscaling as if they need to pay for Ec2 instances that handle their full capacity 100% of the time
@GOTHICforLIFE1
@GOTHICforLIFE1 Год назад
That is very true actually, but i assume their load is reasonably high based on their on-prem capacity already.
@matthiasg4843
@matthiasg4843 Год назад
AWS is expensive if you don't know how to use it correctly
@neociber24
@neociber24 Год назад
​​@@matthiasg4843and nobody knows even Amazon
@Blob64bit
@Blob64bit Год назад
Great point but to be fair since it was 10x more expensive you'd need to run at
@AlwaysStaringSkyward
@AlwaysStaringSkyward Год назад
Fair point but when you're dealing with very large instances like they would be you can't rely on AWS having enough capacity when and where you want them.
@umka7536
@umka7536 Год назад
AWS has discounts up to 70%
@Ravengeno
@Ravengeno Год назад
Still 2x more expensive for worse hardware.
@megaman13able
@megaman13able Год назад
It's a trap!
@fritzstauffacher6931
@fritzstauffacher6931 Год назад
@@Ravengenoyup buying dedicated servers is way way cheaper.
@Novascrub
@Novascrub Год назад
@@fritzstauffacher6931 but you have to pay people to run them. those are _not_ cheap. And their processes aren't as mature. Your SRE team isn't born with runbooks. I can stand up an arbitrarily large database cluster with multiregion HA and point in time recovery in like 3 mins clicking around. And it actually works. The hardware isn't the point at all.
@bogaczew
@bogaczew Год назад
still muy caro
@xbmarx
@xbmarx Год назад
Everyone defending AWS in here pretending like you also don't have to hire a TEAM of platform engineers to keep your AWS infrastructure going. 🤣 I don't believe there is ANY DIFFERENCE in labor costs between managing a large cloud and some on prem infrastructure.
@creditizens
@creditizens 9 месяцев назад
@ThePrimeTime I am surprise that they didn't take into account that when you plan to have a server on AWS for 1 or 3 years there is a HUGE discount for reserved instances which lowers the price -70% down... even more if you use a mix of reserved instances and spot instances (which are -90% discounted). They can save money going to the cloud and serverless (dynamodb) + lambda + s3 can also be considered for super fast retrieval and serve of data instead of using EBS volumes. Maybe they had some issues with AWS and pepper sprayed this article to them 🤣😂
@koorootube
@koorootube 9 месяцев назад
They did factor longevity. per the article, they used the price of a 3yr reservation.
Далее
I Accidentally Saved HALF A MILLION $ | Prime Reacts
29:12
AWS Fooled Devs & Sabotaged The Industry | Prime Reacts
21:47
We finally APPROVED @ZachChoi
00:31
Просмотров 8 млн
DHH discusses SQLite (and Stoicism)
54:00
Просмотров 75 тыс.
PirateSoftware and his craziest DefCon story!
6:09
Просмотров 228 тыс.
How much faster has Mojo's dictionary gotten?
7:40
Просмотров 4,3 тыс.
Why Companies are Kicking Cloud to the Curb
10:06
Просмотров 495 тыс.
How to -10x Engineer Correctly
22:22
Просмотров 508 тыс.
Serverless Was A Mistake | Prime Reacts
13:40
Просмотров 224 тыс.
$400,000 a Year and 10 Hours A Week At GOOGLE
15:10
Просмотров 379 тыс.