Тёмный

How I Would Build a Software System for Scale 

TomDoesTech
Подписаться 30 тыс.
Просмотров 5 тыс.
50% 1

🌎 Follow me here:
Discord: / discord
Twitter: / tomdoes_tech
Facebook: / tomdoestech​
Instagram: / tomdoestech​
TikTok: / tomdoes_tech
☕ Buy me a coffee: www.buymeacoff...

Опубликовано:

 

2 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 41   
@wizz0056
@wizz0056 3 месяца назад
Some tips based on my experience in a large project (30+ microservices, 70+ devs): DX - In cases where you have many microservices, running them all locally for development would rarely be possible. Devs would need beefy laptops to be able to run all the services, and you would also run into the issue of having different setups (eg. docker-compose) for local development and production (eg. kubernetes), which will get exponentially harder to keep in sync as you introduce more and more services and infrastructure pieces. Best approach for this (but pricy) would be to have on-demand remote environments, ideally running inside of kubernetes (or your platform of choice), in which case you eliminate most of the "works on my machine" problems, by having the devs work on the setup that's closest to production. As a bonus with this approach, you also get the benefit of being able to provide on-demand environments for QA/Compliance teams, or for any other purpose, without much effort, since it uses the same logic. Microservices - Please use kafka/rabbitmq/nats (or alternative tech) for communication between services, as opposed to having direct communication. This adds decoupling to your architecture, and will let each service run at it's own pace. This is especially useful when APIs change (like in the example from the video) so instead of having to now update all services that depend on the one that changed the api, you would only change that one, and the way it communicates with the "message bus".
@prosperzegue6735
@prosperzegue6735 3 месяца назад
Great explanation 👌🏽. I would like to know if a startup developping a multi-tenant SaaS (around 100k users predicted) should begin with microservices architecture or just start with a multi-layer monolith architecture (frontend, monolith backend, single DB) ?
@wizz0056
@wizz0056 3 месяца назад
​@@prosperzegue6735 It really depends on your case. For example, if your team never worked on microservices, choosing to do so from the start will add unnecessary complexity and slow you down. You will inevitably have to go the microservice route with that scale, but starting with the monolithic approach and then slowly breaking apart the monolith into different services is still a valid strategy. You can make this process easier by not tightly coupling your code. This can be specific to the tech/language/framework you choose, but you can still take measures to make moving away from the monolith less painful. On the other hand, if you're confident in your team and have prior experience with microservices, I don't see a reason to start with the monolith except for development velocity (only in case where your team doesn't have experience with the microservice architecture). Just be careful of the premature optimization pitfall, and don't over engineer your setup.
@prosperzegue6735
@prosperzegue6735 3 месяца назад
@@wizz0056 Thanks so much for your reply. Your answer is perpect 👌🏽.
@karlnassar8646
@karlnassar8646 Месяц назад
can you send us resources about communication between services using kafka/rabbitmq/nats I never found what I was actually looking for, thanks
@twitchizle
@twitchizle 12 дней назад
oh no, but i need to scale to billions for my 0 users
@yunyang6267
@yunyang6267 3 месяца назад
Please make a minimal project using this architecture if you have the time.
@acheraime
@acheraime 3 месяца назад
Great job explaining this architecture. One crucial piece that I see missing is your observability/ monitoring layer. I’ll add prometheus, grafana to collect app and infrastructure metrics. You can even spice it up a bit with jaeger for traceability. This will equip you with a feedback loop to extend your pipeline to do canary releases later on.
@TomDoesTech
@TomDoesTech 3 месяца назад
Ahh yeah good call. This was the second time I recorded the video and I forgot the observability part. Probably should have written it down instead of doing it off the top of my head.
@noneedtoknowthishandle
@noneedtoknowthishandle Месяц назад
This is quality content. Great work. Subscribed.
@dashaabushenko8599
@dashaabushenko8599 3 месяца назад
very nice to see how a senior dev would approach a project architecture-wise. thank you! very useful 👏🏻👏🏻👏🏻
@JS_Jordan
@JS_Jordan 3 месяца назад
4:40 im using bun and my microservices can consume shared packages from the package.json at the root of the project. So if i need to upgrade a package shared across all microservices i can just update the root package json
@TomDoesTech
@TomDoesTech 3 месяца назад
That sounds awesome! I haven't used bun much
@shakilhossain1551
@shakilhossain1551 3 месяца назад
could you make one more video with this architecture for minimum project
@notarealperson9709
@notarealperson9709 3 месяца назад
how about the communication between micro-services? gRPC?
@TomDoesTech
@TomDoesTech 3 месяца назад
Yeah gRPC is a great way to communicate between them, could also use a message bus like Kafka
@taquanminhlong
@taquanminhlong 3 месяца назад
I'm not a big fan of gRPC, it requires more setup and the difference doesn't take much, I think message bus and json is enough 😂
@ayushgandhi577
@ayushgandhi577 Месяц назад
I would like to see the implementation of the system design you drew. Even a small application will suffice.
@issm6685
@issm6685 3 месяца назад
Very nice! Thanks for sharing 🙏
@tarikogic9313
@tarikogic9313 3 месяца назад
Are there any youtube tutorials that do this in practice which are explained in a clear manner?
@TomDoesTech
@TomDoesTech 3 месяца назад
Not that I know of sorry
@ThiagoVieira91
@ThiagoVieira91 3 месяца назад
Very nice video Tom!. But I am worried about running all the stack in a developer machine. From my experience, even a resourceful a machine can run out of resources pretty quick running everything at once. Also, as you are targeting a micro services architecture for the backend, how about using micro frontends for the web? It can enhance the work of several teams working separately in the same frontend. I also understand that micro frontends also facilitates to ship often.
@TomDoesTech
@TomDoesTech 3 месяца назад
I don't have any experience with micro frontends, from my understanding they sound good in theory but are a nightmare to work with. I think there's a way to get the whole thing running on Dev's machines, or at least the parts they need
@howuseehim
@howuseehim День назад
Php. It will suffice.
@karlnassar8646
@karlnassar8646 Месяц назад
is the BFF an API Gateway?
@TomDoesTech
@TomDoesTech Месяц назад
@@karlnassar8646 no
@daniel64147
@daniel64147 3 месяца назад
How do you do BFF?
@TomDoesTech
@TomDoesTech 3 месяца назад
The bff is just another service
@daniel64147
@daniel64147 3 месяца назад
@@TomDoesTech how do you communicate them, with gRPC?
@cannotthinkofanybetterhandle
@cannotthinkofanybetterhandle 3 месяца назад
Shouldn't we make bff common for both mobile and web (instead of doing it twice in the next js web app and a separate mobile bff)?
@TomDoesTech
@TomDoesTech 3 месяца назад
No, BFF layers should be for a specific UI, they're 1-1
@codedusting
@codedusting 3 месяца назад
NextJS Layer will be using Pages or App Router? Is there any need for App Router in this architecture?
@cannotthinkofanybetterhandle
@cannotthinkofanybetterhandle 3 месяца назад
Here, there is no need to go for app router. Choose based on the team and their experience.
@codedusting
@codedusting 3 месяца назад
@@cannotthinkofanybetterhandle Thanks
@jitxhere
@jitxhere 3 месяца назад
Hey there. If we are using any other backend then do you think we could leverage proper type safety?? Like at that point it just becomes manually typing it out...
@TomDoesTech
@TomDoesTech 2 месяца назад
It doesn't matter
@Euquila
@Euquila 3 месяца назад
Or you can just deploy LOCALLY if your target audience requires strict data privacy, has unreliable internet connectivity, or needs low-latency access to critical systems, such as in healthcare facilities or remote locations.
@TomDoesTech
@TomDoesTech 3 месяца назад
Like an intranet?
@jaycodes8790
@jaycodes8790 3 месяца назад
Tom! Why not ROR ?
@TomDoesTech
@TomDoesTech 3 месяца назад
What is RoR?
@xiaohanyu
@xiaohanyu Месяц назад
@@TomDoesTech I think RoR stands for Ruby on Rails?
Далее
The proper way to secure your databases
14:11
Просмотров 21 тыс.
Use This to 10x Your Portfolio Projects
11:48
Просмотров 1,5 тыс.
🛑самое главное в жизни!
00:11
Просмотров 220 тыс.
МАЛОЙ ГАИШНИК
00:35
Просмотров 460 тыс.
Living life on the edge 😳 #wrc
00:17
Просмотров 2,1 млн
What does larger scale software development look like?
24:15
How I Structure my Go Applications for Scale
14:53
Просмотров 1,8 тыс.
Learn Redis in 40 Minutes - Upstash Redis
41:48
Просмотров 4,9 тыс.
This Is Why Managers Don't Trust Programmers...
28:04
Просмотров 255 тыс.
Why I Use C | Prime Reacts
13:00
Просмотров 160 тыс.
How I Built a Marketplace with Stripe Connect
13:21
Просмотров 3,4 тыс.
🛑самое главное в жизни!
00:11
Просмотров 220 тыс.