Thanks for this video! In our project we were loading data from oracle db to Teradata stg tables using informatica one to one mapping and after loading to stg tables were doing transformations and loading dimension and fact tables so it was ELT process.
Can MongoDB, with its analytical engine and Time Series collections, be considered a hybrid DB/Warehouse? Would it be inherently wrong to store e.g. historical sales transactions of a shop and current transactions within a Time Series Collections on Mongo? If not, which alternative would you consider for it? Thank you so much for your video 👏🏻👏🏻
Can we use ELT for datawarehouse ? Ca we store log file as it in datawarehouse if yes then what's exactly different between data warehouse and data lake?
No in data warehouse we can not store log file as it is unstructured data. but in data lake we can have unstructured and structure data that's the difference exactly
Are datawarehouse and data lake different sections of the same set up? For example if we have a snowflake DW, can the data lake be also within the same snowflake set up but an isolated environment?
Snowflake is created/hosted on any of the three clouds we have. So as per my understanding, snowflake is data warehouse but it can be used as a datalake as well. When used as a datawhere house it stores the data in snowflake itself but when you use it as a data Lake, it keeps or make use of Amazon S3 for example bucket for storage
can we use Oracle also as data warehouse because as far I know Teradata is also database only. so any database available in market, we can use that as data warehouse. Am I correct?
While technically u could use but this would be at the cost of performance. Please note that traditional databases works on rows where as typical DWH database is configured to operate in columnar fashion.
So what happens is when you have data in a database then on regular intervals we move this data from database to a datawarehouse using an ETL tool. So the data flows from your database -> then ETL tool ~> then a datawarehouse. The frequency at which you move data from a database to a data warehouse is generally suggested by the clients or the business users
The idea behind developing data warehouses is to keep historical data you can relate it with a normal datawhere house people are using to store goods so it's a kind of storing huge amount of data
