Тёмный

How to export data from Power BI/Query to Azure SQL 

Curbal
Подписаться 138 тыс.
Просмотров 10 тыс.
50% 1

Опубликовано:

 

20 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 71   
@21mrock
@21mrock 5 лет назад
Hi Ruth, you are doing amazing work. Listening you itself is a fun. Keep rocking!!!
@CurbalEN
@CurbalEN 5 лет назад
Thanks Rahil! /Ruth
@JamesManjackalMSFS
@JamesManjackalMSFS 6 лет назад
Thank you very much! I will try! Just a question. Is the Azure SQL Service one of the free Azure Services? In my company all have fear to use Azure... even I had to use my personal credit card for testing Azure Cognitive Services & show to my boss what I can get!... now when you finish your free time if you wish to go on with a free account you have to give your card. It's free for 750 transactions/month for cognitive services... This is why I ask you this question... I suppose some Gb/month will be free....
@CurbalEN
@CurbalEN 6 лет назад
You can try it for free, but then it will cost you: azure.microsoft.com/en-us/pricing/details/sql-database/single/ /Ruth
@JamesManjackalMSFS
@JamesManjackalMSFS 6 лет назад
Thanks Ruth, but after watching several videos of the BI Convention in Seattle, now I think I will try to use Common Data Services to save my data and model in the cloud. Then I've seen that I can recover them in Power BI with DataFlows, and it's much cheaper! Another new upgrade I'm astonished is the possibility to use Power Query Online, which is now a part of Power BI service! I'm realizing of a new world of posiblities in the world of computing and modelling. Now you can work "on the fly" with the data when a transaction is being triggered and then to "recompose" the transactional data according the data model you are using! If the triggered data come to Power BI already "joined" you could simplify your Power BI model a lot! A join of just one record in the cloud is carried out only once (very good if you are not a PRO user without incremental refresh) and very efficient in time as the records are composed according the model schema on the fly...
@CurbalEN
@CurbalEN 6 лет назад
Thanks for sharing! I need to create some content around that to spread the word :) /Ruth
@berndhartmann9815
@berndhartmann9815 6 лет назад
Hi Ruth, thank you very much for your very helpful videos! I tried to do like you suggested - however there is alwas a failure-message: DataSource.Error: ADO.NET: R script error. Error in odbcDriverConnect(connectionString) : could not find function "odbcDriverConnect" Is it a driver-problem? A problem regarding windows 32-bit or 64-bit-version? Best regards, Bernd
@CurbalEN
@CurbalEN 6 лет назад
Do you have the odcb package installed? /Ruth
@berndhartmann9815
@berndhartmann9815 6 лет назад
@@CurbalEN Hi Ruth, yes I have installed the RODBC - here the respond: > install.packages("RODBC") Installing package into ‘C:/Users/bernd.hartmann/Documents/R/win-library/3.5’ (as ‘lib’ is unspecified) trying URL 'cran.rstudio.com/bin/windows/contrib/3.5/RODBC_1.3-15.zip' Content type 'application/zip' length 879575 bytes (858 KB) downloaded 858 KB package ‘RODBC’ successfully unpacked and MD5 sums checked The downloaded binary packages are in C:\Users\bernd.hartmann\AppData\Local\Temp\RtmpyilUjs\downloaded_packages Best regards, Bernd
@tanababa
@tanababa 6 лет назад
Taking my chances again... liking before seeing ;)
@CurbalEN
@CurbalEN 6 лет назад
Hope I did good this time! 😂 /Ruth
@tanababa
@tanababa 6 лет назад
You got it right :-)))
@CurbalEN
@CurbalEN 6 лет назад
Phew!!! Lucky me! Hope the tutorial was useful :) /Ruth
@tanababa
@tanababa 6 лет назад
Probably in the future some time :-)
@shilpisinghal810
@shilpisinghal810 4 года назад
Hi, thanks for the video. I am not able to view ODBC string Azure for MySQL Database. Can we achieve this using other driver in R script or Python script?
@denissa6933
@denissa6933 5 лет назад
Super cool. Do you know if these data is going to refresh automatically? Or do we need to refresh manually?
@CurbalEN
@CurbalEN 5 лет назад
This might help you: docs.microsoft.com/en-us/power-bi/desktop-r-in-query-editor /Ruth
@CortesdoRafaOficial
@CortesdoRafaOficial 6 лет назад
Hi Ruth, if this dataset was in power bi service it Will Work at Every schedule refresh? Or it only work in power bi desktop?
@CurbalEN
@CurbalEN 6 лет назад
Another great question! R works in the service too, so it should work, but I need to test it. Let me know if you manage first :) /Ruth
@CortesdoRafaOficial
@CortesdoRafaOficial 6 лет назад
I will try...thanks Ruth...
@CurbalEN
@CurbalEN 6 лет назад
Please let me know if you test it :) /Ruth
@CortesdoRafaOficial
@CortesdoRafaOficial 6 лет назад
Working in Power BI Services... But it only work with gateway in personal mode like all the R scripts in power bi.
@CurbalEN
@CurbalEN 6 лет назад
Thanks for sharing!! :))
@vog5197
@vog5197 6 лет назад
Thanks! I will try this at the office. For someone who hasn't used Microsoft SQL Server Management studio, how do you do the part at 9:24 where you connect to the Azure server? Is it easy to find the Azure server connection details?
@CurbalEN
@CurbalEN 6 лет назад
Oh! I forgot to show that part! Yes, it is: Username@server and then your password for the database. /Ruth
@vog5197
@vog5197 6 лет назад
From the little I understand, SQL server is optimized for normalized data models, whereas PBI likes one big fact table with many small dimension tables. Does the model get normalized when you export it to Azure SQL?
@CurbalEN
@CurbalEN 6 лет назад
Hi, you export the tables as is in power bi. Once you have the data in sql , you can transform it there as needed it. /Ruth
@gnanaprakash3029
@gnanaprakash3029 6 лет назад
Hi Ruth Thanks for sharing many videos on Power BI. Can you please provide the sequence to be followed to watch your playlists.
@CurbalEN
@CurbalEN 6 лет назад
I have a lot of videos... mmmmm i see What i can do! /Ruth
@gnanaprakash3029
@gnanaprakash3029 6 лет назад
I would be easy if you provide the sequence of your playlist. like which playlist has to be seen first and second......
@CurbalEN
@CurbalEN 6 лет назад
Start with Power bi for beginners, then power query, power bi and finally Dax Fridays :) /Ruth
@aravindgutta6091
@aravindgutta6091 3 года назад
Hi Ruth, Is there any other way to export data from Power BI visuals to Azure SQL tables other than this R-Script
@CurbalEN
@CurbalEN 3 года назад
Not that I know of
@mshparber
@mshparber 6 лет назад
Thanks! Is there a free or a very cheap account plan in Azure to play with?
@CurbalEN
@CurbalEN 6 лет назад
Yes, you have 30 days trial, where you can test for free and then you o lot pay for what you consume. Give it a go! /Ruth
@catty1685
@catty1685 4 года назад
Hi Ruth, very good demo. Did you test it after publishing to Power BI Service? I wonder if this solution works only from Power BI Desktop. Once published the pbix file to Power BI Service, how do we know the IP address of the server in Microsoft data center? How do you set the firewall in that case? I would like to create a PBI solution using Google Maps Geocoding API (yes I saw your video), schedule a refresh and export the geocoded addresses back to a table in Azure SQL Database to complete a round-trip data flow back into the DW.
@CurbalEN
@CurbalEN 4 года назад
To make google API’s work in the service you need to create a custom connector so you can specify how the service should authenticate. Hope this helps! /Ruth
@hoke73
@hoke73 4 года назад
Hi Ruth, do you know where to get from Azure the information about existing VMs in my tenant(several subscriptions)? information like hostname, primary ip, serial number. uuid, created by, created on, last updated by and so on? i would like to get this information to power bi. thx
@CurbalEN
@CurbalEN 4 года назад
I dont, trybin the power bi community!
@gopid6342
@gopid6342 6 лет назад
How can i download the script that whatever in notepad?
@CurbalEN
@CurbalEN 6 лет назад
The script is in my github account, link on he description box! /Ruth
@qaisassef
@qaisassef 6 лет назад
Hello, would it be possible to show how to export data and append it to an existing DB ? (only new or updated rows)
@CurbalEN
@CurbalEN 6 лет назад
Hi, I have no idea how to do that unfortunately.... Maybe somebody in the power bi community knows? /Ruth
@CortesdoRafaOficial
@CortesdoRafaOficial 6 лет назад
Hi you could create a trigger that when you update the table in DB, they only will do it with non duplicated values... In Ruth's example, if you dont want to keep duplicated values in Date and CityID you will create a trigger like this CREATE TRIGGER removeduplicates ON "Sessions" FOR INSERT AS BEGIN SET NOCOUNT ON; DELETE FROM "Session" WHERE Date IN(SELECT inserted.[Date] FROM inserted) and CityID IN(SELECT inserted.[CityID] from inserted) INSERT INTO "Sessions" SELECT * FROM inserted END
@CurbalEN
@CurbalEN 6 лет назад
Thanks a lot !!! 🤗 /Ruth
@sallyfromthevalley66
@sallyfromthevalley66 3 года назад
@@CortesdoRafaOficial Thankyou, but where do we put this? In the R script? At what point?
@sallyfromthevalley66
@sallyfromthevalley66 3 года назад
Sorry found it in SMSS
@gopid6342
@gopid6342 6 лет назад
Can i export the data from azure DB without using "Run R Script"?
@CurbalEN
@CurbalEN 6 лет назад
I only know this way, try asking in the power bi community. /Ruth
@gopid6342
@gopid6342 6 лет назад
Curbal thank you
@dhirajr3376
@dhirajr3376 5 лет назад
Hi I get an error. What to do? Formula.Firewall: Query 'Professionals' (step 'Run R script') references other queries or steps, so it may not directly access a data source. Please rebuild this data combination.
@CurbalEN
@CurbalEN 5 лет назад
It has to do with your privacy settings: m.ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-kqYtrwXmpVc.html /Ruth
@dhirajr3376
@dhirajr3376 5 лет назад
@@CurbalEN Thank you very much. Now i get this error: DataSource.Error: ADO.NET: R script error. Error in library(RODBC) : there is no package called 'RODBC' Execution halted I already installed > install.packages(RODBC) in R studio...
@gopid6342
@gopid6342 6 лет назад
How it will take the datatype of column?
@CurbalEN
@CurbalEN 6 лет назад
Great question... and I forgot to check! You will have to test it to know ;) /Ruth
@gopid6342
@gopid6342 6 лет назад
Okey I will test
@rikabchand6036
@rikabchand6036 2 года назад
9:21 You seems to be using SSMS from onprem not the AZURE SQL, Please correct me if I am wrong.
@CurbalEN
@CurbalEN 2 года назад
No ssms I am afraid
@rikabchand6036
@rikabchand6036 2 года назад
@@CurbalEN Since it was looking like on-premises I was little confused. So what you have open in Azure SQL only?
@CurbalEN
@CurbalEN 2 года назад
Oh sorry, I pulled from memory but you are right, it is SQL management studio
@rikabchand6036
@rikabchand6036 2 года назад
@@CurbalEN it is not Azure SQL right? Which script is required for Azure SQL then?
@CurbalEN
@CurbalEN 2 года назад
It is
@aks541
@aks541 6 лет назад
By any chance can we use Python in PowerBI?
@laurencecross
@laurencecross 6 лет назад
Python is coming soon according to www.microsoft.com/en-us/businessapplicationssummit/video/BAS2018-204 (54mins)
@CurbalEN
@CurbalEN 6 лет назад
Yes! python is coming to power bi!!! Not available yet though... I will make a video when they release it /Ruth
@jinjin8370
@jinjin8370 4 года назад
Hello, May I consult why I follow the steps and the the error message below? can I know how to fix it? error message: DataSource.Error: ADO.NET: R script error. Warning messages: 1: In odbcDriverConnect(connectionString) : [RODBC] ERROR: state IM002, code 0, message [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified 2: In odbcDriverConnect(connectionString) : ODBC connection failed Error in sqlSave(myconn, dataset, tablename = "PowerBISQL", rownames = FALSE, : first argument is not an open RODBC channel Execution halted Details: DataSourceKind=R DataSourcePath=R Message=R script error. Warning messages: 1: In odbcDriverConnect(connectionString) : [RODBC] ERROR: state IM002, code 0, message [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified 2: In odbcDriverConnect(connectionString) : ODBC connection failed Error in sqlSave(myconn, dataset, tablename = "PowerBISQL", rownames = FALSE, : first argument is not an open RODBC channel Execution halted ErrorCode=-2147467259 ExceptionType=Microsoft.PowerBI.Scripting.R.Exceptions.RScriptRuntimeException
@sid0000009
@sid0000009 3 года назад
If this the best way to save the snapshot of the data set every time we refresh in Power BI ? Also if this feature already cover the feature which was requested here - ideas.powerbi.com/ideas/idea/?ideaid=69fc3925-b9f3-4d7d-b4fa-e4687d69e0c5 Secondly, is there an automated way to export data from dashboard/reports. Manually it gives us an option but can we automate the export using R script as well from Dashboard/Report - Thanks!!!
@lindamcgrew8050
@lindamcgrew8050 3 года назад
00
Далее
BULK Write Back to SQL from Power BI
11:40
Просмотров 33 тыс.
Тестирую гаджет для роллов! 🙈
00:42
How to Import local database to Azure SQL Database
10:38
Power BI - Write Data to SQL
9:49
Просмотров 62 тыс.
Sending Data from Power BI to SQL
5:02
Просмотров 11 тыс.
Query folding to improve Power BI performance
11:39
Просмотров 19 тыс.