Running Python Scripts in Power BI 

That's great to hear, Michal!

Thanks for watching!

+Steve Fox Definitely! Only limitation will be what is supported by Service I assume

Thank you Hemant!

Glad you found this useful, Surajit.

Thank you Tom!

+nizhonglian awesome, glad you liked it!

No problem, Khanh!

+Mark Baich very good point. I'll add it in the description!

@@BIElite If I set a Python script on a Power Bi file from Desktop version and I publish it, is it going to work dynamically when people access from online version?

With personal data gateways the data can still be accessible to the PBI service.

Nice! Thanks for the feedback Raerae

+SantoshKumar Rowlo No problem!

Thanks giavo!

Thanks Bruce!

Maybe you can help me, When I try to run the python script PBI asks me to assign privacy levels. I assign both my python script and my imported data a private privacy level and then Power Bi throws me an error saying"Formula.Firewall: Query 'Power_BI_Data_Dump_Pro_lst001' (step 'Run Python script') is accessing data sources that have privacy levels which cannot be used together. Please rebuild this data combination." I have tried different privacy settings but I always get this error. Any thoughts?

Sorry it took me so long to circle back to this. Did you find a fix for your issue? I ran into this once after selection Private and could not then change the privacy settings to make it work properly. I started over from the point before I imported a Python script and then selected Organizational and then it worked for me.

+D N ooh that’s a tough one. I’ve done this successfully with DAX but never with Python. Not sure I know how!

Thanks Asad! I've been meaning to make videos on this topic for quite a while but never got around to it. Glad to hear that there is some interest! I will definitely cover it at some point then. Thanks for bringing this up!

@@BIElite Great! Thank you very much :)

+Vishal Pawashe yeah definitely! Do you have any recommendations? I'm always looking for ideas

@@BIElite I was thinking more on the below points: 1. Any possible way we can use python datasets to analyze/process the data so that we don't need to use complex DAX formulas, which I guess is harder to understand 2. Any way we can create a new dataset based on processing existing table and populate that into new Table of Power BI ( Something we do using AUTOCALENDER DAX) 3. A video specially based on working with datasets using pandas for POWER BI - There are lot of videos on working with datasets but nothing which will help for POWER BI 4. As we have a lot of visualizations in Power BI, so need to find features which we can only get using python and not using the default visuals 5. One important thing which came into my mind is can we develop a code using PyCharm and paste that in Python Power BI Editor -this will make coding fast and bug-free Why not use the power of Python Language in Power BI. Let me know if the above points make any sense :)

+Vishal Pawashe I love these ideas! Thanks so much for sharing them all. I've added them to my list of topics to make videos about (given that I would need to learn a bit of the technologies you listed). But I definitely think that a couple of these would be nice for a video here soon

@@BIElite Also one more thing which always interests is the Custom Visual Called as 'Sankey Diagram ' using which we can track the flow of objects, this works best with a table/column chart to see the flow better. Actually, I used this for one of my clients where we used to track how users navigate through the website to get to a particular product on the website.

+14robisco thanks! I used the wine dataset that you can find at: archive.ics.uci.edu/ml/datasets/wine I manually removed some values to create "missing data"

Good question, Rahul. I don't know of any methods to test the data via Python. I wish I could be of more help to you!

Gracias por ver. Consulte esta explicación en video: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Z40Txux1Lxk.html

import pandas as pd df = pd.read_csv("path to your file") df.to_excel("name.xlsx")

No problem!

Thanks Brendan!

R is pure stats. Python can do stats, plus a lot more

I have Anaconda installled (includes Jupyter) and this works fine.

+Tug Witt lol the thread you may have seen was probably the question I posted... a simple Python visual was taking 45 seconds to complete. I guess we had different problems though because mine was because Python was slow on my machine (from the CLI). So it made sense that Python in Power bi would be slow too. When I went home and installed Python on my personal machine, everything ran at a reasonable rate. Sorry, I wish I could help you but it seems your problem is different because it is running smoothly on your machine

Hey Steve, here's a good blog post on this: cmdlinetips.com/2018/02/how-to-subset-pandas-dataframe-based-on-values-of-a-column/

@@BIElite Thank you for the reference. It is helpful.

I believe so! Under Options, go to "Python" and there is a section for detected IDEs. Try to specify VS Code there

Not yet, but should be available soon!

Haha good question. I don't know why I did that!

@@BIElite Good answer. As Python/Panda fans, we still loved doing data munging with Python/Pandas. Thanks for sharing.

As a power bi user user and experience both in edit query and python script. Its way easier to transform your data in python script.

Hahaha I used to get up super early to make these

I don't think this is possible, unfortunately.

Nothing specific to Power BI. Knowledge of pandas would be more than enough!

@@BIElite Would that also mean that I wouldn't have to learn M or DAX? and I could just use Pandas?

I think I received a similar error a couple months ago. I had to resort to installing Python 2.7 and it worked out. Not a great fix though.

Hey Asad! Sorry for the late response. When running Python or R scripts, it usually gives me the same warning. What are you doing in the Python script?

Hey Parker! always good to hear from you. What i am trying to do with it can be summed up with this python one-liner df.loc[df.condition_column in ['foo, 'bar'], 'Group'] = df.Group.replace(my_dictionary). Simply put I have to replace a few values in a column named Group with the help of a dictionary called my_dictionary; but only do this if the column called condition column contains either 'foo' or 'bar'. I hope this makes sense.

+pham viet you will need to enable it in the preview features and then restart Power BI

I got it. Thanks for your support :D

+Neal Virtudes Yes you can! You just need to make sure that you are storing the scraped data in a pandas data frame. Then you can select this data frame in the step following your Python script and your data will be available

Was just about to ask this lol!

Haha hopefully you get it working

you might want to check where Python your Power BI is referencing. If it is not referencing to your anaconda location, you might want to change it.

Sam In my PowerBI settings I read the Anaconda directory. Can I check Python settings where Power BI is referencing? How do I do this?

@@kiwimaori2001 I don't think Python/Anaconda references to Power BI, only Power BI does the referencing since it is doing the importing. You can try installing the latest version of Power BI. Previously, I was using an old version of Power BI and Python scripting was not available.

Sam thanks for the advise I have the june version 2019 installed, I update the installation on a monthly base

Hi Neil, it’s likely that I added an unnecessary line. Thanks for bringing this up.

Haha thank you Daniel!

Hi there, you don't want to print the result. You simply need to assign it to another dataframe. For example, instead of the print statement, add a line that says: df2 = df.dropna()[(df.Country == 'Indonesia') | (df.Country == 'Singapore')] Then select df2 in the navigation step of the result.

Hi Parker, ok, it's resolved now after addition install of matplotlib using pip in python. Wonderful. Thank you.

Nice! Glad you figured it out

+sadyaz64 yes, definitely. Looking forward to doing a lot with it

Hmm I appreciate the comment and feedback but it's working fine in my headphones. Any chance that it's on your end? Let me know

Yeah it was my headphones. Sorry about that.

Good to hear that you got it figured out!