Import Data and Analyze with Python 

+Rich Mash thanks for the feedback!

Which one, please?

+Turki Aljrees Turki, thanks for the positive feedback. More videos on Python are posted to the online course apmonitor.com/che263 - I hope you enjoy those as well.

+APMonitor.com thank you my friend

More content is available on the free course website at apmonitor.com/che263

You can create a script by selecting "File...New File" in IDLE or else create a new text file and rename the extension to .py Here is info on changing file extensions: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-YlN9ax7yC0A.html I'll keep your comment in mind for future videos. Thanks for that helpful suggestion.

Try reading the file with pandas and then use dropna to eliminate or fillna to replace NaN. Here is some help: apmonitor.com/pds/index.php/Main/GatherData and apmonitor.com/pds/index.php/Main/CleanseData

Yes, thanks for creating new content!

+Abdullah ALSHEHRI You're welcome - I'm glad that you enjoyed it. Check out other videos and course material at apmonitor.com/che263

Here it is: apmonitor.com/che263/index.php/Main/PythonDataAnalysis

+Yulia Kim Thanks for your feedback. There are other Python videos on the Engineering Programming Course at apmonitor.com/che263

+kisore hari Yes, just designate a delimiter character like I did at 1:38. Most text files use a space, tab, or comma.

+APMonitor.com You may also want to switch to pandas if you have mixed data such as floats and strings. See ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-FXhED53VZ50.html

+Andreas Victor Simanungkalit, the source code and data file is available from apmonitor.com/che263/index.php/Main/PythonDataAnalysis

Leave out the extra 'e' in the function call: docs.scipy.org/doc/numpy-1.13.0/reference/generated/numpy.genfromtxt.html

I used Python 2.7 for this example although it can also be run with Python 3+ if you just add parenthesis around the print statement at 3:28. The txt file needs to be in your working directory (same as myScript.py) for this example. It is possible to navigate to different directories but this example requires the data (txt) file in the same directory. There is another example using Pandas along with source code posted here: apmonitor.com/che263/index.php/Main/PythonDataAnalysis

+pooja mahindrakar, here are some tips to get started: stackoverflow.com/questions/3735553/how-do-i-read-an-image-file-using-python

Simon Chemnitz-Thomsen, yes - it is just for convenience. t[0] is very large so I just time shift everything to start at t[0]=0.

Thanks alot great video

I'd recommend changing the style to circles 'o' or points '.' - here are tutorials on plotting: apmonitor.com/che263/index.php/Main/PythonPlots

Data science is a lot more than just this video but it is a good start. Check out apmonitor.com/che263

APMonitor.com thanks I’ll check it out!

+Abdel Latif Abdel, I don't think I have the original data file. However, the following should work if you copy it into a text file such as data_file.txt: 1.000E+01,4.053E+02,3.926E+02,3.930E+02,4.026E+02,nan,nan,nan,nan 1.050E+01,3.904E+02,3.997E+02,4.084E+02,4.100E+02,nan,nan,nan,nan 1.100E+01,4.091E+02,3.934E+02,3.923E+02,4.035E+02,nan,nan,nan,nan 1.150E+01,4.015E+02,4.011E+02,4.044E+02,4.059E+02,nan,nan,nan,nan 1.200E+01,3.904E+02,3.925E+02,4.025E+02,3.948E+02,nan,nan,nan,nan 1.250E+01,4.095E+02,4.040E+02,3.960E+02,4.051E+02,nan,nan,nan,nan 1.300E+01,4.018E+02,3.916E+02,3.939E+02,3.979E+02,nan,nan,nan,nan 1.350E+01,3.931E+02,3.984E+02,3.950E+02,3.939E+02,nan,nan,nan,nan 1.400E+01,4.066E+02,3.927E+02,4.000E+02,3.992E+02,nan,nan,nan,nan 1.450E+01,3.953E+02,4.076E+02,4.098E+02,3.966E+02,nan,nan,nan,nan 1.500E+01,4.095E+02,3.976E+02,3.901E+02,4.018E+02,nan,nan,nan,nan 1.550E+01,3.948E+02,4.036E+02,3.997E+02,4.015E+02,nan,nan,nan,nan 1.600E+01,4.018E+02,3.983E+02,4.056E+02,4.047E+02,nan,nan,nan,nan 1.650E+01,4.000E+02,3.923E+02,3.952E+02,4.055E+02,nan,nan,nan,nan 1.700E+01,3.928E+02,3.907E+02,3.960E+02,3.909E+02,nan,nan,nan,nan 1.750E+01,3.921E+02,3.978E+02,4.060E+02,3.996E+02,nan,nan,nan,nan 1.800E+01,4.070E+02,4.056E+02,3.955E+02,4.068E+02,nan,nan,nan,nan 1.850E+01,4.010E+02,3.913E+02,4.019E+02,3.944E+02,nan,nan,nan,nan 1.900E+01,4.085E+02,3.949E+02,4.031E+02,4.090E+02,nan,nan,nan,nan 1.950E+01,3.968E+02,4.018E+02,3.975E+02,3.963E+02,nan,nan,nan,nan 2.000E+01,4.037E+02,4.037E+02,4.036E+02,3.907E+02,nan,nan,nan,nan

+New Rider NT, you need to show Windows file extensions. Navigate to "Folder Options"..."View" and unselect the option to hide extensions for known file types. This will allow you to view and change file extensions.

APMonitor.com Thanks it worked and thanks for the great video.

If you need help with starting a programming language such as python, there are many wonderful tutorials online such as code.org. labview is a nice environment for data acquisition but I don't recommend it as a programming language. There are fewer courses that treat numerical python. If you are interested in learning more about python I recommend that you go through the homework on my course. apmonitor.com/che263/index.php/Main/CourseHomework

Here is a Python program: e2e.ti.com/support/sensors/f/1023/t/762364?AWR1642-Python-program-to-read-and-plot-data-from-XWR1642-and-XWR1443

i have no hardware to run the program i just want a program which read a data frame from an iwr1642 radar because i have no raspberry and radar github.com/ibaiGorordo/AWR1642-Read-Data-Python-MMWAVE-SDK-2/blob/8a38aa4325b46955703f501bce3f03a56590a737/People%20counting%20demo/peopleCountingDemo.py

I just have an example dataframe and want to read in python and convert to binaries

@@souheibbounouara3679 you could run it on Google Colab if you don't have a place to run it.

@@apm it works with google colab even if there is no hardware (raspberry and iwr1642)

Python should work the same on all platforms including Windows, MacOS, or Linux. I recommend that you try it and mention anything that is different in the comments.

+Mingguang Tuo, you can store the data in separate rows. The savetxt function will automatically put it on the next line.

Thanks for your kind reply. For your case here, you are using variable time_col which actually represents a column. I am still confused a little bit how you can process in separate rows. Thanks again.

+Muggins, you may want to open the file, read one line at a time, count the number of delimiters (comma or tab are common), and then do a try...except on converting the elements to numbers or leaving as strings. There are lots of examples on stack exchange.

vaibhav bhagat Numpy is only 32-bit and requires that you install the 32-bit version of Python. Even though you are running a 64-bit processor, you can still run the 32-bit applications. I recommend uninstalling Python and starting with the 32-bit versions. Also, you'll need Python 2.7. I don't think Numpy works with Python 3.4 yet. For Windows, this is a collection of files that you can download that will work with this example: apmonitor.com/che263/index.php/Main/PythonIntroduction

There are a few examples here: apmonitor.com/che263/index.php/Main/PythonDataAnalysis

Camtasia Relay on a Surface Pro Tablet.

thanks :)

Here are instructions on installing numpy: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-FKwicZF7xNE.htmlm16s if you are on Windows. If you are on Linux or MacOS, try "pip install numpy" on a command line.

+APMonitor.com awesome, nailed it! thank you Sir! :)

WINDOWS: python -m pip install module_name (I don't even know what -m means...)

Thanks for the command line example. When Python is called with -m, the given module (pip) is located on the Python module path and executed as a script.

See this video for changing windows file extensions: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-YlN9ax7yC0A.html You may have a file name such as myScript.py.txt and you just need to remove the .txt after you show the file extensions.

+MImran Khan, notepad++ is freely available from notepad-plus-plus.org/ You can download this particular data set from apmonitor.com/che263/index.php/Main/PythonDataAnalysis

George Willcox use this on command prompt pip install numpy

Thanks, Javed! Here is some additional help on installing Numpy for George: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE--llHYUMH9Dg.html

Sure, it is no problem to ask a question.