Before you can work with data sets, it is important to first clean and preprocess the data using the scripting language/software of your choice. However, how do you know what needs to be cleaned? And further, how do you find…
Testing Data Cleaning Python Scripts in Linux
If you want to retain the input data file’s format: If you want to change the data file’s format (i.e.: comma delimited to tab delimited) First create a script which will go line by line and convert from comma delimited…
I’m Back After a Big Move :)
My husband and I have recently moved to a new area with a new job market, which I am sure will be more fruitful. 🙂 The plan is to complete the Udemy “The Data Science Course 2020: Complete Data Science…
Predict Bank Customer Churn – In Progress
Step 1: import csv into mysql Download data from kaggle: https://www.kaggle.com/barelydedicated/bank-customer-churn-modeling create database in MySQL Create table within database Import csv into table. Replace what is between < >. If you get the following error “The MySQL server is running…
Protected: Deep Learning
There is no excerpt because this is a protected post.
How to Extract Title and Text from Scraped Article
Say you have successfully extracted the full HTML of multiple articles using a web crawler and stored it in a database. You can easily extract the title and text from this article. In this tutorial, the data is being stored…
Extract Provided Keywords and Their Synonyms from News Articles
In Jupyter Notebook: Open Anaconda Prompt and conda activate your environment. Otherwise, create a new environment and activate it. Run jupyter notebook. Import statements: Connect to MongoDB database collection. Fill in any info between <>. In this example, the database…
Using Stanford OpenIE with Ubuntu on VirtualBox
Use Vagrant and VirtualBox to set up a local Ubuntu installation. Run the VirtualBox, steps here. In the command line, cd into /vagrant_data: Install Java 8: Download Stanford CoreNLP here and extract it. cd into the stanford-corenlp directory and run…
Running Jupyter Notebook in Ubuntu on VirtualBox
Get vagrant box running Make a directory to store vagrant files. I have called it UbuntuProject. cd into the new directory. Use the box with Vagrant (Code from https://app.vagrantup.com/ubuntu/boxes/trusty64 ) Open explorer from command line: create data directory in UbuntuProject…
How to Use Git Version Control
Clone a git repository Step 1: Open gitbash Step 2: Cd into or create desired directory. Then clone the repository: Step 3: If says Permission denied (public key), do the following. Otherwise skip to step 4. Generate a private/public ed25519…