I am happy to announce that my book, Python Natural Language Processing Cookbook, is now available in print and as a Kindle book. In this blog post I will tell you more about the book so that you can better understand whether the book is for you. The first important thing about the book is …
Python Natural Language Processing Cookbook book announcement Read More »
In August I did a data quality project with LaborEdge, automating part of their data standardization process using Natural Language Processing (NLP) techniques. Data standardization is part of a larger host of tasks ensuring data quality. In this post I am going to tell you about the project, data quality and how NLP can help …
Ensuring data quality for LaborEdge: a case study Read More »
Almost all businesses deal with texts: invoices, proposals, research papers, reports, resumes, job descriptions, emails, news, and other documents. Some of these text documents require processing, such as sorting, extracting and entering information into a database, evaluating for sentiment, and so on. According to Forbes Magazine, 84% of businesses still rely on some sort of …
I’m often asked, what is it that you do? When I mention the word NLP, frequently the next question is what is that? So here is a blog post that has both the short and the long versions of my answer. Here is the short answer. NLP stands for Natural Language Processing. The “Natural” in …
Social media posts and reviews from review sites like Yelp are an important and powerful marketing and feedback tool for businesses. They are readily available on the Internet and provide customers’ opinions on different aspects of restaurants, car mechanics, cinemas, IT consulting firms, mobile apps, Internet hosting companies and every other kind of business out …
What are chatbots? So what are chatbots all about? They are a general category of programs that interact with people via messaging or speech. Speech bots are Alexa, Siri, etc. In this post I will talk about messaging chatbots. Messaging chatbots use your favorite messaging platform: Facebook, WhatsApp, Slack, Telegram, Kik, etc. The program interacts …
If you have lots of HTML files that you collected for a project, chances are you can’t really use those files as is. Usually, you are looking to extract some information from these files, for example, an article (like in my project), a product description, or user reviews. Depending on the data you want to …
LTE: Extracting relevant text and features from HTML Read More »
After I labeled all the data by topic, I took a quick look at the topic tallies, both overall and by newspaper, keeping in mind the newspapers’ locations. The overall percentages are shown in the graph below: Some of these stats were expected, others surprising. I expected most of the letters to be about politics …
For the project of automatically assigning topics to the letters to the editor, I needed labeled data. Sometimes blog posts, or articles in a newspaper will have assigned labels (for example, this post is tagged with “machine learning” and “natural language processing”). However, none of the newspapers I got my data from did that. Thus, …
In this post, I detail how I collected the data for the letters to the editor corpus analysis project. First, I picked several web-sites where I could access letters to the editor archives: Chicago Tribune from Illinois The Citizen from Georgia Daily Herald from Illinois Dubois County Free Press from Indiana Ellsworth American from Maine …