Category: Data Extraction

I had a thought of embedding metadata into images after a building survey. This would capture the surveyors comments on the survey and store them in the the actual image files. So the next time the photo is inspected in the office the information on that image is easily inspected. Rather than looking for 2

A regular expression, regex or regexp A regular expression, regex or regexp is, in theoretical computer science and formal language theory, a sequence of characters that define a search pattern. Usually this pattern is then used by string searching algorithms for “find” or “find and replace” operations on strings, or for input validation. From Wikipedia.

A few words of jargon in the Text Mining area. Corpus. In linguistics, a corpus or text corpus is a large and structured set of texts. They are used to do statistical analysis and hypothesis testing, checking occurrences or validating linguistic rules within a specific language territory. Token. Tokenization is the process of demarcating and

After writing the initial post which I wrote whilst setting up and populating the database I had a further play, using the Mobile App, or rather, I didn’t get very far at all. The company who set up the free Asset Management Site make Bar Code tags, so the accessing of data would be by

The AlternativeTo website popped up Asset Tiger as a free asset management tool when I typed in Alternatives to OpenMAINT. It is a cloud based tool and has a mobile app so that you can use it on your smartphone or tablet which is good too, as its free (the OpenMAINT one isn’t). Asset Tiger

I was looking through 101-useful-websites article and came across AlternativeTo.net and used it to look up alternatives to say “Revit” and “AutoCad” and other tools I use. I then typed in KNIME which I use for data mining, data analysis and it came up with Orange as a free alternative.  So I looked at some

After writing the previous post on web scraping and the example given of using Google Spreadsheet to obtain a web table I started wondering about Excel. I was aware that it had a web connection so decided to explore those. This first video shows how to automate the data scraping  from websites into Excel: Then

I have been looking at some of the free Data Science and Cognitive Computing Courses and was following the Data Journalism: First Steps, Skills and Tools course. The Google Searching video was on improving your searches in Google using the following: quotes to get specific key words eg “data science on construction” using – sign

OpenRefine (formerly Google Refine) is a powerful tool for working with messy data: cleaning it; transforming it from one format into another; and extending it with web services and external data. You can download it from here. In the Cognitive Class tutorial on OpenRefine it talks about 60-85% of time of data scientists spending on

There is an interactive tutorial here running Python. This instance is running from another website so could be slow. I found this video extremely good for setting up (I used the pip install method not anaconda) and how to use it. The Jupyter Notebook The Jupyter Notebook is an open-source web application that allows you