A BUSY WEEK

     This week was one of the busiest weeks in my internship so far. I had to finalize my script really fast so that I could present it to my supervisor. When I finally presented my work, we had to consult a librarian to verify its accuracy. I am happy that the librarian approved my work as the only best way to gather the data from the Library of Congress. However, when we discussed the next step with my supervisors, we happened to find out an even better step to gather the most accurate data. This time it does not involve collecting data from a third-party website or scraping any website. Instead, my supervisors have a list of authors along with all their information, including their era. The era we are looking for is the Romantic era which goes from 1780 to 1838. So, this time, what we will do is work with the authors, and collect those who match the era we are interested in. When we get all the authors, we match them with our project Gutenberg metadata and only collect the work of art of those authors. This way we do not need the date of publication as we already know the era during which these authors worked.

    While this week was stressful in terms of the amount of work I had to complete, it was also a very resourceful week as I got to learn so many things. I worked with python, the language that I know best, I combined Python with a query language called CQL, and I got more insight into how librarians work with old works of art through that meeting with the librarian, and now I am working with SQL query. I know that the knowledge that I acquired will be valuable for me in the future. About SQL in particular, I was nervous about it before the start of the internship because I tried to get into a database class last semester but I could not. So, I had to learn the language on my own so that I can use it. I am still in the beginning phase when it comes to SQL queries, but the more I work with the language, the more I learn, and I am happy because that is the way I have always learned new things.

Comments

Post a Comment

Popular posts from this blog

FINAL TASK

       Today, I started what probably is my last work with Project Gutenberg. I am working on a named entity recognition. This is my second time applying timed entity recognition to this data. During my previous task, I used SpaCy to do the NER, but this time I am using JohnSnowLabs. JohnSnowLabs is a website with a collection of pre-trained machine learning pipelines. This time I am using the BERT pipeline to accomplish my task. The final result of my work will be a topic modeling and a named entity recognition which my supervisor will then analyze.      I think it is the right time to reflect on some of the things I accomplished during these nine weeks of work. I have learned a lot from this experience, whether it is a way to complete work, a learning habit, or an ability to multitask, I have gained new skills, knowledge, and work experience. I believed that these gains will allow me to perform well in my future internship.
Read more

FINAL POINT

       I recently completed my internship at Vanderbilt University, where I worked with an English professor and a librarian for a text-mining project. The goal of the project is to help the English professor in his research about how Law is represented in general dialogue during the Romanticism period (a period of literature between 1750 and 1850). So, the data collected were English books published in the United Kingdom and Ireland between 1770 and 1835. The main source of data was Project Gutenberg, an online library of free eBooks.       We faced a load of challenges while working on this project. One of the biggest issues was figuring out the correct book to collect. While project Gutenberg provides some information such as authors and editions of the book, it does not provide the year of publication, so there was no way for us to know what the right book is. We have attempted to solve the problem by collecting all the books in English and fr...
Read more