STEP BY STEP LEARNING

    I shifted my work environment from my local machine to a cloud platform called Databricks a few days ago. Databricks is a cloud platform for cluster computing using Spark. For the moment, my main task revolves around SQL queries as we work with various tables to create one full metadata. This part of the internship is what I find the most exciting as we are working on a big data platform. With my intent to pursue a career in data science, and experience with big data is very valuable, especially with SQL and Spark. The cloud platform also makes it easier to work in a team and makes my work more interactive, allowing my supervisors to inspect it.

    What I have realized about my job so far is that almost all the skills that I apply to my work are from my personal experience, not from any class I have taken in college. It may be because I just finished freshman year and have only taken two computer science classes so far. Due to the intensity of the work, I cannot rely only on my skills as I often encounter new things that do not know. Due to this, I had to get used to learning habits where I try to learn a new feature in the fastest way possible. When I am given a new task and I am not familiar with the process, I spend around no more than two hours learning the process specific to my task. The knowledge I gain is limited but it allows me to complete my task. I know that at the end of the day, all the small knowledge combined will build into a big one. A big example of this is SQL query, I started with basically no knowledge of it, but I am confident that by the end of my internship, my combined small knowledge will allow me to know the language as a whole.

Comments

Post a Comment

Popular posts from this blog

FINAL TASK

       Today, I started what probably is my last work with Project Gutenberg. I am working on a named entity recognition. This is my second time applying timed entity recognition to this data. During my previous task, I used SpaCy to do the NER, but this time I am using JohnSnowLabs. JohnSnowLabs is a website with a collection of pre-trained machine learning pipelines. This time I am using the BERT pipeline to accomplish my task. The final result of my work will be a topic modeling and a named entity recognition which my supervisor will then analyze.      I think it is the right time to reflect on some of the things I accomplished during these nine weeks of work. I have learned a lot from this experience, whether it is a way to complete work, a learning habit, or an ability to multitask, I have gained new skills, knowledge, and work experience. I believed that these gains will allow me to perform well in my future internship.
Read more

FINAL POINT

       I recently completed my internship at Vanderbilt University, where I worked with an English professor and a librarian for a text-mining project. The goal of the project is to help the English professor in his research about how Law is represented in general dialogue during the Romanticism period (a period of literature between 1750 and 1850). So, the data collected were English books published in the United Kingdom and Ireland between 1770 and 1835. The main source of data was Project Gutenberg, an online library of free eBooks.       We faced a load of challenges while working on this project. One of the biggest issues was figuring out the correct book to collect. While project Gutenberg provides some information such as authors and editions of the book, it does not provide the year of publication, so there was no way for us to know what the right book is. We have attempted to solve the problem by collecting all the books in English and fr...
Read more