dc.contributor.author |
Jomaa, Hadi Samer, |
dc.date.accessioned |
2017-08-30T14:29:11Z |
dc.date.available |
2017-08-30T14:29:11Z |
dc.date.issued |
2016 |
dc.date.submitted |
2016 |
dc.identifier.other |
b19028283 |
dc.identifier.uri |
http://hdl.handle.net/10938/11149 |
dc.description |
Thesis. M.E. American University of Beirut. Department of Electrical and Computer Engineering, 2016. ET:6516 |
dc.description |
Advisor : Dr. Mariette Awad, Associate Professor, Electrical and Computer Engineering ; Members of Committee : Dr. Louay Bazzi, Associate Professor, Electrical and Computer Engineering ; Dr. Daniel Asmar, Associate Professor, Mechanical Engineering ; Dr. Carlos Castillo, Director of Research for Data Science at Eurecat . |
dc.description |
Includes bibliographical references (leaves 96-107) |
dc.description.abstract |
When the public and first responders are flooding the internet with often annotated images and texts during natural disasters, rescue teams are overwhelmed to prioritize often scarce resources. Given that most of the efforts in such humanitarian situations rely heavily on human labor and input, we propose in this research a novel approach that leverages social media and uses machine learning and computer vision to help automate humanitarian intervention. After all, “an ANNOTATED image is worth a thousand words”. Our framework relies analyzing visually and semantically twitter data. We merge low-level visual features that extract color, shape and texture with semantic attributes extracted from annotated pictures posted on Twitter in disaster times. These visual and textual features are trained and tested on a home-grown dataset solely gathered from Twitter. The best accuracy obtained after crowdsource labeling the data was when low-level visual features and semantic attributes were applied to the different classification scenarios of support vector machines (SVM), Neural Networks and Ensemble Learning-SVM with 5-Fold cross-validation. Since the data is organically unsupervised, we proposed a structural neuronal modification to the cortical algorithms, a deep learning algorithm inspired by the human visual cortex and tested it using the previously proposed visual and semantic features. As expected, the proposed CA showed better performance than regular CA, which motivates follow on research. |
dc.format.extent |
1 online resource (xiv, 107 leaves) : color illustrations |
dc.language.iso |
eng |
dc.relation.ispartof |
Theses, Dissertations, and Projects |
dc.subject.classification |
ET:006516 |
dc.subject.lcsh |
Machine learning. |
dc.subject.lcsh |
Computer vision. |
dc.subject.lcsh |
Image processing. |
dc.subject.lcsh |
Natural language processing (Computer science) |
dc.subject.lcsh |
Support vector machines. |
dc.subject.lcsh |
Neural networks (Computer science) |
dc.title |
Humanitarian visual and semantic computing : crisis-related image tweets classification - |
dc.type |
Thesis |
dc.contributor.department |
Faculty of Engineering and Architecture. |
dc.contributor.department |
Department of Electrical and Computer Engineering, |
dc.contributor.institution |
American University of Beirut. |