Processamento de Dados Massivos/Projeto e implementação de aplicações Big Data/Processamento de streams de tweets: diferenças entre revisões

[edição não verificada][edição não verificada]
Conteúdo apagado Conteúdo adicionado
Linha 158:
<syntaxhighlight lang="java">void declareOutputFields(OutputFieldsDeclarer declarer) </syntaxhighlight>
Declare the Output Filed on the outgoing tuple.
 
==== Topology Builder ====
 
 
====Communication====
Linha 181 ⟶ 184:
Considering the requirements of this project which focus scalability and fault tolerance over latency. I evaluated the Storm capabilities of distributing process and making a massive stream scalable to be processed. The main results of this project is to build the foundation to many bolts and spouts designed specially to the Web Observatory project. It also helps the software development processes because each bolt is a black box that may be implemented by many different people in different languages.
 
===Load on Bolts===
For simple Twitter jobs, Storm managed to distribute jobs in a fair way. None worker node recived more jobs than another. This is a good result that shows that our system scales well enough for a huge twitter load.
[[File:BoltLoad.png|centro|Load on Bolts]]
 
 
===Load on Bolts===
For simple Twitter jobs, Storm managed to distribute jobs quite good
===Nimbus Logs===