Raspberry Pi 2/3 and Odroid XU4 5x compact cluster

Although you can find on web lot of good guides for Big Data installation on Raspberry Pi, for Odroid XU4 was little different. I honestly can recommend one very good web-guide for Odroid XU4 Big Data implementation. In link below you can find more on how to install Hadoop (including Apache Spark) on (our) Odroid XU4 Cluster, same procedure can be in great extent reproduced on Raspberry Pi thought :)

Installing Hadoop onto an ODROID XU4 Cluster

This new Small nodes Big data for Sensor/IoT system pre-processing concept can look like this:

And best part for the last, if you look on the last image regarding project you will find one bread/protoboard that is connected to ChipKIT MCU dev.board and then via USB to SoC.

What you can not see is that it is fast -flash 8bit parallel ADC based on 1-1,5MSPS AD7821 IC.

It is interesting to point out that this ADC was stable at 1.5MSPS and that on that speed 8-bit Atmega 328's (Arduino Uno/Nano) was to slow to read and merge 2 binary ports. Arduino Due with Atmel SAM3 end up slower then ChipKIT's PIC32mx250 MCU on the task. But winner was by no surprise Raspberry Pi3 that without much problem blink and read any GPIO port faster than ~55MHz.

We all knows that Small nodes based on SoC computers can bring excellent power efficiency and low cost to BigData system solution domain, bit it (still) luck much needed high computing performances that rack-mount PC based servers provide.

What I research recently was how to help BigData databases to obtains > 1MSPS reading from analog (industrial) sensor sources in real time. Making of log-files from ADC reading can not be considered as "real-time" solution.

Any way think that we need to make >1M database transactions (1 row insert) that will record all conditions that follow particular ADC value, and you will find out that even bigger among Big Data systems will "hiccup" on this demand.

Why is this important to save ADC values as unique values and not as log them and use after you will ask, and all I can say is because in a next few years M2M communication among +20 Billion Sensor/IoT systems and SoC/MCUs will demand processing in real time exponentially greater amount of information compared with today's volume which is generated by human social networks and web.

In concept that I proposed in my academic research Small nodes SoC systems and clusters will be first line of data acquisition and pre-processing. In that way BigData system will have by order of magnitude less demanding tasks to perform regarding pre-processing with much lower network load and power consumption.

In next illustrator I will sheer with you my vision of concept that need to enable reading (ADC) of fast sensor systems and real time pre-processing that will be sent to Small Nodes Big Data system.

(With a big apologies in advance because my original illustration of the Serbo-Croatian

language and for details you will be needing translator.)

Any way you can easily recognize main block Sensors (Physical to Analog electrical values), block with ADC and MCU development board systems ( from Atmel, Microchip, ST), block with SoC computers that use GPIO ports, USART (SIP, I2C...) and USB communication to get ADC values and pack them to a form with all other needed ingredients that can be sent via ETHERNET LAN (asynchronous packet communication) to Small nodes Big Data system on pre-processing or even to Big Data system in some far data center on regular processing.

After we all make those boxes and fill them with 4,5, or even 7 SoC logical next step is to put them in to good use, right?

I developed idea to push BigData systems to Small nodes systems, but not in ordinary (big system "emulation" on SoC) way but as completely different approach.

I want change recognizable project name for now but it will evolve eventually to Autonomous Small nodes BigData solution.

Stay tuned :)

What is a common opinion about putting Fan with LED-light, or not?

I conceive design as retro radio box, and I think that with LED it will be more like Christmas tree, but what you think about it?

I would like to avoid my PC light style :)