High speed streaming / workarounds for the streaming limit

Comments

• bestname

  May 2016 edited May 2016

  So I wrote some code, and I can see that the return value of getLogCapacity is 12160. If I record three accel values (x,y,z) does this mean that I can store the last (approximately) 12160/3/1600=2.5s of entries at max sampling? Or am I being naive?

  
  

  It seems like what I could do is set up the logger to record with overwriting enabled:

  logModule.startLogging(true);

  and then ~ 1s after the characteristic movement is detected call stopLogging followed by logModule.downloadLog . This is perfect.

  
  

  The only problem is that it seems that the accel can be set up either as a logger or a streamer but not both. Is this correct?
• bestname

  May 2016 edited May 2016

  Maybe I can use splitting and branching? I will try something like the following:

  
  

  bmi160AccModule.routeData().fromAxes()

      .split()

      .branch().log(LOG_KEY)

      .branch().stream(STREAM_KEY)

      .end().commit().onComplete(new CompletionHandler<RouteManager>() {

      @Override

      public void success(RouteManager result) {

  result.setLogMessageHandler(LOG_KEY, loggingHandler );

  result.subscribe( streamingHandler );

      }

  });

  
  

  
  
• bestname

  May 2016 edited May 2016

  On a blog I see it written:

  It’s important to note that you cannot stream and log on the same route. Also, simultaneously streaming and logging data is not a recommended use case.

  However I was able to implement it and it is both streaming and logging using my code in the above post. What issues should I anticipate?

  
  

  Now is downloading the entire log (I think), is there some way I can only download the last N recorded entries?
• Eric

  May 2016

  There is nothing wrong with logging and streaming simultaneously; that blog post is wrong. However, the second statement is correct, streaming and logging the same data is not a recommended use case.
  
  You don't need a splitter to log and steam. The splitter is for data processors, as searched in the documentation:
  https://mbientlab.com/androiddocs/latest/routing_sensor_data.html#splitter
  
  What you can do is set the odr to your desired rate and use a time filter to reduce the streaming rate.
• bestname

  May 2016 edited May 2016

  Thanks for pointing out the part about the splitter. Code works fine without it.

  
  

  When I read from the sensor it does not return the oldest element first. Compare the following (the top is the same movement as read in the log...it takes about two minutes to retrieve a full buffer)

  
  

  
  

  Notice in particular that in the top chart the motion seems almost cut off... unlike the bottom buffer where I only recorded for a few seconds. This is with a streamer and a logger enabled. The streamer reads off the 'rough' data, and when it recognizes a movement it will pull the precise readings from the log.

  
  

  If I use a filter on the log I won't be able to get streaming data to the device...I think it would be quite clever to use a filter but I don't see how it would be useful since the whole point is finding some way to workaround the streaming limit.

  
  

  Looking at the Time documentary page it looks like it is used to remove sampling frequency... 

  public Time(Time.OutputMode mode,
      int period)

  Constructs a config object for a time data processor

  Parameters:

  mode - Operation mode of the processor

  period - How often to alllow data through, in milliseconds

  I want max frequency but only for, say, the last one second of data. Everything else seems fine: I just want to be able to be able to pull a log in the proper order, ideally only the last N entries. Is there any way to do that?

  
  

  Thanks for the help so far.
• bestname

  May 2016 edited May 2016

  Here is my code for retrieving the log data:

      Logging loggingModule = mwBoard.getModule(Logging.class);

      final Bmi160Accelerometer bmi160AccModule = mwBoard.getModule(Bmi160Accelerometer.class);

      // first stop the accel:

      loggingModule.stopLogging();  

      bmi160AccModule.disableAxisSampling();

      bmi160AccModule.stop();

      loggingModule.downloadLog(0.05f, new Logging.DownloadHandler() {
  

      @Override

      public void onProgressUpdate(int nEntriesLeft, int totalEntries) {

  Log.i("LOG", String.format("Downloading Log: Progress= %d / %d", nEntriesLeft,

     totalEntries));

      }});

   
• bestname

  May 2016

  If I leave the log active for some long time there are all sorts of pathological findings...this one is clearly cut off. I let it sit recording on my desk for a minute or two and then moved it around a bit right at the end... there are only about twenty elements (at the very beginning) of the 800hz recording which are nonzero. Why did this happen?

  http://pastebin.com/J5Bzxnsj
  

  
  
• Eric

  May 2016

  Overwriting does not work if you are connected to the board; it looks like you are reading data from earlier runs.  You can clear the log by downloading it or issuing a clear command, then disconnecting.

  
  

  Log data is returned in chronological order so you will have to download the entire log to get your desired data.