Skip to main content

Writing huge string data to file in java, optimization options



I have a chat like desktop java swing app, where i keep getting String type data. Eventually the String variable keeps growing larger and larger.





1) Is it wise idea to keep the large variable in memory and only when the logging is finished save this to disk.





2) If not, then should i continue saving everytime i get a new string (of length about 30-40).





How should i go about optimizing such a desgin?


Comments

  1. I would use a BufferedWriter, like PrintWriter. This will buffer the data for you and write every 8 KB (actually every 8192 characters). If you want to write more often you can use flush() or a smaller buffer.

    PrintWriter pw = new PrintWriter("my.log");

    // will actually write to the OS, 5 times. (1000 * 40 / 8192)
    for(int i = 0; i < 1000; i++) {
    pw.printf("%39d%n", i); // a 40 character number.
    }

    pw.flush();


    or you can use

    pw.println(lineOfText);




    BTW: If you want to know what a really huge file looks like ;) This example writes an 8 TB file http://vanillajava.blogspot.com/2011/12/using-memory-mapped-file-for-huge.html

    ReplyDelete
  2. Perhaps you should use a StringBuilder. Append each new message to it, and at the end convert it to a string.

    For example,

    StringBuilder sb = new StringBuilder();
    // Do your code that continuously adds new messages/strings.
    sb.append(new_string);
    // Then once you are done...
    String result = sb.toString();


    If you were to have some string, say String message, and every time you got a new message/string you did message += new_string, it will eat up more memory.

    As suggested by Viruzzo, only save so much, then discard the earlier strings at some point. Don't hold on to every message forever.

    ReplyDelete

Post a Comment

Popular posts from this blog

[韓日関係] 首相含む大幅な内閣改造の可能性…早ければ来月10日ごろ=韓国

div not scrolling properly with slimScroll plugin

I am using the slimScroll plugin for jQuery by Piotr Rochala Which is a great plugin for nice scrollbars on most browsers but I am stuck because I am using it for a chat box and whenever the user appends new text to the boxit does scroll using the .scrollTop() method however the plugin's scrollbar doesnt scroll with it and when the user wants to look though the chat history it will start scrolling from near the top. I have made a quick demo of my situation http://jsfiddle.net/DY9CT/2/ Does anyone know how to solve this problem?

Why does this javascript based printing cause Safari to refresh the page?

The page I am working on has a javascript function executed to print parts of the page. For some reason, printing in Safari, causes the window to somehow update. I say somehow, because it does not really refresh as in reload the page, but rather it starts the "rendering" of the page from start, i.e. scroll to top, flash animations start from 0, and so forth. The effect is reproduced by this fiddle: http://jsfiddle.net/fYmnB/ Clicking the print button and finishing or cancelling a print in Safari causes the screen to "go white" for a sec, which in my real website manifests itself as something "like" a reload. While running print button with, let's say, Firefox, just opens and closes the print dialogue without affecting the fiddle page in any way. Is there something with my way of calling the browsers print method that causes this, or how can it be explained - and preferably, avoided? P.S.: On my real site the same occurs with Chrome. In the ex