Skip to main content

Writing huge string data to file in java, optimization options



I have a chat like desktop java swing app, where i keep getting String type data. Eventually the String variable keeps growing larger and larger.





1) Is it wise idea to keep the large variable in memory and only when the logging is finished save this to disk.





2) If not, then should i continue saving everytime i get a new string (of length about 30-40).





How should i go about optimizing such a desgin?


Comments

  1. I would use a BufferedWriter, like PrintWriter. This will buffer the data for you and write every 8 KB (actually every 8192 characters). If you want to write more often you can use flush() or a smaller buffer.

    PrintWriter pw = new PrintWriter("my.log");

    // will actually write to the OS, 5 times. (1000 * 40 / 8192)
    for(int i = 0; i < 1000; i++) {
    pw.printf("%39d%n", i); // a 40 character number.
    }

    pw.flush();


    or you can use

    pw.println(lineOfText);




    BTW: If you want to know what a really huge file looks like ;) This example writes an 8 TB file http://vanillajava.blogspot.com/2011/12/using-memory-mapped-file-for-huge.html

    ReplyDelete
  2. Perhaps you should use a StringBuilder. Append each new message to it, and at the end convert it to a string.

    For example,

    StringBuilder sb = new StringBuilder();
    // Do your code that continuously adds new messages/strings.
    sb.append(new_string);
    // Then once you are done...
    String result = sb.toString();


    If you were to have some string, say String message, and every time you got a new message/string you did message += new_string, it will eat up more memory.

    As suggested by Viruzzo, only save so much, then discard the earlier strings at some point. Don't hold on to every message forever.

    ReplyDelete

Post a Comment

Popular posts from this blog

Slow Android emulator

I have a 2.67 GHz Celeron processor, 1.21 GB of RAM on a x86 Windows XP Professional machine. My understanding is that the Android emulator should start fairly quickly on such a machine, but for me it does not. I have followed all instructions in setting up the IDE, SDKs, JDKs and such and have had some success in staring the emulator quickly but is very particulary. How can I, if possible, fix this problem?

CCNA 1 Final Exam 2011 latest (hot hot hot)

  Hi! I have been posted content of ccna1 final exam (latest and only question.) I will post the answer and insert image on sunday. If you care, please subscribe your email an become a first person have full test content. Subcribe now  Some question  have not content because this question have images content. So that can you wait for me? SUNDAY 1. A user sees the command prompt: Router(config-if)# . What task can be performed at this mode? Reload the device. Perform basic tests. Configure individual interfaces. Configure individual terminal lines. 2. Refer to the exhibit. Host A attempts to establish a TCP/IP session with host C. During this attempt, a frame was captured with the source MAC address 0050.7320.D632 and the destination MAC address 0030.8517.44C4. The packet inside the captured frame has an IP source address 192.168.7.5, and the destination IP address is 192.168.219.24. At which point in the network was this packet captured? leaving host A leaving ATL leaving...