Hello,
In our lab we have multiple users who use CONN on a computing cluster. I was wondering if anyone knew of any strategies in reducing data usage when running many analyses? We are running into issues with users generating multiple TB worth of data. Although storage is relatively cheap now, we don't want to pay for more than we need. Is there anyway to purge intermediate files, or files not needed for certain analyses? Are there any particular space heavy options?
In our lab we have multiple users who use CONN on a computing cluster. I was wondering if anyone knew of any strategies in reducing data usage when running many analyses? We are running into issues with users generating multiple TB worth of data. Although storage is relatively cheap now, we don't want to pay for more than we need. Is there anyway to purge intermediate files, or files not needed for certain analyses? Are there any particular space heavy options?