Processing millions and millions of records

Question:
Hello,
Has anyone processed records in an internal table that contains more than a couple of million records? I keep getting the error "No storage space available for extending table IT_46". I talked to the Basis group to get more space on our development system but I am getting anaswers like correct your program by breaking it up or ask OSS to help.
Would defiing the table in a different way be better in resolving this problem. I defined it to be LIKE the data base table occurs 0.
Help!!!
Thanks
Tess
Answer:
Hi Tess,
If you had searched the forum, you would have found a posting by R stating that you would be better off using FIELD-GROUPS in place of ITABs for your scenario.
It is possible to have millions of records in an ITAB if the ITAB is narrow. It is the total memory that matters, not just the number of lines. If you don't need all the columns of the reference table, define your own ITAB with fewer columns and you will be able to fit more records.
_________________
Sudhi Karkada
Answer:
Dear Tess:
Do you REALLY need all the records in memory? If you process a flat file, you may just process the records as they come rather than put them in an internal table first. It depends a bit on the task, but usually there are ways to minimize your memory needs.
Regards,
Wolfgang
Answer:
Maybe you need to think if the data can be archived, so that the amount of data appearing in your internal table will be much less....
_________________
codeboy

More Articles:

can we use field symbol inside sql statement as work area?
How to encrypt data in ABAP?
How to Save Values from table control to database table?
In which table changes made to SAP programs are stored?
Tables in ABAP Dictionary?
Leap year?