Bcp Fatal Error Memory Allocation Failed
Contents |
links to the respective forums on SCN, or you can go fatal error js allocation failed process out of memory to SCN and search for your product in the fatal error call_and_retry_2 allocation failed process out of memory search box (upper right corner) to find your specific developer center. Forums Archive > ASE
Fatal Error Call_and_retry_last Allocation Failed Process Out Of Memory
> General Discussion > "BCP memory allocation failed???" BCP memory allocation failed??? 7 posts in General Discussion . Last posting was on 2003-01-16 20:49:58.0Z
Fatal Error Call_and_retry_0 Allocation Failed Process Out Of Memory
Armitage Shanks Posted on 2003-01-14 16:38:04.0Z Date: Tue, 14 Jan 2003 16:38:04 +0000From: Armitage Shanks ESD #4 andOpen-Client version ( using bcp -v ) : Sybase CTBCP Utility/12.5/P-EBF11490ESD #14/DRV.12.5.0.6/RS6000/AIX 4.3.3/BUILD125-032/OPT/Tue Oct 7 23:00:442003.When Use the bcp utility to load a data in tables,BCP return with error "Fatal Error: Memory Allocation Failed" and must usethe -b parameters with a litle number associated (i.e -b10). I believe thatinstalling the last EBF for SDK this problem will be dissapear but stillhere.The platform is IBM AIX 5.1 32-bit!¿Any Recommendation or suggest? any will be welcomeThanks In AdvancePID SybaseNeal 2004-04-22 16:14:55 UTC PermalinkRaw Message Hello,There is a special note in EBF#14:BCP and memory allocation-------------------------As a result of a fix to several issues related to memory allocationand bcp http://nntp-archive.sybase.com/nntp-archive/action/article/%3C3E246E0F.D5CA6ABA@davidsohn.com%3E (including CR 313067), you may see a change with bcp undercertain conditions.When trying to bcp into a table that has many columns (> 100), bcpmight allocate substantial amounts of memory ( > 200 MB ). If youexperience the conditions described above, it is recommended thatyou use smaller batch sizes (< 40) to avoid potential out-of-memoryerrors.So if your table has enough columns, it could cause bcp to requireupwards of 200MB http://sybase.public.connectivity.open-client.narkive.com/pLr0itAm/problem-with-bcp-and-b-option-open-client-12-5 of memory. You should be able to adjust your "ulimit"parameters so that the operating system gives bcp the memory it requires.I ran many tests with my ulimit set to unlimited so I could see howmuch memory bcp required at different batch sizes (10, 100, 1000, 10000).If I recall, it never required much more than 200MB for my table withthe most columns (I don't remember how many columns or what datatypesthey were).The datatypes of your columns could affect memory usage for bcp as well.If your table has text/image columns that contain more than 32K you haveto use the -T parameter with bcp to specify a larger default size. The-T parameter can increase bcp's memory usage.If you take all of this into account and test with your ulimit memoryparameters set to unlimited and see that bcp is using a lot more than200 MB, you should log a case with Sybase tehcnical support.Thanks,NealPost by Pablo Ibarra DupratHi Sybase TeamI have a Sybase 12.5.0.3 EBF 11443 - ESD #4 andOpen-Client version ( using bcp -v ) : Sybase CTBCP Utility/12.5/P-EBF11490ESD #14/DRV.12.5.0.6/RS6000/AIX 4.3.3/BUILD125-032/OPT/Tue Oct 7 23:00:442003.When Use the bcp utility to load a data in tables,BCP return with error "Fatal Error: Memory Allocation Failed" and must usethe -b parameters with a litl multiple BCP process. In this scenario, we have observed the following error: " Start loading, table="FOO", file="./FOO_1.dmp": Fatal error: http://dbaspot.com/sybase/130056-parallel-bcp-failure.html memory allocation failed. End loading. " Now, when we run bcp manually, the problem does not appear. Can anyone explain why we would be getting this problem? I understand that http://sybase.bcp.fatal.error.memory.allocation.failed.winwizards.org/ there was a problem with bcp on 12.5.1 and the patc has been applied. Any help would be most appreciated. thanks Pipon - piponist ----------------------------------------------------------------------- Posted via http://www.webservertalk.co ----------------------------------------------------------------------- View this fatal error thread: http://www.webservertalk.com/message328992.htm Re: parallel bcp failure Hi There, I recently encountered this problem (it was intermittent) ... it seems to be a known BUG ... you do not mention the version of SYBASE nor platform but here is the write-up ... look up the below BUG number and see if you can upgrade your Open Client ... I upgraded to SDK allocation failed process 12.5/P-EBF11488 ESD #14 on Solaris and the problem disappeared ... Hope this helps!! Sara ... Case Description: Receiving the error message "Fatal error: memory allocation failed" when running the 'bcp in' utility with the batch size of 10000. Tip or Workaround: Workarounds: 1) Use a smaller batch size. In other words, use -b1000 or -b100 instead of -b10000. 2) Remove any restrictions for memory allocation. In other words, "ulimit -v unlimited" or "limit memorysize unlimited". 3) Revert to a version of bcp that does not have this problem. Resolution: This problem relates to Sybase bugs CR 261087 and CR 299879. CR 261087 reads, "BCP: eliminates memory allocation errors for large batch sizes (when doing BCP IN)". This bug was fixed in Open Client/ bcp 12.5 ESD#3, but that solution only partially fixed the problem in bcp 12.5. That fix existed in version 12.5 ESD#3 - ESD#7 of Open Client/ bcp. It was removed in ESD#8 and ESD#9, and a new CR 299879 was issued. CR 299879 reads: "bcp allocates huge chunks of memory when large batch size specified w/ -b flag".