[ADMIN] out of memory in backup and restore

Thomas Markus

nepřečteno,

15. 12. 2006 4:57:5115.12.06

komu:

Hi,

i'm running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb ram)
pg_dump creates an error when exporting a large table with blobs
(largest blob is 180mb)

error is:
pg_dump: ERROR: out of memory
DETAIL: Failed on request of size 1073741823.
pg_dump: SQL command to dump the contents of table "downloads" failed:
PQendcopy() failed.
pg_dump: Error message from server: ERROR: out of memory
DETAIL: Failed on request of size 1073741823.
pg_dump: The command was: COPY public.downloads ... TO stdout;

if i try pg_dump with -d dump runs with all types (c,t,p), but i cant
restore (out of memory error or corrupt tar header at ...)

how can i backup (and restore) such a db?

kr
Thomas

---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?

http://archives.postgresql.org

Shoaib Mir

nepřečteno,

15. 12. 2006 6:20:4715.12.06

komu:

------=_Part_117153_31269572.1166181556330
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Can you please show the dbserver logs and syslog at the same time when it
goes out of memory...

Also how much is available RAM you have and the SHMMAX set?

------------
Shoaib Mir
EnterpriseDB (www.enterprisedb.com)

------=_Part_117153_31269572.1166181556330
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Can you please show the dbserver logs and syslog at the same time when it goes out of memory... Also how much is available RAM you have and the SHMMAX set? ------------ Shoaib Mir EnterpriseDB (<a href="http://www.enterprisedb.com">
www.enterprisedb.com</a>) <div>On 12/15/06, Thomas Markus <<a href="mailto:t.ma...@proventis.net">t.ma...@proventis.net</a>> wrote:<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Hi, i'm running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb ram) pg_dump creates an error when exporting a large table with blobs (largest blob is 180mb) error is: pg_dump: ERROR:  out of memory
 DETAIL:  Failed on request of size 1073741823. pg_dump: SQL command to dump the contents of table "downloads" failed: PQendcopy() failed. pg_dump: Error message from server: ERROR:  out of memory 
DETAIL:  Failed on request of size 1073741823. pg_dump: The command was: COPY public.downloads ...  TO stdout; if i try pg_dump with -d dump runs with all types (c,t,p), but i cant restore (out of memory error or corrupt tar header at ...)
 how can i backup (and restore) such a db? kr Thomas ---------------------------(end of broadcast)--------------------------- TIP 4: Have you searched our list archives?                <a href="http://archives.postgresql.org">
http://archives.postgresql.org</a> </blockquote></div>

------=_Part_117153_31269572.1166181556330--

Thomas Markus

nepřečteno,

15. 12. 2006 7:08:1415.12.06

komu:

This is a multi-part message in MIME format.
--------------020202040803040007070908
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit

Hi,

logfile content see http://www.rafb.net/paste/results/cvD7uk33.html
- cat /proc/sys/kernel/shmmax is 2013265920
- ulimit is unlimited
kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit
postmaster process usage is 1.8gb ram atm

thx
Thomas

Shoaib Mir schrieb:

> Can you please show the dbserver logs and syslog at the same time when
> it goes out of memory...
>
> Also how much is available RAM you have and the SHMMAX set?
>
> ------------
> Shoaib Mir

> EnterpriseDB ( www.enterprisedb.com <http://www.enterprisedb.com>)
>
> On 12/15/06, *Thomas Markus* <t.ma...@proventis.net

> <mailto:t.ma...@proventis.net>> wrote:
>
> Hi,
>
> i'm running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb ram)
> pg_dump creates an error when exporting a large table with blobs
> (largest blob is 180mb)
>
> error is:
> pg_dump: ERROR: out of memory
> DETAIL: Failed on request of size 1073741823.
> pg_dump: SQL command to dump the contents of table "downloads" failed:
> PQendcopy() failed.
> pg_dump: Error message from server: ERROR: out of memory
> DETAIL: Failed on request of size 1073741823.
> pg_dump: The command was: COPY public.downloads ... TO stdout;
>
> if i try pg_dump with -d dump runs with all types (c,t,p), but i cant
> restore (out of memory error or corrupt tar header at ...)
>
> how can i backup (and restore) such a db?
>
> kr
> Thomas
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
> http://archives.postgresql.org
>
>

--
Thomas Markus

Tel: +49 30 29 36 399 - 22
Fax: +49 30 29 36 399 - 50
Mail: t.ma...@proventis.net
Web: www.proventis.net
Web: www.blue-ant.de

proventis GmbH
Zimmerstraße 79-80
10117 Berlin

"proventis: Wir bewegen Organisationen."

--------------020202040803040007070908
Content-Type: text/x-vcard; charset=utf-8;
name="t.markus.vcf"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
filename="t.markus.vcf"

begin:vcard
fn:Thomas Markus
n:Markus;Thomas
org:proventis GmbH
adr;dom:;;Zimmerstr. 79-80;Berlin;Berlin;10117
email;internet:t.ma...@proventis.net
tel;work:+49 30 29 36 399 22
x-mozilla-html:FALSE
url:http://www.proventis.net
version:2.1
end:vcard

--------------020202040803040007070908
Content-Type: text/plain
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0

---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?

http://archives.postgresql.org

--------------020202040803040007070908--

Marcelo Costa

nepřečteno,

15. 12. 2006 7:11:4115.12.06

komu:

------=_Part_198065_16064772.1166184590239
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Try see your /tmp directory on your server, this maybe can for an left spac=
e
on your system disk.

[],s

Marcelo.

2006/12/15, Thomas Markus <t.ma...@proventis.net>:

> Zimmerstra=DFe 79-80

> 10117 Berlin
>
> "proventis: Wir bewegen Organisationen."
>
>
>
>

> ---------------------------(end of broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
> http://archives.postgresql.org
>
>
>
>

--=20
Marcelo Costa

------=_Part_198065_16064772.1166184590239
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Try see your /tmp directory on your server, this maybe can for an left spac=
e on your system disk. [],s Marcelo. <div>2006/12/15, Thomas Markus <<a href=3D"mailto:t.markus@p=
roventis.net">
t.ma...@proventis.net</a>>:<blockquote class=3D"gmail_quote" sty=
le=3D"border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex;=
padding-left: 1ex;">Hi, logfile content see <a href=3D"http://www.r=
afb.net/paste/results/cvD7uk33.html">
http://www.rafb.net/paste/results/cvD7uk33.html</a> - cat /proc/sys/kern=
el/shmmax is 2013265920 - ulimit is unlimited kernel is 2.6.15-1-em64=
t-p4-smp, pg version is 8.1.0 32bit postmaster process usage is 1.8gb
ram atm thx Thomas Shoaib Mir schrieb: > Can yo=
u please show the dbserver logs and syslog at the same time when > it=
goes out of memory... > > Also how much is available RAM you h=

ave and the SHMMAX set?

> > ------------ > Shoaib Mir > EnterpriseDB ( <a =
href=3D"http://www.enterprisedb.com">www.enterprisedb.com</a> <<a href=
=3D"http://www.enterprisedb.com">http://www.enterprisedb.com</a>>) &g=
t;
 > On 12/15/06, *Thomas Markus* <<a href=3D"mailto:t.markus@proven=
tis.net">t.ma...@proventis.net</a> > <mailto:<a href=3D"mailto:t.=
mar...@proventis.net">t.ma...@proventis.net</a>>> wrote: > 
>     Hi, > >     i'=
m running pg 8.1.0 on a debian linux (64bit) box (dual xeon 8gb ram) &gt=
;     pg_dump creates an error when exporting a large t=
able with blobs >     (largest blob is 180mb) =
>
 >     error is: >     =
pg_dump: ERROR:  out of memory >     DE=
TAIL:  Failed on request of size 1073741823. >  &=
nbsp;  pg_dump: SQL command to dump the contents of table "downlo=
ads" failed: 
>     PQendcopy() failed. >   &=
nbsp; pg_dump: Error message from server: ERROR:  out of memory<b=
r>>     DETAIL:  Failed on request of size=
1073741823. >     pg_dump: The command was: COPY=

public.downloads ...  TO stdout;

> >     if i try pg_dump with -d dump runs=
with all types (c,t,p), but i cant >     restore=
(out of memory error or corrupt tar header at ...) > > &n=
bsp;   how can i backup (and restore) such a db?
 > >     kr >    =
Thomas > >     ---------------------------=
(end of >     broadcast)-------------------------=
-- >     TIP 4: Have you searched our list archiv=
es? > >         &n=

bsp;          

<a href=3D"http://archives.postgresql.org">http://archives.postgresql.org</=
a> > > -- Thomas Markus Tel:   =
 +49 30 29 36 399 - 22 Fax:    +49 30 29 36 399=
- 50 Mail:   <a href=3D"mailto:t.ma...@proventis.net">
t.ma...@proventis.net</a> Web:    <a href=3D"http:/=
/www.proventis.net">www.proventis.net</a> Web:    <a=
href=3D"http://www.blue-ant.de">www.blue-ant.de</a> proventis GmbH<=
br>Zimmerstra=DFe 79-80 10117 Berlin 
 "proventis: Wir bewegen Organisationen." -=
--------------------------(end of broadcast)--------------------------- =
TIP 4: Have you searched our list archives?     =
           <a href=3D"htt=
p://archives.postgresql.org">
http://archives.postgresql.org</a> </blockquote></div> <b=
r clear=3D"all"> -- Marcelo Costa

------=_Part_198065_16064772.1166184590239--

Shoaib Mir

nepřečteno,

15. 12. 2006 7:18:5915.12.06

komu:

------=_Part_117577_27281510.1166185031505

Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Looks like with 1.8 GB usage not much left for dump to get the required
chunk from memory. Not sure if that will help but try increasing the swap
space...

-------------
Shoaib Mir
EnterpriseDB (www.enterprisedb.com)

On 12/15/06, Thomas Markus <t.ma...@proventis.net> wrote:
>

------=_Part_117577_27281510.1166185031505

Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Looks like with 1.8 GB usage not much left for dump to get the required chu=
nk from memory. Not sure if that will help but try increasing the swap spac=
e... ------------- Shoaib Mir EnterpriseDB (<a href=3D"http://=
www.enterprisedb.com">
www.enterprisedb.com</a>) <div>On 12/15/=
06, Thomas Markus <<a href=3D"mailto:t=
.mar...@proventis.net">t.ma...@proventis.net</a>> wrote:<blockqu=
ote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, 204, 204=
); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Hi, logfile content see <a href=3D"http://www.rafb.net/paste/results=
/cvD7uk33.html">http://www.rafb.net/paste/results/cvD7uk33.html</a> - ca=
t /proc/sys/kernel/shmmax is 2013265920 - ulimit is unlimited kernel =
is=20
2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit postmaster process usag=
e is 1.8gb ram atm thx Thomas Shoaib Mir schrieb: &=
gt; Can you please show the dbserver logs and syslog at the same time when
 > it goes out of memory... > > Also how much is availabl=
e RAM you have and the SHMMAX set? > > ------------ > Sho=
aib Mir > EnterpriseDB ( <a href=3D"http://www.enterprisedb.com">www.=
enterprisedb.com
</a> <<a href=3D"http://www.enterprisedb.com">http://www.enterprisedb.co=
m</a>>) > > On 12/15/06, *Thomas Markus* <<a href=3D"mail=
to:t.ma...@proventis.net">t.ma...@proventis.net</a> > <mailto:<a=
href=3D"mailto:t.ma...@proventis.net">
t.ma...@proventis.net</a>>> wrote: > >   =
  Hi, > >     i'm running pg 8.1.0 on =
a debian linux (64bit) box (dual xeon 8gb ram) >   &nb=
sp; pg_dump creates an error when exporting a large table with blobs
 >     (largest blob is 180mb) > >&nb=
sp;    error is: >     pg_dump: ER=
ROR:  out of memory >     DETAIL: =
 Failed on request of size 1073741823. >    =
pg_dump: SQL command to dump the contents of table "downloads" f=
ailed:
 >     PQendcopy() failed. >  &nb=
sp;  pg_dump: Error message from server: ERROR:  out of memo=
ry >     DETAIL:  Failed on request of =
size 1073741823. >     pg_dump: The command was: =
COPY public.downloads
...  TO stdout; > >     if i try=
pg_dump with -d dump runs with all types (c,t,p), but i cant > =
    restore (out of memory error or corrupt tar header at ..=
.) > >     how can i backup (and restore) s=

uch a db?
 > >     kr >    =
Thomas > >     ---------------------------=
(end of >     broadcast)-------------------------=
-- >     TIP 4: Have you searched our list archiv=
es? > >         &n=
bsp;          
<a href=3D"http://archives.postgresql.org">http://archives.postgresql.org</=
a> > > -- Thomas Markus Tel:   =
 +49 30 29 36 399 - 22 Fax:    +49 30 29 36 399=
- 50 Mail:   <a href=3D"mailto:t.ma...@proventis.net">
t.ma...@proventis.net</a> Web:    <a href=3D"http:/=
/www.proventis.net">www.proventis.net</a> Web:    <a=
href=3D"http://www.blue-ant.de">www.blue-ant.de</a> proventis GmbH<=
br>Zimmerstra=DFe 79-80 10117 Berlin 
 "proventis: Wir bewegen Organisationen." -=
--------------------------(end of broadcast)--------------------------- =
TIP 4: Have you searched our list archives?     =
           <a href=3D"htt=
p://archives.postgresql.org">
http://archives.postgresql.org</a> </blockquote></div>

------=_Part_117577_27281510.1166185031505--

Thomas Markus

nepřečteno,

15. 12. 2006 7:30:4615.12.06

komu:

Hi,

free diskspace is 34gb (underlying xfs) (complete db dump is 9gb). free
-tm says 6gb free ram and 6gb unused swap space.
can i decrease shared buffers without pg restart?

thx
Thomas

Shoaib Mir schrieb:

> Looks like with 1.8 GB usage not much left for dump to get the
> required chunk from memory. Not sure if that will help but try
> increasing the swap space...
>
> -------------
> Shoaib Mir

> EnterpriseDB ( www.enterprisedb.com <http://www.enterprisedb.com>)
>
> On 12/15/06, *Thomas Markus* <t.ma...@proventis.net
> <mailto:t.ma...@proventis.net>> wrote:
>
> Hi,
>
> logfile content see http://www.rafb.net/paste/results/cvD7uk33.html
> - cat /proc/sys/kernel/shmmax is 2013265920
> - ulimit is unlimited
> kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit
> postmaster process usage is 1.8gb ram atm
>
> thx
> Thomas
>
>
> Shoaib Mir schrieb:
> > Can you please show the dbserver logs and syslog at the same
> time when
> > it goes out of memory...
> >
> > Also how much is available RAM you have and the SHMMAX set?
> >
> > ------------
> > Shoaib Mir
> > EnterpriseDB ( www.enterprisedb.com

> <http://www.enterprisedb.com> <http://www.enterprisedb.com>)

> >
> > On 12/15/06, *Thomas Markus* <t.ma...@proventis.net
> <mailto:t.ma...@proventis.net>

> > <mailto: t.ma...@proventis.net

Marcelo Costa

nepřečteno,

15. 12. 2006 7:44:2715.12.06

komu:

------=_Part_198305_10894583.1166186562272
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

To decrease shared buffers you need restart your pgsql.

If do you make on df -h command what is the result, please send.

2006/12/15, Thomas Markus <t.ma...@proventis.net>:

--
Marcelo Costa

------=_Part_198305_10894583.1166186562272

Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

To decrease shared buffers you need restart your pgsql. If do you make on df -h command what is the result, please send. <div>2006/12/15, Thomas Markus <<a href="mailto:t.ma...@proventis.net">
t.ma...@proventis.net</a>>:<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Hi, free diskspace is 34gb (underlying xfs) (complete db dump is 9gb). free
 -tm says 6gb free ram and 6gb unused swap space. can i decrease shared buffers without pg restart? thx Thomas Shoaib Mir schrieb: > Looks like with 1.8 GB usage not much left for dump to get the
 > required chunk from memory. Not sure if that will help but try > increasing the swap space... > > ------------- > Shoaib Mir > EnterpriseDB ( <a href="http://www.enterprisedb.com">www.enterprisedb.com
</a> <<a href="http://www.enterprisedb.com">http://www.enterprisedb.com</a>>) > > On 12/15/06, *Thomas Markus* <<a href="mailto:t.ma...@proventis.net">t.ma...@proventis.net</a> > <mailto:<a href="mailto:t.ma...@proventis.net">
t.ma...@proventis.net</a>>> wrote: > >     Hi, > >     logfile content see <a href="http://www.rafb.net/paste/results/cvD7uk33.html">http://www.rafb.net/paste/results/cvD7uk33.html</a> >     - cat /proc/sys/kernel/shmmax is 2013265920
 >     - ulimit is unlimited >     kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit >     postmaster process usage is 1.8gb ram atm > >     thx >     Thomas > > 
>     Shoaib Mir schrieb: >     > Can you please show the dbserver logs and syslog at the same >     time when >     > it goes out of memory... >     > >     > Also how much is available RAM you have and the SHMMAX set?
 >     > >     > ------------ >     > Shoaib Mir >     > EnterpriseDB ( <a href="http://www.enterprisedb.com">www.enterprisedb.com</a> >     <<a href="http://www.enterprisedb.com">
http://www.enterprisedb.com</a>> <<a href="http://www.enterprisedb.com">http://www.enterprisedb.com</a>>) >     > >     > On 12/15/06, *Thomas Markus* <<a href="mailto:t.ma...@proventis.net">
t.ma...@proventis.net</a> >     <mailto:<a href="mailto:t.ma...@proventis.net">t.ma...@proventis.net</a>> >     > <mailto: <a href="mailto:t.ma...@proventis.net">t.ma...@proventis.net</a> >     <mailto:
<a href="mailto:t.ma...@proventis.net">t.ma...@proventis.net</a>>>> wrote: >     > >     >     Hi, >     > >     >     i'm running pg 8.1.0 on a debian linux (64bit) box (dual
 >     xeon 8gb ram) >     >     pg_dump creates an error when exporting a large table with >     blobs >     >     (largest blob is 180mb) >     > >     >     error is: 
>     >     pg_dump: ERROR:  out of memory >     >     DETAIL:  Failed on request of size 1073741823. >     >     pg_dump: SQL command to dump the contents of table >     "downloads" failed:
 >     >     PQendcopy() failed. >     >     pg_dump: Error message from server: ERROR:  out of memory >     >     DETAIL:  Failed on request of size 1073741823. >     >     pg_dump: The command was: COPY
public.downloads ...  TO stdout; >     > >     >     if i try pg_dump with -d dump runs with all types (c,t,p), >     but i cant >     >     restore (out of memory error or corrupt tar header at ...)
 >     > >     >     how can i backup (and restore) such a db? >     > >     >     kr >     >     Thomas >     > >     >     ---------------------------(end of
 >     >     broadcast)--------------------------- >     >     TIP 4: Have you searched our list archives? >     > >     >                     <a href="http://archives.postgresql.org">http://archives.postgresql.org
</a> >     > >     > > > ---------------------------(end of broadcast)--------------------------- TIP 4: Have you searched our list archives?                <a href="http://archives.postgresql.org">
http://archives.postgresql.org</a> </blockquote></div> -- Marcelo Costa

------=_Part_198305_10894583.1166186562272--

Thomas Markus

nepřečteno,

15. 12. 2006 7:58:5215.12.06

komu:

df -h

Filesystem Size Used Avail Use% Mounted on
/dev/sda5 132G 99G 34G 75% /
tmpfs 4.0G 0 4.0G 0% /dev/shm
/dev/sda1 74M 16M 54M 23% /boot

is there another dump tool that dumps blobs (or all) as binary content
(not as insert statements, maybe directly dbblocks)?

Marcelo Costa schrieb:

> To decrease shared buffers you need restart your pgsql.
>
> If do you make on df -h command what is the result, please send.
>
> 2006/12/15, Thomas Markus < t.ma...@proventis.net

> <mailto:t.ma...@proventis.net>>:

>
> Hi,
>
> free diskspace is 34gb (underlying xfs) (complete db dump is 9gb).
> free
> -tm says 6gb free ram and 6gb unused swap space.
> can i decrease shared buffers without pg restart?
>
> thx
> Thomas
>
> Shoaib Mir schrieb:
> > Looks like with 1.8 GB usage not much left for dump to get the
> > required chunk from memory. Not sure if that will help but try
> > increasing the swap space...
> >
> > -------------
> > Shoaib Mir
> > EnterpriseDB ( www.enterprisedb.com

---------------------------(end of broadcast)---------------------------
TIP 2: Don't 'kill -9' the postmaster

Tom Lane

nepřečteno,

15. 12. 2006 10:46:2915.12.06

komu:

Thomas Markus <t.ma...@proventis.net> writes:
> logfile content see http://www.rafb.net/paste/results/cvD7uk33.html

It looks to me like you must have individual rows whose COPY
representation requires more than half a gigabyte (maybe much more,
but at least that) and the system cannot allocate enough buffer space.

It could be that this is a symptom of corrupted data, if you're certain
that there shouldn't be any such rows in the table.

> kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit

You really need a 64-bit PG build if you want to push
multi-hundred-megabyte field values around --- otherwise there's just
not enough headroom in the process address space. (Something newer than
8.1.0 would be a good idea too.)

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

Thomas Markus

nepřečteno,

18. 12. 2006 4:13:5518.12.06

komu:

Hi,

i tried various ways to backup that db.
if i use a separate 'copy table to 'file' with binary' i can export the
problematic table and restore without problems. resulting outputfile is
much smaller than default output and runtime is much shorter.
is there any way to say pg_dump to use a copy command with option 'with
binary'? it should be possible with the custom or tar format. i searched
the docs and manpage and cant find something.

thx
Thomas

Tom Lane schrieb:

> Thomas Markus <t.ma...@proventis.net> writes:
>
>> logfile content see http://www.rafb.net/paste/results/cvD7uk33.html
>>
>
> It looks to me like you must have individual rows whose COPY
> representation requires more than half a gigabyte (maybe much more,
> but at least that) and the system cannot allocate enough buffer space.
>

yes, msg is DETAIL: Failed on request of size 546321213. (521mb)

> It could be that this is a symptom of corrupted data, if you're certain
> that there shouldn't be any such rows in the table.
>

no

>
>> kernel is 2.6.15-1-em64t-p4-smp, pg version is 8.1.0 32bit
>>
>
> You really need a 64-bit PG build if you want to push
> multi-hundred-megabyte field values around --- otherwise there's just
> not enough headroom in the process address space. (Something newer than
> 8.1.0 would be a good idea too.)
>

i cant change the db installation. but thats another problem