
I had a brief look at this today. Basically, I thought of adding a new 
routine to dumputils.c thus:

    void appendStringLiteralDQ(PQExpBuffer buf, const char *str, const 
char *dqprefix)

and using it in dumping function bodies and comments on all objects, 
with a prefix argument of "function" and "comment" respectively. There 
might be other places where we want to use dollar quoting, but this 
would be a good start, ISTM.

Basically, this routine would start with $ (+ dqprefix if not null) and 
then keep adding characters (in turn "_1234567890") until that string 
was not found in str, then appending "$" and using that as the delimiter.

Thoughts?

cheers

andrew



Tue, 23 Mar 2004 10:08:54 -0500
Andrew Dunstan <andrew@dunslane.net>
dollar quoting and pg_dump
Andrew Dunstan <andrew@dunslane.net> writes:
> ... using it in dumping function bodies and comments on all objects, 
> with a prefix argument of "function" and "comment" respectively. There 
> might be other places where we want to use dollar quoting, but this 
> would be a good start, ISTM.

Do we really need to be that verbose?  Why not start with the minimal $$
and extend only if needed?  On the KISS principle, trying "$$", "$X$",
"$XX$", "$XXX$", etc seems sufficient.

For that matter, I'm not convinced we should use $$ for comments.  They
don't have nearly the problem that functions do with embedded quotes.

A thought: maybe just put this logic into the regular
appendStringLiteral routine, and trigger it when the string contains any
quotes or backslashes; if it has none, you can just use quotes ...

BTW, I've been holding off making this change myself, realizing that it
will completely break backwards compatibility of pg_dump output to 7.4
and earlier.  Not sure if anyone is trying to use CVS tip pg_dump with
older releases, but it seems possible given that the dump ordering issue
is finally solved.  Might be a good idea to make it disablable with a
fallback to regular quoting.

			regards, tom lane

Tue, 23 Mar 2004 10:28:16 -0500
Tom Lane <tgl@sss.pgh.pa.us>
Re: dollar quoting and pg_dump 
Tom Lane wrote:

>Andrew Dunstan <andrew@dunslane.net> writes:
>  
>
>>... using it in dumping function bodies and comments on all objects, 
>>with a prefix argument of "function" and "comment" respectively. There 
>>might be other places where we want to use dollar quoting, but this 
>>would be a good start, ISTM.
>>    
>>
>
>Do we really need to be that verbose?  Why not start with the minimal $$
>and extend only if needed?  On the KISS principle, trying "$$", "$X$",
>"$XX$", "$XXX$", etc seems sufficient.
>  
>

It's a matter of taste, I guess. I'm certainly not dogmatic about it. 
The function design in my head is flexible enough for either.

>For that matter, I'm not convinced we should use $$ for comments.  They
>don't have nearly the problem that functions do with embedded quotes.
>  
>

Well, I keep a master schema file and I like to decorate it with fairly 
verbose comments, so users can see what the object is for and how it 
works. I've been caught a few times with forgetting to double quotes 
inside the comments. But again, Maybe you are right, and we should at 
least start with just the obvious case.

>A thought: maybe just put this logic into the regular
>appendStringLiteral routine, and trigger it when the string contains any
>quotes or backslashes; if it has none, you can just use quotes ...
>  
>

I did think of fallback, but rejected it on the KISS principle :-)  I 
also prefer consistency in style - I want all my functions dollar quoted 
even if they don't currently contain characters in need of escape.

>BTW, I've been holding off making this change myself, realizing that it
>will completely break backwards compatibility of pg_dump output to 7.4
>and earlier.  Not sure if anyone is trying to use CVS tip pg_dump with
>older releases, but it seems possible given that the dump ordering issue
>is finally solved.  Might be a good idea to make it disablable with a
>fallback to regular quoting.
>  
>

Makes sense. "-X disable-dollar-quoting"? Or we could have it turned off 
by default and require it to be specifically turned on - that might 
conform to the principle of least surprise, at least for now.

For that matter, we could also have a "verbose-dollar-quoting" feature, 
and/or a "dollar-quote-objects=functions,comments,......" feature

But let's walk before we start to run ;-)

cheers

andrew




Tue, 23 Mar 2004 11:03:05 -0500
Andrew Dunstan <andrew@dunslane.net>
Re: dollar quoting and pg_dump
Andrew Dunstan <andrew@dunslane.net> writes:
> Tom Lane wrote:
>> A thought: maybe just put this logic into the regular
>> appendStringLiteral routine, and trigger it when the string contains any
>> quotes or backslashes; if it has none, you can just use quotes ...

> I did think of fallback, but rejected it on the KISS principle :-)  I 
> also prefer consistency in style - I want all my functions dollar quoted 
> even if they don't currently contain characters in need of escape.

Good point.  Never mind that idea then.

>> Might be a good idea to make it disablable with a
>> fallback to regular quoting.

> Makes sense. "-X disable-dollar-quoting"? Or we could have it turned off 
> by default and require it to be specifically turned on - that might 
> conform to the principle of least surprise, at least for now.

I don't mind if it's on by default; just thinking that some people might
appreciate a way to turn it off.  "-X disable-dollar-quoting" sounds
fine.

			regards, tom lane

Tue, 23 Mar 2004 11:22:45 -0500
Tom Lane <tgl@sss.pgh.pa.us>
Re: dollar quoting and pg_dump 
Here's my attempt, as discussed earlier today. As always, comments 
welcome.  I did provide (and use) a fallback mechanism after all, for 
the case of a function with a non-empty probin. A few examples from a 
dump of the regression db:

--
-- Name: tg_hub_adjustslots(character, integer, integer); Type: 
FUNCTION; Schema
: public; Owner: andrew
--

CREATE FUNCTION tg_hub_adjustslots(character, integer, integer) RETURNS 
integer
    AS $_$
declare
    hname   alias for $1;
    oldnslots   alias for $2;
    newnslots   alias for $3;
begin
    if newnslots = oldnslots then
        return 0;
    end if;
    if newnslots < oldnslots then
        delete from HSlot where hubname = hname and slotno > newnslots;
    return 0;
    end if;
    for i in oldnslots + 1 .. newnslots loop
        insert into HSlot (slotname, hubname, slotno, slotlink)
        values ('HS.dummy', hname, i, '');
    end loop;
    return 0;
end;
$_$
    LANGUAGE plpgsql;

--
-- Name: ttdummy(); Type: FUNCTION; Schema: public; Owner: andrew
--

CREATE FUNCTION ttdummy() RETURNS "trigger"
    AS '/home/andrew/pgwork/tip/pgsql/src/test/regress/regress.so', 
'ttdummy'
    LANGUAGE c;


--
-- Name: user_relns(); Type: FUNCTION; Schema: public; Owner: andrew
--

CREATE FUNCTION user_relns() RETURNS SETOF name
    AS $$select relname
       from pg_class c, pg_namespace n
       where relnamespace = n.oid and
             (nspname !~ 'pg_.*' and nspname <> 'information_schema') and
             relkind <> 'i' $$
    LANGUAGE sql;



cheers

andrew
Tue, 23 Mar 2004 14:53:06 -0500
Andrew Dunstan <andrew@dunslane.net>
dollar quoting and pg_dump
Andrew Dunstan <andrew@dunslane.net> writes:
> Here's my attempt, as discussed earlier today. As always, comments 
> welcome.  I did provide (and use) a fallback mechanism after all, for 
> the case of a function with a non-empty probin.

Applied with light editorializing ("fallback" seemed a weird description
of what that function was doing, for instance).

At this point I think we are done with the coding part of this project,
and it's time to get to work on the documentation ...

			regards, tom lane

Tue, 23 Mar 2004 17:07:35 -0500
Tom Lane <tgl@sss.pgh.pa.us>
Re: dollar quoting and pg_dump 
Tom Lane wrote:

>Andrew Dunstan <andrew@dunslane.net> writes:
>  
>
>>Here's my attempt, as discussed earlier today. As always, comments 
>>welcome.  I did provide (and use) a fallback mechanism after all, for 
>>the case of a function with a non-empty probin.
>>    
>>
>
>Applied with light editorializing ("fallback" seemed a weird description
>of what that function was doing, for instance).
>
>At this point I think we are done with the coding part of this project,
>and it's time to get to work on the documentation ...
>
>  
>

It is being worked on.

cheers

andrew







Tom Lane wrote:

Andrew Dunstan <andrew@dunslane.net> writes:
  

Here's my attempt, as discussed earlier today. As always, comments 
welcome.  I did provide (and use) a fallback mechanism after all, for 
the case of a function with a non-empty probin.
    


Applied with light editorializing ("fallback" seemed a weird description
of what that function was doing, for instance).

At this point I think we are done with the coding part of this project,
and it's time to get to work on the documentation ...

  


It is being worked on.

cheers

andrew
Tue, 23 Mar 2004 17:15:00 -0500
Andrew Dunstan <andrew@dunslane.net>
Re: dollar quoting and pg_dump
> I don't mind if it's on by default; just thinking that some people might
> appreciate a way to turn it off.  "-X disable-dollar-quoting" sounds
> fine.

Does it _have_ to be dollars?  Other languages call this feature 
'heretext' IIRC.

Chris


Wed, 24 Mar 2004 09:36:16 +0800
Christopher Kings-Lynne <chriskl@familyhealth.com.au>
Re: dollar quoting and pg_dump


Christopher Kings-Lynne wrote:

>> I don't mind if it's on by default; just thinking that some people might
>> appreciate a way to turn it off.  "-X disable-dollar-quoting" sounds
>> fine.
>
>
> Does it _have_ to be dollars?  Other languages call this feature 
> 'heretext' IIRC.
>

This is not heretext, and calling it such would be quite misleading. 
Nobody has yet come up with a better name for it.

cheers

andrew


Tue, 23 Mar 2004 21:28:17 -0500
Andrew Dunstan <andrew@dunslane.net>
Re: dollar quoting and pg_dump
On Wed, 24 Mar 2004, Christopher Kings-Lynne wrote:

> > I don't mind if it's on by default; just thinking that some people might
> > appreciate a way to turn it off.  "-X disable-dollar-quoting" sounds
> > fine.
> 
> Does it _have_ to be dollars?  Other languages call this feature 
> 'heretext' IIRC.

No, but I think the rough consensus was that the behavior of this feature 
is different enough from shell and Perl here documents that it deserved a 
different name. In particular the $ is part of both the opening and 
closing token, and newlines aren't relevant at either the beginning or 
end.

Jon

Wed, 24 Mar 2004 02:36:52 +0000 (UTC)
Jon Jensen <jon@endpoint.com>
Re: dollar quoting and pg_dump
Christopher Kings-Lynne <chriskl@familyhealth.com.au> writes:
> Does it _have_ to be dollars?  Other languages call this feature 
> 'heretext' IIRC.

I'm not in love with the name "dollar quoting" either ... but "here
text" would be quite misleading.  See the archives for the discussions
that led us to develop our definition.  The features that go by that
name usually have dependencies on formatting (ie newline boundaries)
that we specifically rejected.

Right now would be a fine time to invent a better name if you can think
of one ...

			regards, tom lane

Tue, 23 Mar 2004 22:27:57 -0500
Tom Lane <tgl@sss.pgh.pa.us>
Re: dollar quoting and pg_dump 